Decompressing/loading data and monitoring Last mod Sep 26, 1994 R. Pain A) Decompressing, loading Decompressing and loading the data into the database is automatically done as soon as a compressed file has been transfered on disk (eg. /home/astro5/deepsearch/kpnodata for kittpeak data) provide the program load.csh has been started (and is running) at the beginning of the night. Before starting the program make sure the uncompressed files are stored in the correct directory by copying load.csh from $DEEPHOME/bin and setting the variables DATADIR and FINALDIR respectively to : the directory where the transfered files arrive and the directory you want the files to end (eg. /home/astro5/deepsearch). Then start the program by typing : load.csh . From time to time, check that the program is still running. If crashed, check that there is space enough on FINALDIR (known reason for crashes) , change FINALDIR if needed and restart the program. ATENTION : Loading data is done assuming all default values (eg filter and renaming) to be accepted. If you want to change some parameters, edit load.csh and modify the making of the intermediate file load.dat (echo xx statements) with your choices. B) Monitoring the data The purpose of monitoring is primeraly to estimate the exposure lenght to reach a given magnitude. The predicted exposure length are for 1 new image ie the number should be DOUBLE if you are taking a 1 image reference field The seeing is also calculated and a few plots give some hints about the data quality. Monitoring every third of fourth image should be easily achievable. The time distribution of the seeing and the transmission can then be checked when enough runs have been processed. three IDL program are existing : 1 - Moniclean : Does a rough cleanning of a given run and save locally for later use : - the photometry list ( .pho files) - the ims structure (.ims files ) The cleaned image may optionaly be saved 2 - Monimatch : Matches the image with the APM catalog and calculate the magnitude zero point and the exposure lenght to reach a given magnitude at some sigma level (3,5,7) 3 - Monitime : plot the time dependence of the seeing and the zeropoint and of the seeing and transmission ratios wrt a choosen reference run. Monitime uses the result of monimatch processing which uses the result of moniclean processing. It's useful to have two IDL sessions, One for running moniclean and the second one for the 2 other programs. B-1 MONICLEAN : Before running this program, you should have determined a bias value and decide on which flat to use. MINIMAL SYNTAX : moniclean,imagename,bias=bias,flat=flat_imagename eg. moniclean,'sep1294kp4m158raw.fts',bias=260.,flat='sep1094kp4m28raw.fts' The program ask for another image to process when it's done with the first one. Give a filename (no quotes) or X (upper case) to exit. eg : Please enter new file name to clean (X to eXit) :sep1294kp4m161raw.fts Do it on a few runs to check if the cleaning is satisfactory. Once you are satisfied, you can edit the program and change the defaults bias and flatname for later running and type only : moniclean,imagename OPTIONS : You can - used cleaned images : eg moniclean,'sep1294kp4m158ebs.fts',/dontclean - not surfed the image : eg: moniclean,'sep1294kp4m158raw.fts',/dontsurf - force displaying the raw and cleaned image with : /display - force saving the cleaned image with : /save - calculate aperture photometry in a fraction of the Full with (the default) by typing eg : moniclean,'sep1294kp4m158raw.fts',frac=.67 OUTPUT : the seeing value is printed in pixel and arc second PLOTS: Two pages are displayed : - page 1 : Histo of FWHM in the x direction (ra) and y direction (dec) This allows to decide where to cut for cosmics rays (eg. 1.5 pixels) for the seeing calculation and objects selection. - Page 2 : Spatial distribution of found objects, galaxy like objects, star like objects and saturated objects. A out of focus image will show a abnormally big hole in the star like objects distribution. B-2 MONIMATCH : Once a image has been cleaned and its photometry list saved you can run monimatch. MINIMAL SYNTAX : monimatch,imagename(s) eg. monimatch,'sep1294kp4m158raw.fts' or monimatch,list_of_file where list_of_file is an IDL string array of n imagesnames OPTIONS : use keyword frac when the image has been processed with moniclean using this keyword eg : monimatch,'sep1294kp4mraw.fts',frac=.67 OUTPUT : the value of the zeropoint and the predisctions for exposure lengths to reach m=22.5 and 23 at 3, 5 and 8 sigma signal to noise levels are printed PLOTS: 4 pages are displayed : Page 1 : The Aperture electrons per second vs APM magnitude . A typical number is : 700 electrons/s in 1 FWHM for m=19 Page 2 : The Zeropoint distributions for all object and APM stars only. Typical central value is : 26.2 with a FWHM of 0.5 The Zeropoint vs APM and CCD magnitude. Should be flat. Page 3 : APM magnitude vs CCD magnitude of all objects and "good" APM stars ( (17