NAME
proc_gaps - process gap data and build baler gap list
SYNOPSIS
proc_gaps [-v] [-V] [-n]
[-p pf] [-m mail_to]
sync_file YYYY MM
SUPPORT
Contributed code: NO BRTT support.
THIS PIECE OF SOFTWARE WAS CONTRIBUTED BY THE ANTELOPE USER COMMUNITY. BRTT DISCLAIMS ALL OWNERSHIP, LIABILITY, AND SUPPORT FOR THIS PIECE OF SOFTWARE.
FOR HELP WITH THIS PIECE OF SOFTWARE, PLEASE CONTACT THE CONTRIBUTING AUTHOR.
DESCRIPTION
proc_gaps uses a collection of scripts build the best estimate of missing real-time
data which has
been recovered from the balers and generates a new baler request list for
baler_admin.
proc_gaps requires a
sync_file which is a gap list generated by the DMC. The other
required inputs are the year and month of data to process input in the form of
YYYY MM.
The sequence of scripts executed by
proc_gaps the first time each
YYYY MM is processed
are:
-
miniseed2db
builds rtdirbase/YYYY_MM/dbbase_YYYY_MM wfdisc of data collected from wfdirbase.
In the process the wfdisc dir field is set to its absolute path, and the
lastid,snetsta,schanloc tables are removed.
-
dmcgap2db
builds rtdirbase/YYYY_MM/dmcgapbase_YYYY_MM gap table for missing data from DMC sync_file.
-
rt_daily_return
builds rtdirbase/YYYY_MM/dbbase_YYYY_MM gap, netperf, and chanperf tables. Also a
rtdirbase/YYYY_MM/dbbase_YYYY_MM descriptor file is created immediately before this step.
-
build_baler_data
builds cleanbalerdirbase/YYYY_MM/baler database combining all approrpiate data
under balerdb_central.
-
gap_status
Evaluate whether TA and DMC gaps have been filled by previous baler recoveries
-
baler_request
Generate baler request file for baler_admin
The scripts executed by proc_gaps for subsequent processing of YYYY MM are the same
as above, except that the miniseed2db, dmcgap2db, and rt_daily_return steps are skipped since
they only need to be excecuted once for each month of data.
OPTIONS
-
-v
verbose
-
-V
Extremely verbose. Used for debugging purposes only.
-
-n
Test mode. Does not execute commands.
-
-p parameter_file
Name of parameter file to use. $PFPATH is searched to find parameter file.
The default parameter file is proc_gaps.
-
-m mail_to
email address list to send results.
ENVIRONMENT
needs to have sourced $ANTELOPE/setup.csh.
PARAMETER FILE
-
dbbase
db dbbasename
-
dmcgapbase
dmc gap dbbasename
-
period
allowed values are "year" or "month"
-
clustername
dbcentral cluster name
-
rtdirbase
Path name for directory base for wfdiscs of monthly realtime waveform data.
-
cleanbalerdirbase
Path name for directory base for databases containing cleaned monthly baler waveform data.
-
wfdirbase
Path name for directory base original realtime waveform data.
-
requestdir
path name for baler request directory
-
balerdb_central
dbcentral for baler data recoveries
-
balerwfdisc
path name for complete baler wfdisc db
-
archivebase
Absolute path name for output directory containing station directories with station database
-
dbidserver
Name of idserver to be written into descriptor file for output database to use.
-
dbpath
dbpath to be written into descriptor file for output database to use.
-
dblocks
dblocking type for database
EXAMPLE PARAMETER FILE
dbbase usarray # db dbbasename
dmcgapbase dmc # dmc gap dbbasename
period month # allowed values are "year" or "month"
clustername baler_data # dbcentral cluster name
rtdirbase /anf/TA/dbs/event_dbs # should be on a different disk than the rtdb
cleanbalerdirbase /anf/TA/build/baler # should be on a different disk than the rtdb
wfdirbase /anf/TA/dbs/certified # should be on a different disk than the rtdb
requestdir /anf/TA/baler/requests # baler request directory
balerdb_central /anf/TA/baler/all_ta_data # dbcentral for baler data recoveries
balerwfdisc /anf/TA/baler/db/all # complete baler wfdisc db
archivebase /anf/TA/wf/archive # should be on a different disk than the rtdb
dbpath /anf/TA/dbs/dbmaster/{usarray}:/anf/TA/dbs/dbops/{usarray} # default dbpath
dbidserver anfanalyst.ucsd.edu:2498 # default dbidserver
dblocks nfs # default dblocks
RETURN VALUES
0 if successful, 1 if not.
SEE ALSO
baler_request(1)
baler2db(1)
build_baler_data(1)
gap_status(1)
dbcentral(1)
dmcgap2db(1)
rt_baler_info(1)
rt_daily_return(1)
BUGS AND CAVEATS
proc_gaps should only be run after baler data are collected and installed
into
balerdb_central using
baler2db.
AUTHOR
Frank Vernon
Antelope User Group Contributed Software