Monitoring Tasks: Difference between revisions

From Genecats
Jump to navigationJump to search
No edit summary
(Adding new column for reshuffling and a new cronjob that BrianR has for GeneReviews)
Line 4: Line 4:
<th>task</th>
<th>task</th>
<th>frequency</th>
<th>frequency</th>
<th>who NOW (starting Aug '13)</th>
<th>who NOW (starting Aug '14)</th>
<th>who was before</th>
<th>who Aug '13 - Jul '14</th>
<th>who before</th>
</tr>
</tr>


Line 15: Line 16:
<td>ask Galt/Jim about blat updates</td>
<td>ask Galt/Jim about blat updates</td>
<td>3x per year</td>
<td>3x per year</td>
<td></td>
<td>Pauline, Steve, Jonathan</td>
<td>Pauline, Steve, Jonathan</td>
<td>Pauline, Steve, Jonathan</td>
<td>Pauline, Steve, Jonathan</td>
Line 22: Line 24:
<td>Respond to items on the broken links report: Check to make sure that broken links reported are actually broken.  If so, fix the link if it is clear what the new link should be and push to the RR.  If not, contact the appropriate person at the web site in question to find out what the new link should be.</td>
<td>Respond to items on the broken links report: Check to make sure that broken links reported are actually broken.  If so, fix the link if it is clear what the new link should be and push to the RR.  If not, contact the appropriate person at the web site in question to find out what the new link should be.</td>
<td>daily</td>
<td>daily</td>
<td></td>
<td>Matt</td>
<td>Matt</td>
<td>Steve</td>
<td>Steve</td>
Line 29: Line 32:
<td>Respond to the trackDbGlobal report: Make public and request a push of trackDb and friends for any assemblies that show up as changed in the trackDbGlobal report.</td>
<td>Respond to the trackDbGlobal report: Make public and request a push of trackDb and friends for any assemblies that show up as changed in the trackDbGlobal report.</td>
<td>weekly</td>
<td>weekly</td>
<td></td>
<td>Luvina</td>
<td>Luvina</td>
<td>Steve</td>
<td>Steve</td>
Line 36: Line 40:
<td>receive output from hgTracksRandom cron; alert admins to problems</td>
<td>receive output from hgTracksRandom cron; alert admins to problems</td>
<td>as needed</td>
<td>as needed</td>
<td></td>
<td>many: kuhn, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper, matt</td>
<td>many: kuhn, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper, matt</td>
<td>many: kuhn, rhead, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper</td>
<td>many: kuhn, rhead, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper</td>
Line 43: Line 48:
<td>receive output from gbLoaded cron job and alert braney if anything seems very outdated</td>
<td>receive output from gbLoaded cron job and alert braney if anything seems very outdated</td>
<td>daily, problems every 3-6 months</td>
<td>daily, problems every 3-6 months</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
Line 50: Line 56:
<td>receive output from showProcesslist.csh</td>
<td>receive output from showProcesslist.csh</td>
<td>daily, no action</td>
<td>daily, no action</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
Line 57: Line 64:
<td>get output from checkTableStatus.csh on Mondays (this is a report on whether the genbank table dumps are up-to-date...if we could get rid of our dependence on those, we could get rid of this cron job)</td>
<td>get output from checkTableStatus.csh on Mondays (this is a report on whether the genbank table dumps are up-to-date...if we could get rid of our dependence on those, we could get rid of this cron job)</td>
<td>weekly</td>
<td>weekly</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
Line 64: Line 72:
<td>get an email from backupCentral.csh each month (there's a redmine ticket on whether we should change this one: http://redmine.soe.ucsc.edu/issues/7834)</td>
<td>get an email from backupCentral.csh each month (there's a redmine ticket on whether we should change this one: http://redmine.soe.ucsc.edu/issues/7834)</td>
<td>monthly</td>
<td>monthly</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
Line 71: Line 80:
<td>receive an email on additions and subtractions to files in /gbdb on hgnfs1</td>
<td>receive an email on additions and subtractions to files in /gbdb on hgnfs1</td>
<td>daily</td>
<td>daily</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
Line 78: Line 88:
<td>receive an email from cron if qateam DailySandboxUpdate fails</td>
<td>receive an email from cron if qateam DailySandboxUpdate fails</td>
<td>daily</td>
<td>daily</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
Line 85: Line 96:
<td>receive output from checkMetaAday.csh; alert (steve, jcasper) if anything is out of sync (compares hgcentralbeta to hgcentral for db of the day)</td>
<td>receive output from checkMetaAday.csh; alert (steve, jcasper) if anything is out of sync (compares hgcentralbeta to hgcentral for db of the day)</td>
<td>daily</td>
<td>daily</td>
<td></td>
<td>Matt</td>
<td>Matt</td>
<td>Luvina</td>
<td>Luvina</td>
Line 92: Line 104:
<td>receive output from syncAday.csh; alert (steve, jcasper) if anything is out of sync (checks that tables are in sync between beta and RR for database of the day) </td>
<td>receive output from syncAday.csh; alert (steve, jcasper) if anything is out of sync (checks that tables are in sync between beta and RR for database of the day) </td>
<td>daily</td>
<td>daily</td>
<td></td>
<td>Brian</td>
<td>Brian</td>
<td>Luvina</td>
<td>Luvina</td>
Line 99: Line 112:
<td>get output from checkGenomeMysql</td>
<td>get output from checkGenomeMysql</td>
<td>daily</td>
<td>daily</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
<td>Brooke, Steve, Jonathan</td>
Line 110: Line 124:
<td>receive cron output for tableDescriptions build errors</td>
<td>receive cron output for tableDescriptions build errors</td>
<td>rare</td>
<td>rare</td>
<td></td>
<td>Pauline, Matt</td>
<td>Pauline, Matt</td>
<td>Brooke, Pauline</td>
<td>Brooke, Pauline</td>
Line 121: Line 136:
<td>run ReleaseLog script (this requires a copy of the kent repository)</td>
<td>run ReleaseLog script (this requires a copy of the kent repository)</td>
<td>daily</td>
<td>daily</td>
<td></td>
<td>Galt (if QA takes this over, Pauline will do it)</td>
<td>Galt (if QA takes this over, Pauline will do it)</td>
<td>Galt</td>
<td>Galt</td>
Line 128: Line 144:
<td>back up the qapushq</td>
<td>back up the qapushq</td>
<td>every 30 minutes during the work day/week</td>
<td>every 30 minutes during the work day/week</td>
<td></td>
<td>Galt</td>
<td>Galt</td>
<td>Galt</td>
<td>Galt</td>
Line 139: Line 156:
<td>braney has a cron that runs /cluster/bin/x86_64/hubPublicCheck and complains when the hubPublic table doesn't have the same strings as the actual hub.txt file. This should be claimed by a QAer and transferred to the qateam cron.</td>
<td>braney has a cron that runs /cluster/bin/x86_64/hubPublicCheck and complains when the hubPublic table doesn't have the same strings as the actual hub.txt file. This should be claimed by a QAer and transferred to the qateam cron.</td>
<td>runs daily, complains rarely?</td>
<td>runs daily, complains rarely?</td>
<td></td>
<td>Brian Lee</td>
<td>Brian Lee</td>
<td>braney</td>
<td>braney</td>
Line 146: Line 164:
<td>braney has a cron that runs /hive/data/outside/otto/omim/omimWrapper.sh that checks for new OMIM data and downloads and loads it into hgwdev if so</td>
<td>braney has a cron that runs /hive/data/outside/otto/omim/omimWrapper.sh that checks for new OMIM data and downloads and loads it into hgwdev if so</td>
<td>runs daily, complains bi-weekly</td>
<td>runs daily, complains bi-weekly</td>
<td></td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
Line 154: Line 173:
<td>braney has a cron that runs /hive/data/outside/otto/omim/omimUploadWrapper.sh that uploads the OMIM tables to OMIM</td>
<td>braney has a cron that runs /hive/data/outside/otto/omim/omimUploadWrapper.sh that uploads the OMIM tables to OMIM</td>
<td>runs weekly, complains rarely</td>
<td>runs weekly, complains rarely</td>
<td></td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
Line 161: Line 181:
<td>braney has a cron that runs /hive/data/outside/otto/decipher/decipherWrapper.sh that checks for new DECIPHER data and downloads and loads it into hgwdev if so</td>
<td>braney has a cron that runs /hive/data/outside/otto/decipher/decipherWrapper.sh that checks for new DECIPHER data and downloads and loads it into hgwdev if so</td>
<td>runs daily, complains monthly</td>
<td>runs daily, complains monthly</td>
<td></td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
Line 168: Line 189:
<td>braney has a cron that runs /hive/data/outside/otto/isca/iscoWrapper.sh that checks for new ISCA data and downloads and loads it into hgwdev if so</td>
<td>braney has a cron that runs /hive/data/outside/otto/isca/iscoWrapper.sh that checks for new ISCA data and downloads and loads it into hgwdev if so</td>
<td>runs daily, complains monthly</td>
<td>runs daily, complains monthly</td>
<td></td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
Line 175: Line 197:
<td>braney has a cron that runs /hive/data/outside/otto/gwas/gwasWrapper.sh that checks for new GWAS data and downloads and loads it into hgwdev if so</td>
<td>braney has a cron that runs /hive/data/outside/otto/gwas/gwasWrapper.sh that checks for new GWAS data and downloads and loads it into hgwdev if so</td>
<td>runs daily, complains quarterly</td>
<td>runs daily, complains quarterly</td>
<td></td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
<td>braney</td>
</tr>
</tr>


<tr>
<td>braney has a cron that runs /hive/data/outside/otto/geneReviews/geneReviewsWrapper.sh that checks for new GeneReviews data and downloads and loads it into hgwdev if so</td>
<td>runs daily, complains quarterly</td>
<td></td>
<td>braney</td>
<td>braney</td>
</tr>
<tr>
<tr>
<td colspan="4" style="background-color:gray"><b>from ann's cron</b></td>
<td colspan="4" style="background-color:gray"><b>from ann's cron</b></td>
Line 186: Line 216:
<td>Ann has a cron that sends a reminder to check the list of folks who have mirror sites. This list is created by a script of Hiram's and located here: http://genome-test.cse.ucsc.edu/admin/tools/useCount.html. The information comes from the phoneHome program in the CGIs. Sometimes companies set up mirrors, which is not OK.</td>
<td>Ann has a cron that sends a reminder to check the list of folks who have mirror sites. This list is created by a script of Hiram's and located here: http://genome-test.cse.ucsc.edu/admin/tools/useCount.html. The information comes from the phoneHome program in the CGIs. Sometimes companies set up mirrors, which is not OK.</td>
<td>monthly</td>
<td>monthly</td>
<td></td>
<td>Pauline</td>
<td>Pauline</td>
<td>Ann</td>
<td>Ann</td>
Line 197: Line 228:
<td>Check old forum (http://redmine.soe.ucsc.edu/forum/index.php) for MLQs that may have slipped through the cracks: Check to make sure that the last response for every ticket came from one of us.  If not, look it up in redmine to ensure that A) there is indeed a redmine ticket for it, and B) it has been responded to.  If not, notify the appropriate MLM with as much information about the MLQ as possible.</td>
<td>Check old forum (http://redmine.soe.ucsc.edu/forum/index.php) for MLQs that may have slipped through the cracks: Check to make sure that the last response for every ticket came from one of us.  If not, look it up in redmine to ensure that A) there is indeed a redmine ticket for it, and B) it has been responded to.  If not, notify the appropriate MLM with as much information about the MLQ as possible.</td>
<td>weekly</td>
<td>weekly</td>
<td></td>
<td>Luvina</td>
<td>Luvina</td>
<td>Steve</td>
<td>Steve</td>
Line 204: Line 236:
<td>update sla.html whenever we have RR downtime</td>
<td>update sla.html whenever we have RR downtime</td>
<td>hopefully, not much!</td>
<td>hopefully, not much!</td>
<td></td>
<td>Steve, Jonathan</td>
<td>Steve, Jonathan</td>
<td>Brooke, Pauline</td>
<td>Brooke, Pauline</td>
Line 211: Line 244:
<td>update crontab in genecats/qa/crontabs/*.crontab (and [http://genomewiki.cse.ucsc.edu/genecats/index.php/Updating_QA_crontabs log in as qateam and restart the qateam crontab] with updates)</td>
<td>update crontab in genecats/qa/crontabs/*.crontab (and [http://genomewiki.cse.ucsc.edu/genecats/index.php/Updating_QA_crontabs log in as qateam and restart the qateam crontab] with updates)</td>
<td>as needed</td>
<td>as needed</td>
<td></td>
<td>Pauline, Jonathan</td>
<td>Pauline, Jonathan</td>
<td>Brooke, Pauline</td>
<td>Brooke, Pauline</td>
Line 222: Line 256:
<td>Check genome-preview with Selenium test, ensures various big ENCODE tracks are accessible, and that machine is still running</td>
<td>Check genome-preview with Selenium test, ensures various big ENCODE tracks are accessible, and that machine is still running</td>
<td>weekly</td>
<td>weekly</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
Line 229: Line 264:
<td>Receive validation checks on ENCODE cv.ra metadata, but won't change unless cv.ra changes</td>
<td>Receive validation checks on ENCODE cv.ra metadata, but won't change unless cv.ra changes</td>
<td>rare/never</td>
<td>rare/never</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
Line 236: Line 272:
<td>Update broken links from cron on hgEncodeVocab/cv.ra checkLinks</td>
<td>Update broken links from cron on hgEncodeVocab/cv.ra checkLinks</td>
<td>rare, fixes needed about once a month</td>
<td>rare, fixes needed about once a month</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>
<td>Brian</td>

Revision as of 19:45, 30 July 2014

task frequency who NOW (starting Aug '14) who Aug '13 - Jul '14 who before
from qateam cron
ask Galt/Jim about blat updates 3x per year Pauline, Steve, Jonathan Pauline, Steve, Jonathan
Respond to items on the broken links report: Check to make sure that broken links reported are actually broken. If so, fix the link if it is clear what the new link should be and push to the RR. If not, contact the appropriate person at the web site in question to find out what the new link should be. daily Matt Steve
Respond to the trackDbGlobal report: Make public and request a push of trackDb and friends for any assemblies that show up as changed in the trackDbGlobal report. weekly Luvina Steve
receive output from hgTracksRandom cron; alert admins to problems as needed many: kuhn, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper, matt many: kuhn, rhead, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper
receive output from gbLoaded cron job and alert braney if anything seems very outdated daily, problems every 3-6 months Steve, Jonathan Brooke, Steve, Jonathan
receive output from showProcesslist.csh daily, no action Steve, Jonathan Brooke, Steve, Jonathan
get output from checkTableStatus.csh on Mondays (this is a report on whether the genbank table dumps are up-to-date...if we could get rid of our dependence on those, we could get rid of this cron job) weekly Steve, Jonathan Brooke, Steve, Jonathan
get an email from backupCentral.csh each month (there's a redmine ticket on whether we should change this one: http://redmine.soe.ucsc.edu/issues/7834) monthly Steve, Jonathan Brooke, Steve, Jonathan
receive an email on additions and subtractions to files in /gbdb on hgnfs1 daily Steve, Jonathan Brooke, Steve, Jonathan
receive an email from cron if qateam DailySandboxUpdate fails daily Steve, Jonathan Brooke, Steve, Jonathan
receive output from checkMetaAday.csh; alert (steve, jcasper) if anything is out of sync (compares hgcentralbeta to hgcentral for db of the day) daily Matt Luvina
receive output from syncAday.csh; alert (steve, jcasper) if anything is out of sync (checks that tables are in sync between beta and RR for database of the day) daily Brian Luvina
get output from checkGenomeMysql daily Steve, Jonathan Brooke, Steve, Jonathan
from build cron
receive cron output for tableDescriptions build errors rare Pauline, Matt Brooke, Pauline
from galt's cron
run ReleaseLog script (this requires a copy of the kent repository) daily Galt (if QA takes this over, Pauline will do it) Galt
back up the qapushq every 30 minutes during the work day/week Galt Galt
from braney's cron
braney has a cron that runs /cluster/bin/x86_64/hubPublicCheck and complains when the hubPublic table doesn't have the same strings as the actual hub.txt file. This should be claimed by a QAer and transferred to the qateam cron. runs daily, complains rarely? Brian Lee braney
braney has a cron that runs /hive/data/outside/otto/omim/omimWrapper.sh that checks for new OMIM data and downloads and loads it into hgwdev if so runs daily, complains bi-weekly braney braney
braney has a cron that runs /hive/data/outside/otto/omim/omimUploadWrapper.sh that uploads the OMIM tables to OMIM runs weekly, complains rarely braney braney
braney has a cron that runs /hive/data/outside/otto/decipher/decipherWrapper.sh that checks for new DECIPHER data and downloads and loads it into hgwdev if so runs daily, complains monthly braney braney
braney has a cron that runs /hive/data/outside/otto/isca/iscoWrapper.sh that checks for new ISCA data and downloads and loads it into hgwdev if so runs daily, complains monthly braney braney
braney has a cron that runs /hive/data/outside/otto/gwas/gwasWrapper.sh that checks for new GWAS data and downloads and loads it into hgwdev if so runs daily, complains quarterly braney braney
braney has a cron that runs /hive/data/outside/otto/geneReviews/geneReviewsWrapper.sh that checks for new GeneReviews data and downloads and loads it into hgwdev if so runs daily, complains quarterly braney braney
from ann's cron
Ann has a cron that sends a reminder to check the list of folks who have mirror sites. This list is created by a script of Hiram's and located here: http://genome-test.cse.ucsc.edu/admin/tools/useCount.html. The information comes from the phoneHome program in the CGIs. Sometimes companies set up mirrors, which is not OK. monthly Pauline Ann
non-cron jobs
Check old forum (http://redmine.soe.ucsc.edu/forum/index.php) for MLQs that may have slipped through the cracks: Check to make sure that the last response for every ticket came from one of us. If not, look it up in redmine to ensure that A) there is indeed a redmine ticket for it, and B) it has been responded to. If not, notify the appropriate MLM with as much information about the MLQ as possible. weekly Luvina Steve
update sla.html whenever we have RR downtime hopefully, not much! Steve, Jonathan Brooke, Pauline
update crontab in genecats/qa/crontabs/*.crontab (and log in as qateam and restart the qateam crontab with updates) as needed Pauline, Jonathan Brooke, Pauline
ENCODE
Check genome-preview with Selenium test, ensures various big ENCODE tracks are accessible, and that machine is still running weekly Brian Brian Brian
Receive validation checks on ENCODE cv.ra metadata, but won't change unless cv.ra changes rare/never Brian Brian Brian
Update broken links from cron on hgEncodeVocab/cv.ra checkLinks rare, fixes needed about once a month Brian Brian Brian
Retrieved from "https://genomewiki.ucsc.edu/genecats/index.php?title=Monitoring_Tasks&oldid=1910"