New Release Checklist: Difference between revisions
From genomewiki
Jump to navigationJump to search
No edit summary |
No edit summary |
||
Line 29: | Line 29: | ||
| | | | ||
|Complete staging of assembly on hgwbeta. | |Complete staging of assembly on hgwbeta. | ||
| | |[[New_Assembly_Release_Process_Details#Stage_and_test_on_hgwbeta | details]] | ||
|-valign="top" | |-valign="top" | ||
Line 35: | Line 35: | ||
| | | | ||
|Check assembly details on hgwbeta, including: BLAT/PCR, GenBank updates, .nib file, default position/tracks, orderKey, gateway page, joinerCheck, indices, makedoc, featureBits. | |Check assembly details on hgwbeta, including: BLAT/PCR, GenBank updates, .nib file, default position/tracks, orderKey, gateway page, joinerCheck, indices, makedoc, featureBits. | ||
| | |[[New_Assembly_Release_Process_Details#Stage_and_test_on_hgwbeta | details]] | ||
|-valign="top" | |-valign="top" | ||
Line 47: | Line 47: | ||
| | | | ||
|Warn Donna K. that the release is imminent so she can update docs. Read everything and test links in downloads, gateway, credits, currentGenomes. | |Warn Donna K. that the release is imminent so she can update docs. Read everything and test links in downloads, gateway, credits, currentGenomes. | ||
| | |[[New_Assembly_Release_Process_Details#Push_Static_Content_from_hgwdev_to_hgwbeta_and_Round_Robin | details]] | ||
|-valign="top" | |-valign="top" | ||
Line 53: | Line 53: | ||
| | | | ||
|Send email to genome-mirror letting them know that there is a new assembly (and exactly how much data) and when it will be released for rsync. Give 24 hours notice. | |Send email to genome-mirror letting them know that there is a new assembly (and exactly how much data) and when it will be released for rsync. Give 24 hours notice. | ||
| | |[[New_Assembly_Release_Process_Details#Push_Data_to_Round_Robin_from_hgwbeta | details]] | ||
|-valign="top" | |-valign="top" |
Revision as of 18:21, 5 April 2010
Start | Complete | Step | Link to details doc |
If the organism has an existing assembly, check to see if chroms have changed in size considerably since the last release of an assembly. |
| ||
Check to see if anyone has given WUStL the heads-up so they can begin doing their N-Scan predictions. Jeltje van Baren: jeltje at cse.wustl.edu (check with markd first). | |||
Ask admins to add your assembly to the exclude list (both the gbdb and mysql rsync download targets) at: hgdownload:/opt/csw/etc/rsyncd.conf. This should be done before syncing /gbdb data to hgnfs1 (i.e., before testing on beta). | |||
Complete staging of assembly on hgwbeta. | details | ||
Check assembly details on hgwbeta, including: BLAT/PCR, GenBank updates, .nib file, default position/tracks, orderKey, gateway page, joinerCheck, indices, makedoc, featureBits. | details | ||
Complete testing of all tracks in sub-pushQ | |||
Warn Donna K. that the release is imminent so she can update docs. Read everything and test links in downloads, gateway, credits, currentGenomes. | details | ||
Send email to genome-mirror letting them know that there is a new assembly (and exactly how much data) and when it will be released for rsync. Give 24 hours notice. | details | ||
Adjust Release Log in main pushQ |
| ||
Check that all of the MySQL tables are in good repair: hgwbeta> sudo dbCheck.sh $db | |||
Request rsync of database: hgwbeta -> RR (email to push-request) | |||
Mark main pushQ entry as “push requested” | |||
Add to genomeClade if needed (only if this is the first release for this organism (e.g. “aaaBbb1”)) | |||
Add line to genome-centdb.hgcentral.dbDb with active set = 0 (use checkMetaData.csh to get exact entry) | |||
Add the two lines to genome-centdb.hgcentral.blatServers | |||
Wait for pushes to RR to be complete | |||
Turn on GenBank automatic updates on on the RR. Follow instructions for turning on updates on beta, but add assembly to rr.dbs instead of hgwbeta.dbs | |||
Test browser on RR by changing db= value in URLs | |||
Request push of downloads hgwdev -> hgdownloads: /usr/local/apache/htdocs/goldenPath/<db>/*. Verify that liftOver files are in /liftOver, NOT in /vsXXX directories. Remember to push pairwise alignments and liftovers (vs the new assembly) from other organisms' databases. | |||
Request dump & autodump of database (send email to cluster-admins to ask for dump to hgdownload into htdocs/goldenPath/$db/database/) | |||
Double check that all appropriate /gbdb files were pushed from dev -> hgnfs1 (during beta testing), including liftOver files. (i.e. compare /gbdb/$db/* dev vs. beta) | |||
Create currentGenomes symlink and request push from hgwdev -> hgdownloads /usr/local/apache/htdocs/goldenPath/currentGenomes/<db_symlink> (this is for the FTP link) | |||
Confirm that hgdownloads, currentGenome, and FTP links are functional | |||
Change line in genome-centdb.hgcentral.dbDb to be active = 1 (this makes the assembly live on RR!) | |||
Enable liftOver on the RR Follow instructions for enabling liftOver on beta, but make changes to hgcentral (not hgcentralbeta): (on hgwdev)"hgsql -h genome-centdb" then in mysql type "use hgcentral" Test hgLiftOver and hgConvert immediately | |||
Complete testing in RR: tracks, PCR, Blat, liftOver, etc. (that required active=1). | |||
Change or add line in genome-centdb.hgcentral.(and in hgcentraltest and hgcentralbeta).defaultDb to point to new DB and test | |||
Send email to Donna K. letting her know it has been pushed, and she will push all static documents. Test all of her files. Test links in downloads, gateway, credits, currentGenomes. |
| ||
For human, mouse and rat (KG assemblies), ask for push of htdocs/knownGeneList/$db/* and knownGeneLists.html | |||
Ask admins to remove your assembly from the exclude list at: hgdownload:/etc/rsyncd.conf and alert genome-mirror. | |||
If this is a new species, send an email to Branwyn (bwagman@ucsc.edu) so she can determine whether or not to announce on the CBSE website. |
| ||
Notify cluster-admin that new assembly is complete and ask for push to genome-mysql. Remind them to make permissions for users "genome" and "genomep", and update the mysql.db table permissions. | |||
Push net and chain tracks in other organisms, taking care to edit and push trackDb as necessary. If these tracks are replacing nets and chains to a previous assembly, drop those tracks and notify the mirrors. | |||
Click on “done!” in main pushQ for this assembly (the release log will be updated the next morning) |
| ||
Retire the assembly sub pushQ using retirePushQ.csh from hgwdev. Make sure there are release log entries for the net and chain tracks in other databases. (The script will remove release log notes for all push queue entries where dbs=$db.) | |||
Update hgcentral.sql: cd $WEEKLYBLD; Run buildHgCentralSql.csh real (can run w/o 'real' to just see diffs). Ask for a push of hgcentral.sql to hgdownload. (Or just ask the buildmeister to do this.) | |||
Double check next day: release log, database dump/autodump, genome-mysql, genbank auto-update, downloads (bigZip autodownloads) |
|