Euronode: Difference between revisions

From Genecats
Jump to navigationJump to search
No edit summary
Line 13: Line 13:
  browser.node=2
  browser.node=2


We may add other nodes in the future (e.g. in asia).
We may add other nodes in the future (e.g. in asia). If this configuration variable is not found, the redirection code is not executed (e.g. this will be the case in traditional mirrors).


The table <tt>hgFixed.gbNodeReal</tt> contains the metadata for each node (e.g. domain, country and description).
In the following discussion, <tt>hgcentral</tt> applies to RR, <tt>hgcentraltest</tt> applies to hgwdev. RR will include euronode.cse.ucsc.edu when we activate the euronode.


The table <tt>hgcentral.geoIpNode</tt> is used to map a user's IP to the appropriate node. If an IP is not found in geoIpNode, the system assumes the user belongs in node 1 (UCSC).
The table <tt>hgcentral.gbNode</tt> contains the metadata for each node (e.g. domain, country and description). This is a copy of <tt>hgFixed.gbNodeReal</tt> (so we can modify on hgwdev).


hgcentral.geoIpNode is based on <tt>hgFixed.geoIpNode</tt>, which built by Galt using a publicly available IP => country mapping database. The copy in hgcentral may be modified (e.g. to add the IP used by QA team for testing).
The table <tt>hgcentral.geoIpNode</tt> is used to map a user's IP to the appropriate node. If an IP is not found in geoIpNode, the system assumes the user belongs in node 1 (California). hgcentral.geoIpNode is based on <tt>hgFixed.geoIpNode</tt>, which was built by Galt using a publicly available IP => country mapping database (http://software77.net/geo-ip). The copy in hgcentral may be modified (e.g. to add the IP used by QA team for testing).


Note that the IP's are stored in the tables using a numeric representation (for speed). mysql has a built in function, <tt>INET_ATON</tt>, which can be used to convert the dotted-quad notation to the numeric form; e.g. to add a new entry to geoIpNode:
Note that the IPs are stored in the tables using a numeric representation (for speed). mysql has a built in function, <tt>INET_ATON</tt>, which can be used to convert the dotted-quad notation to the numeric form; e.g. to add a new entry to geoIpNode:


  hgsql hgcentral -s -e "insert into geoIpNode VALUES (INET_ATON('128.114.49.36'), INET_ATON('128.114.49.36'), 2)"
  hgsql hgcentral -s -e "insert into geoIpNode VALUES (INET_ATON('128.114.49.36'), INET_ATON('128.114.49.36'), 2)"
Line 33: Line 33:
Users are only redirected via hgGateway; e.g. if a european goes directly to <tt>http://genome.ucsc.edu/cgi-bin/hgTracks</tt>, they will not be redirected back to europe. The rationale for this is that such links may include sessions that are specific to the California mirror.
Users are only redirected via hgGateway; e.g. if a european goes directly to <tt>http://genome.ucsc.edu/cgi-bin/hgTracks</tt>, they will not be redirected back to europe. The rationale for this is that such links may include sessions that are specific to the California mirror.


The first time a user is redirected, they will see a little dialog box at the top of hgGateway that let's them override the redirect; e.g. if user X is redirected to euronode, they may click on the link in the box to get back to the Californian hgGateway. This action is remembered with a cookie stored in the user's web browser (in this example, the cookie would be <tt>redirect=genome.ucsc.edu</tt>). This cookie is not cleared by a cartReset (this is intentional). The user will always be able to switch which mirror they are using via a to-be-designed UI.
The first time a user is redirected, they will see a little dialog box at the top of hgGateway that let's them override the redirect; e.g. if user X is redirected to euronode, they may click on the link in the box to get back to the Californian hgGateway. This action is remembered with a cookie stored in the user's web browser (the value of the cookie will be <tt>redirect=manual</tt>). This cookie is not cleared by a cartReset (this is intentional). The user will always be able to switch which mirror they are using via a to-be-designed UI.
 
[[File:euronode.jpg]]


== How do I test this? ==
== How do I test this? ==


We are putting the IP of hgroaming.cse.ucsc.edu (128.114.49.36) into the geoIpNode table as node == 2. So if you configure your web browser to use the hgroaming proxy, the site will "think" you are coming from europe. You can contact cluster-admin to get an hgroaming account.
We are putting the IP of hgroaming.cse.ucsc.edu (128.114.49.36) into the geoIpNode table as node == 2. So if you configure your web browser to use the hgroaming proxy, the site will "think" you are coming from europe. You can contact cluster-admin to get an hgroaming account.

Revision as of 03:31, 19 April 2012


This pages describes the way the euronode mirror works

We are moving to a system where we have geographically specific servers (nodes); we will try to direct users to the node which is appropriate for them. I call this geoMirroring to avoid confusion with our traditional mirrors.

The node for a given server is specified in the hg.conf file; e.g. the machines in california will have the following in their hg.conf file:

browser.node=1

The euronode will have:

browser.node=2

We may add other nodes in the future (e.g. in asia). If this configuration variable is not found, the redirection code is not executed (e.g. this will be the case in traditional mirrors).

In the following discussion, hgcentral applies to RR, hgcentraltest applies to hgwdev. RR will include euronode.cse.ucsc.edu when we activate the euronode.

The table hgcentral.gbNode contains the metadata for each node (e.g. domain, country and description). This is a copy of hgFixed.gbNodeReal (so we can modify on hgwdev).

The table hgcentral.geoIpNode is used to map a user's IP to the appropriate node. If an IP is not found in geoIpNode, the system assumes the user belongs in node 1 (California). hgcentral.geoIpNode is based on hgFixed.geoIpNode, which was built by Galt using a publicly available IP => country mapping database (http://software77.net/geo-ip). The copy in hgcentral may be modified (e.g. to add the IP used by QA team for testing).

Note that the IPs are stored in the tables using a numeric representation (for speed). mysql has a built in function, INET_ATON, which can be used to convert the dotted-quad notation to the numeric form; e.g. to add a new entry to geoIpNode:

hgsql hgcentral -s -e "insert into geoIpNode VALUES (INET_ATON('128.114.49.36'), INET_ATON('128.114.49.36'), 2)"

The built-in function INET_NTOA can be used to convert back from the numeric representation to the dotted-quad notation.

When does redirection happen?

An important limitation of these mirrors is that sessions are NOT shared between the different nodes.

Users are only redirected via hgGateway; e.g. if a european goes directly to http://genome.ucsc.edu/cgi-bin/hgTracks, they will not be redirected back to europe. The rationale for this is that such links may include sessions that are specific to the California mirror.

The first time a user is redirected, they will see a little dialog box at the top of hgGateway that let's them override the redirect; e.g. if user X is redirected to euronode, they may click on the link in the box to get back to the Californian hgGateway. This action is remembered with a cookie stored in the user's web browser (the value of the cookie will be redirect=manual). This cookie is not cleared by a cartReset (this is intentional). The user will always be able to switch which mirror they are using via a to-be-designed UI.

Euronode.jpg

How do I test this?

We are putting the IP of hgroaming.cse.ucsc.edu (128.114.49.36) into the geoIpNode table as node == 2. So if you configure your web browser to use the hgroaming proxy, the site will "think" you are coming from europe. You can contact cluster-admin to get an hgroaming account.