Rsync transfer rates: Difference between revisions
From genomewiki
Jump to navigationJump to search
(initial contents) |
m (add cat tag) |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
measuring actual disk space consumed on the destination filesystem per minute: | measuring actual disk space consumed on the destination filesystem per minute: | ||
<PRE> | |||
1. pull from hgwdev to hgdownload: 39 Mb/sec = 2360 Mb/min = 141,600 Mb/hour = 3,398,400 Mb/day (single rsync) | 1. pull from hgwdev to hgdownload: 39 Mb/sec = 2360 Mb/min = 141,600 Mb/hour = 3,398,400 Mb/day (single rsync) | ||
2. pull from hgdownload to cloud: 18 Mb/sec = 1080 Mb/min = 64,800 Mb/hour = 1,555,200 Mb/day (single rsync) | 2. pull from hgdownload to cloud: 18 Mb/sec = 1080 Mb/min = 64,800 Mb/hour = 1,555,200 Mb/day (single rsync) | ||
| Line 8: | Line 9: | ||
5. internal cloud to cloud copy: 35 Mb/sec = 2150 Mb/min = 129,000 Mb/hour = 3,096,000 Mb/day (volume to volume) | 5. internal cloud to cloud copy: 35 Mb/sec = 2150 Mb/min = 129,000 Mb/hour = 3,096,000 Mb/day (volume to volume) | ||
6. second example cloud to cloud: 12 Mb/sec = 770 Mb/min = 46,200 Mb/hour = 1,108,800 Mb/day (volume to volume) | 6. second example cloud to cloud: 12 Mb/sec = 770 Mb/min = 46,200 Mb/hour = 1,108,800 Mb/day (volume to volume) | ||
</PRE> | |||
According to IP locator services, the cloud computer I was working with was in Texas.<BR> | |||
Transfer rates between here and there, with 2 rsync instances, was just about as good<BR> | |||
as our internal transfer rate here on campus.<BR> | |||
Internal cloud to cloud transfer rates were less efficient and quite variable depending<BR> | |||
upon time of day. | |||
[[Category:Cloud Computing]] | |||
Latest revision as of 17:24, 28 April 2009
Testing rsync transfer rates, using the rsync command: 'rsync -azP --stats', measuring actual disk space consumed on the destination filesystem per minute:
1. pull from hgwdev to hgdownload: 39 Mb/sec = 2360 Mb/min = 141,600 Mb/hour = 3,398,400 Mb/day (single rsync) 2. pull from hgdownload to cloud: 18 Mb/sec = 1080 Mb/min = 64,800 Mb/hour = 1,555,200 Mb/day (single rsync) 3. pull from hgdownload to cloud: 37 Mb/sec = 2230 Mb/min = 133,800 Mb/hour = 3,211,200 Mb/day (two rsync) 4. pull from hgwdev to cloud: 768 Kb/sec = 45 Mb/min = 2,700 Mb/hour = 64,800 Mb/day (via ssh, not rsh) 5. internal cloud to cloud copy: 35 Mb/sec = 2150 Mb/min = 129,000 Mb/hour = 3,096,000 Mb/day (volume to volume) 6. second example cloud to cloud: 12 Mb/sec = 770 Mb/min = 46,200 Mb/hour = 1,108,800 Mb/day (volume to volume)
According to IP locator services, the cloud computer I was working with was in Texas.
Transfer rates between here and there, with 2 rsync instances, was just about as good
as our internal transfer rate here on campus.
Internal cloud to cloud transfer rates were less efficient and quite variable depending
upon time of day.
