Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
USCMS T2 Transfers | ||||||||
Line: 14 to 14 | ||||||||
Caltech | ||||||||
Changed: | ||||||||
< < | Had a power outage in 30 nodes at 2 PM PST that degraded transfers as HDFS was affected. All nodes recovered within 10 minutes but the optimizer got traumatized and took a while to ramp-up again. | |||||||
> > | Monday 18:00 PST removed the 40 Gbps host for performance tuning. Overhead when recompiling CentOS 3.X series Kernel will cause it to come back by ~Tuesday afternoon. For now sites should expect 20 Gbps from Caltech (10+10 G setup). I don't see things too loaded though. 8G on average. 12G peak. | |||||||
Nebraska | ||||||||
Changed: | ||||||||
< < | Had good rates on this Friday, when we started ramping up. Had problems with their PhEDEx node which interrupted transfers at some points in the day. Last time I have seen there were bursty transfers -- not enough pending. | |||||||
> > | Had good rates on this Friday, when we started ramping up. Had problems with their PhEDEx node which interrupted transfers at some points in the day. More stability but no major improvement on rates since then. | |||||||
GFTP issues | ||||||||
Added: | ||||||||
> > | Not sure if this is still up-to-date : | |||||||
Error reason: TRANSFER globus_ftp_client: the server responded with an error 500 Command failed. : Unable to extend our file-backed buffers; aborting transfer. | ||||||||
Line: 30 to 32 | ||||||||
Purdue | ||||||||
Changed: | ||||||||
< < | It seemed that we have Network issues in Kansas. Even though when the optimizer lets us, we have good rates. Manoj analyzed thoroughly the network paths for sites that were good and bad, cross-checking with PerfSONAR and the best clue is that we have a problem with a route in Los Angeles, which looks good to Nebraska but bad to Purdue. Will follow up with Iperf testing to reveal packet loss and contact Network Support. | |||||||
> > | Found on Monday that the problem is related to LHCONE peering. Their traffic from Caltech is going through CENIC, not LHCONE, which is sub-optimal. Purdue will contact their Network support to improve this. | |||||||
GFTP Issues : | ||||||||
Line: 44 to 44 | ||||||||
Florida | ||||||||
Changed: | ||||||||
< < | Just joined. Thanks, will ramp up transfers. | |||||||
> > | Joined last Friday, had transfers ramped up on Monday but not seeing a lot of action from PhEDEx. | |||||||
Vanderbilt | ||||||||
Changed: | ||||||||
< < | Joined in the first day, LStore performance is randomly anywhere from great to poor. Have seen 600 MBps in the past but not a lot right now. Still figuring out the contacts to follow up there as they reorganize the team. | |||||||
> > | Joined in the first day, LStore performance is randomly anywhere from great to poor. Have seen 600 MBps in the past but not a lot right now. Found the contacts and included in the thread. | |||||||
-- Main.samir - 2014-07-29 |