ComputingT2Transfers < Main

Tags: view all tags
%TOC%
---+ USCMS T2 Transfers

This twiki was created to report the latest status on [[https://twiki.cern.ch/twiki/bin/view/CMSPublic/USCMSTier2Transfers][this initiative]].

---+ General status

[[http://dashb-fts-transfers.cern.ch/ui/#date.interval=1440&grouping.dst=(site)&grouping.src=(site)&p.grouping=dst&src.site=(CIT)&tab=transfer_plots][DashBoard FTS plots]]

[[http://dashb-fts-transfers.cern.ch/ui/#date.interval=40320&grouping.dst=(site)&grouping.src=(site)&p.grouping=dst&src.site=(CIT)&tab=transfer_plots][Month-long FTS plots]]

Created a spreadsheet so sites can post their GridFTP configurations and get comments from the group :

[[https://docs.google.com/spreadsheets/d/1vnRopSrMJHvmiPIu8K0CpLr_eLSTdirdQ_uqAItoghs/edit?usp=sharing][Spreadsheet]]

As of 12th of September, the only site which managed interesting rates was Purdue. Most SE to SE links won't pass ~70 transfers and 500~1000 MBps, which is a bit disappointing. Suggesting to the group that we try a general FTS-optimizer bypass if everyone is comfortable with throttling transfers in their download agents. This is important as otherwise the number of transfers can grow out of control, crashing either GridFTPs (site SE) or the PhEDEx host managing those.

---+ Site notes

---++ Caltech

Started having consistent stage-out problems by Sep 11th. Throttled down the transfers to other sites so we can investigate the issue with less load on the GridFTPs.

---++ Nebraska

Had good rates in general, but didn't see more than 1000 MBps from Caltech.

---++ Purdue

By Sep 11th the site started doing very interesting download rates. Up to 28 Gbps download rates averaged over 10 min.

[[http://dashb-fts-transfers.cern.ch/ui/#date.from=201409111650&date.interval=0&date.to=201409121650&dst.site=(Purdue)&grouping.dst=(site)&grouping.src=(site)&p.bin.size=10m&p.grouping=src&tab=transfer_plots][Plots here]]

<span>= Older notes =</span> Found that there was a problem related to LHCONE peering. Their traffic from Caltech was going through CENIC, not LHCONE, which is sub-optimal. Purdue is following up with local network support.

Even though there was this problem, we still observed decent rates &gt; 500 MBps at some distinct moments.

---++ Vanderbilt

Joined in the first day, LStore performance is randomly anywhere from great to poor. Have seen 600 MBps in the past.

---++ UCSD

Observed ~450 MBps in distinct days, see monthly plot

-- Main.samir - 2014-07-29
Topic revision: r9 - 2014-09-12 - samir
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback