USCMS T2 Transfers

This twiki is intended to aggregate all necessary information for the current effort of improving inter-T2 PhEDEx transfers in the context of USCMS.

It is known that the networks supported between the 7 sites are of high capacity and availability. However there seem to be some limitations to be addressed and tested at the level of CMS Transfer tools or configurations of these, that could improve the overall performance and at the end, make these systems perform better and deliver data faster between sites.

The general picture on transfers over 20 Gbps and some of these configuration problems are mentioned in Samir's talk at the T2 meeting of 07/29.

The ideal is that even 10 Gbps sites could participate, as it is possible that the currrent settings are not optimal for fast transfers. We could tune it until it saturates the 10 Gbps link and everyone would have exercised how to improve transfer rates in Debug.

Current connectivity at sites

So far, the showstopper was the uplink bandwidth for most sites. Since July 2014 this is starting to change, this is to track the current state from different sites

• MIT - 10 Gbps
• Nebraska - Could do more then 10 Gbps currently, will have 100 Gbps on the T2 soon.
• Purdue - 100 Gbps. Running tests with FNAL.
• Florida - 100 Gbps
• UCSD - 10 Gbps (Samir observed when running tests. To be confirmed by admins)
• SPRACE - 10 Gbps
• Wisconsin - 10 Gbps - Saturating from times to times. Would like to avoid tests for now.

FTS Notes

PhEDEx Documentation

We will be exercising mostly the Download agent, therefore the most useful documenation for us is this. However there is also this if you would like to read more.

PhEDEx configurations

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed condimentum rhoncus ligula, et lobortis ipsum aliquet id. In fringilla felis id venenatis placerat. Vivamus ornare egestas mattis. Donec sapien leo, gravida vitae magna sed, dictum convallis metus. Nulla mattis iaculis diam a gravida. Sed ac sem eget nisi tristique convallis vel sit amet dolor.

.
.
.
 -batch-files 500
 -link-pending-files 200
 -max-active-files 700
 -link-active-files 'T1_CH_CERN_Buffer=50'
 -link-active-files 'T1_DE_KIT_Buffer=10'
 -link-active-files 'T1_DE_KIT_Disk=10'
 -link-active-files 'T1_ES_PIC_Buffer=100'
 -link-active-files 'T2_RU_RRC_KI=2'
 -link-active-files 'T1_FR_CCIN2P3_Buffer=100'
 -link-active-files 'T1_FR_CCIN2P3_Disk=100'
.
.
.

-- Main.samir - 2014-07-29