(r1) ComputingCRABLocal < Main

Tags: view all tags

---+ Local CRAB

This page is intended to describe how to use CRAB in T3-Higgs

---++ Environment :

I'm hoping that users are familiar with the [[https://twiki.cern.ch/twiki/bin/view/CMSPublic/WorkBookCRABTutorial][usual CRAB recipe]].

For the specific environments here they are :

<verbatim>
source /cvmfs/cms.cern.ch/cmsset_default.sh # CMSSW
cmsrel RELEASE ; cd RELEASE/src ; cmsenv # Just a guideline on how to get cmsenv to run  *the order is important*
source /cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el5-x86_64/setup.sh # Grid tools
source /share/apps/crab/crab.sh
</verbatim>

---++ Configuration

Everything is usually whatever you want, except these :

<verbatim>
[USER]
return_data             = 1 
copy_data               = 0

[CRAB]
scheduler = condor

</verbatim>

This will ensure that we will find the right CMSSW.sh that will help us achieve faster the goal of setting the stage-out to Hadoop.

--++ Steps

After your environment is set and the crab.cfg is configured, time to create the jobs with crab -create. This will give you a task directory :

<verbatim>
	working directory   /home/samir/CMSSW_5_3_11/src/crab_0_140705_005804/
</verbatim>

Now is the part where we set the stageout location, you need to use the taskdir to edit CMSSW.sh : 

 /home/samir/CMSSW_5_3_11/src/crab_0_140705_005804/job/CMSSW.sh

Towards the end of the file, search for "file_list". Just below a line like this :

<verbatim>
file_list="$SOFTWARE_DIR/outfile_$OutUniqueID.root"
</verbatim>

Is where we will place the copy command :

<verbatim>
cp $RUNTIME_AREA/outfile_* /mnt/hadoop/store/user/$USER/crabtest/
</verbatim>

*NOTE*: "outfile" was in my case where I specify it in crab.cfg. Make sure that you pick the right filename for the copy command. You will have a hint some lines above in the same script.

<verbatim>
output_file    = outfile.root
</verbatim>


That should be all. Now you can submit your jobs and if the input data is in the right place (/mnt/hadoop) your jobs should run and copy the output files to the directory you specify


-- Main.samir - 2014-07-05

Topic revision: r1 - 2014-07-05 - samir

Account
- Log In

~~Edit~~
~~Attach~~

Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback