10.3 T2/T3 Cross-site x509 Access
10.3 T2/T3 Cross-site x509 Access¶
Within the IHEP WLCG grid infrastructure, files can be transferred bidirectionally between T2 (Tier-2) and T3 (Tier-3) storage using x509 grid certificates. The following uses the CMS experiment as an example.
Prerequisites¶
- A valid grid certificate (see8.1 Grid Certificate)
- Grid certificate DN registered on theINK Dashboardunder theX509 Certificatetab to complete the certificate→user mapping (required by the T3 xrootd proxy
besproxyto resolve the certificate to a cluster user) - Joined the relevant VO (see8.2 Join VO)
- A valid x509 proxy certificate (typically named
x509up_)
Environment Configuration¶
Set the following x509 environment variables in your job script. The CVMFS paths differ slightly per experiment; use the CMS example as a reference:
exportX509_USER_PROXY=${TMPDIR}/x509up_uid# proxy cert path (on the worker node)exportXrdSecPROTOCOL=gsi,unix# xrootd auth protocolexportX509_VOMS_DIR=/cvmfs/cms.cern.ch/grid/etc/grid-security/vomsdirexportX509_CERT_DIR=/cvmfs/cms.cern.ch/grid/etc/grid-security/certificatesexportX509_VOMSES=/cvmfs/cms.cern.ch/grid/etc/vomses
Reference paths for other experiments:
| Experiment | Certificate / CVMFS path prefix |
|---|---|
| CMS | /cvmfs/cms.cern.ch/grid/etc/grid-security/(certificates,vomsdir) and/cvmfs/cms.cern.ch/grid/etc/vomses |
| ATLAS | Corresponding directories under/cvmfs/atlas.cern.ch/repo/sw/ |
| LHCb | Corresponding directories under/cvmfs/lhcb.cern.ch/etc/grid-security/ |
Job Submission¶
Use the-cert x509flag ofhep_subto submit jobs requiring certificate authentication, and use-into specify the proxy certificate file:
Parameters:
-cert x509: Enables x509 certificate authentication mode.hep_subwrites+HepJob_CertType = "x509"into the HTCondor ClassAd, allowing the job system to configure the certificate environment accordingly.-in /path/to/x509up_uid: Specifies the proxy certificate file path.hep_subtransfers it to the worker node's$TMPDIRalong with the job.
T3 → T2 File Access¶
Access T2 EOS storage (cceos.ihep.ac.cn) from a T3 site (besproxy01.ihep.ac.cn, corresponding to/publicfs/cms/public storage):
# List T2 EOS directoryxrdfsroot://cceos.ihep.ac.cnls/eos/ihep/cms/store/user// # Upload from T3 worker to T2 EOSxrdcplocalfileroot://cceos.ihep.ac.cn//eos/ihep/cms/store/user// # Download from T2 EOS to T3 workerxrdcproot://cceos.ihep.ac.cn//eos/ihep/cms/store/user//remotefile.
T2 → T3 File Access¶
Access T3 public storage (besproxy01.ihep.ac.cn) from a T2 site:
# List T3 public storage directoryxrdfsroot://besproxy01.ihep.ac.cn:2094/ls/publicfs/cms/user// # Upload from T2 worker to T3xrdcplocalfileroot://besproxy01.ihep.ac.cn:2094//publicfs/cms/user// # Download from T3 to T2 workerxrdcproot://besproxy01.ihep.ac.cn:2094//publicfs/cms/user//remotefile.
Using gfal Tools¶
In addition to xrootd clients, you can usegfal-*commands. Ensuregfalis inPATH(e.g., add/cvmfs/grid.cern.ch/alma9-ui-test/usr/bin):
exportPATH=$PATH:/cvmfs/grid.cern.ch/alma9-ui-test/usr/bin# List directorygfal-lsroot://cceos.ihep.ac.cn//eos/ihep/cms/store/user// # Copy filegfal-copylocalfileroot://cceos.ihep.ac.cn//eos/ihep/cms/store/user//
Verifying Certificate Status¶
Before submitting a job, verify the x509 proxy certificate is valid on the login node:
grid-proxy-info# View basic proxy certificate informationvoms-proxy-info--all# View VOMS extended information (VO, roles, etc.)
If the proxy certificate is about to expire, regenerate it:
有问题?输入后跳转到对话页继续交流