Skip to content

10.3 T2/T3 Cross-site x509 Access

10.3 T2/T3 Cross-site x509 Access

Within the IHEP WLCG grid infrastructure, files can be transferred bidirectionally between T2 (Tier-2) and T3 (Tier-3) storage using x509 grid certificates. The following uses the CMS experiment as an example.

Prerequisites

  • A valid grid certificate (see8.1 Grid Certificate)
  • Grid certificate DN registered on theINK Dashboardunder theX509 Certificatetab to complete the certificate→user mapping (required by the T3 xrootd proxybesproxyto resolve the certificate to a cluster user)
  • Joined the relevant VO (see8.2 Join VO)
  • A valid x509 proxy certificate (typically namedx509up_)

Environment Configuration

Set the following x509 environment variables in your job script. The CVMFS paths differ slightly per experiment; use the CMS example as a reference:

exportX509_USER_PROXY=${TMPDIR}/x509up_uid# proxy cert path (on the worker node)exportXrdSecPROTOCOL=gsi,unix# xrootd auth protocolexportX509_VOMS_DIR=/cvmfs/cms.cern.ch/grid/etc/grid-security/vomsdirexportX509_CERT_DIR=/cvmfs/cms.cern.ch/grid/etc/grid-security/certificatesexportX509_VOMSES=/cvmfs/cms.cern.ch/grid/etc/vomses

Reference paths for other experiments:

Experiment Certificate / CVMFS path prefix
CMS /cvmfs/cms.cern.ch/grid/etc/grid-security/(certificates,vomsdir) and/cvmfs/cms.cern.ch/grid/etc/vomses
ATLAS Corresponding directories under/cvmfs/atlas.cern.ch/repo/sw/
LHCb Corresponding directories under/cvmfs/lhcb.cern.ch/etc/grid-security/

Job Submission

Use the-cert x509flag ofhep_subto submit jobs requiring certificate authentication, and use-into specify the proxy certificate file:

hep_subjob.sh-in/path/to/x509up_uid-certx509

Parameters:

  • -cert x509: Enables x509 certificate authentication mode.hep_subwrites+HepJob_CertType = "x509"into the HTCondor ClassAd, allowing the job system to configure the certificate environment accordingly.
  • -in /path/to/x509up_uid: Specifies the proxy certificate file path.hep_subtransfers it to the worker node's$TMPDIRalong with the job.

T3 → T2 File Access

Access T2 EOS storage (cceos.ihep.ac.cn) from a T3 site (besproxy01.ihep.ac.cn, corresponding to/publicfs/cms/public storage):

# List T2 EOS directoryxrdfsroot://cceos.ihep.ac.cnls/eos/ihep/cms/store/user//# Upload from T3 worker to T2 EOSxrdcplocalfileroot://cceos.ihep.ac.cn//eos/ihep/cms/store/user//# Download from T2 EOS to T3 workerxrdcproot://cceos.ihep.ac.cn//eos/ihep/cms/store/user//remotefile.

T2 → T3 File Access

Access T3 public storage (besproxy01.ihep.ac.cn) from a T2 site:

# List T3 public storage directoryxrdfsroot://besproxy01.ihep.ac.cn:2094/ls/publicfs/cms/user//# Upload from T2 worker to T3xrdcplocalfileroot://besproxy01.ihep.ac.cn:2094//publicfs/cms/user//# Download from T3 to T2 workerxrdcproot://besproxy01.ihep.ac.cn:2094//publicfs/cms/user//remotefile.

Using gfal Tools

In addition to xrootd clients, you can usegfal-*commands. Ensuregfalis inPATH(e.g., add/cvmfs/grid.cern.ch/alma9-ui-test/usr/bin):

exportPATH=$PATH:/cvmfs/grid.cern.ch/alma9-ui-test/usr/bin# List directorygfal-lsroot://cceos.ihep.ac.cn//eos/ihep/cms/store/user//# Copy filegfal-copylocalfileroot://cceos.ihep.ac.cn//eos/ihep/cms/store/user//

Verifying Certificate Status

Before submitting a job, verify the x509 proxy certificate is valid on the login node:

grid-proxy-info# View basic proxy certificate informationvoms-proxy-info--all# View VOMS extended information (VO, roles, etc.)

If the proxy certificate is about to expire, regenerate it:

grid-proxy-init-valid72:0-out/path/to/x509up_uid
AI 助手
快速提问 ×

有问题?输入后跳转到对话页继续交流

Baidu
map