Skip to content

8.4 EOS File Storage

8.4.1 EOS File System Overview

EOS is a distributed file system for EB-level data storage based on the XRootD framework. It currently provides massive data storage services for multiple experiments, including LHAASO and HXMT.

Current EOS file system information is shown below.

Instance Mount Point Instance Server Address Space Usage
LHAASO local /eos eos01.ihep.ac.cn 2.39 PB LHAASO local offline data processing
LHAASO Daocheng /eos/daocheng lhmteos01.ihep.ac.cn 152.83 TB LHAASO Daocheng online data processing
HXMT /mnt/hxmt hxmteos01.ihep.ac.cn 382.25 TB HXMT experiment storage

8.4.2 EOS File System Usage

1) EOS Usage

EOS currently provides two access modes: client FUSE mode and XRootD mode.

Access Methods

a) FUSE access

This method accesses the EOS system through a mount point, similar to accessing a local file system. For different experiment storage instances, mount points are shown in the table above. For example, the mount directory for the LHAASO experiment is/eos. On login nodes, data in the EOS file system can be accessed through the mount point.

b) XRootD access

This method accesses the EOS system through the XRootD protocol.

root://EOS_MGM_URL//filepath

EOS_MGM_URLis the server address of the instance. Users can use XRootD commands or EOS commands. For example, to list a file in the LHAASO instance:

xrdfsroot://eos01.ihep.ac.cnls/eos/user/file.txt

Or:

eosroot://eos01.ihep.ac.cnls/eos/user/file.txt

Note:If user jobs access EOS files through XRootD, the experiment software must support the XRootD protocol.

2) View User Resource Quota

Command format:

eosquotayour_eos_path

Example:

eosquota/eos/user/z/zhangsanByuser...# _______________________________________________________________________________________________# ==> Quota Node: /eos/user/z/zhangsan/# _______________________________________________________________________________________________userusedbyteslogibytesusedfilesavalbytesavallogibavalfilesfilled[%]vol-statusino-statuslihaibo800GB800GB10k-1.00TB200GB25M-9.08okok(usedspace)(numberofusedfiles)(spacequota)(numberoffilequota)Bygroup...# _______________________________________________________________________________________________# ==> Quota Node: /eos/user/z/zhangsan/# _______________________________________________________________________________________________# ...............................................................................................groupusedbyteslogibytesusedfilesavalbytesavallogibavalfilesfilled[%]vol-statusino-statusu07800GB800GB10k-0B0B0-100.00ignoredignored

3) View EOS Recycle Bin Usage

Command format:

eosrecyclehelpSupportls,purge,restorethreeoperations.

View files in a user's personal recycle bin:

eosrecyclels# Deletion Time UID GID SIZE TYPE RESTORE-KEY RESTORE-PATH# ==============================================================================================================================SatDec2916:32:032018zhangsanu0713file0000000008b0f7bf/eos/user/z/zhangsan/test.txt

Clean files in a user's personal recycle bin:

eosrecyclepurge

Restore files from a user's personal recycle bin:

eosrecyclerestore[--force-original-name|-f][--restore-versions|-r]

Example:

eosrecyclerestore0000000008b0f7bf

Note:Files in the EOS recycle bin are currently kept for only three days.

AI 助手
快速提问 ×

有问题?输入后跳转到对话页继续交流

Baidu
map