8.4 EOS File Storage¶
8.4.1 EOS File System Overview¶
EOS is a distributed file system for EB-level data storage based on the XRootD framework. It currently provides massive data storage services for multiple experiments, including LHAASO and HXMT.
Current EOS file system information is shown below.
| Instance | Mount Point | Instance Server Address | Space | Usage |
|---|---|---|---|---|
| LHAASO local | /eos | eos01.ihep.ac.cn | 2.39 PB | LHAASO local offline data processing |
| LHAASO Daocheng | /eos/daocheng | lhmteos01.ihep.ac.cn | 152.83 TB | LHAASO Daocheng online data processing |
| HXMT | /mnt/hxmt | hxmteos01.ihep.ac.cn | 382.25 TB | HXMT experiment storage |
8.4.2 EOS File System Usage¶
1) EOS Usage¶
EOS currently provides two access modes: client FUSE mode and XRootD mode.
Access Methods¶
a) FUSE access
This method accesses the EOS system through a mount point, similar to accessing a local file system. For different experiment storage instances, mount points are shown in the table above. For example, the mount directory for the LHAASO experiment is/eos. On login nodes, data in the EOS file system can be accessed through the mount point.
b) XRootD access
This method accesses the EOS system through the XRootD protocol.
EOS_MGM_URLis the server address of the instance. Users can use XRootD commands or EOS commands. For example, to list a file in the LHAASO instance:
Or:
Note:If user jobs access EOS files through XRootD, the experiment software must support the XRootD protocol.
2) View User Resource Quota¶
Command format:
Example:
eosquota/eos/user/z/zhangsanByuser...# _______________________________________________________________________________________________# ==> Quota Node: /eos/user/z/zhangsan/# _______________________________________________________________________________________________userusedbyteslogibytesusedfilesavalbytesavallogibavalfilesfilled[%]vol-statusino-statuslihaibo800GB800GB10k-1.00TB200GB25M-9.08okok(usedspace)(numberofusedfiles)(spacequota)(numberoffilequota)Bygroup...# _______________________________________________________________________________________________# ==> Quota Node: /eos/user/z/zhangsan/# _______________________________________________________________________________________________# ...............................................................................................groupusedbyteslogibytesusedfilesavalbytesavallogibavalfilesfilled[%]vol-statusino-statusu07800GB800GB10k-0B0B0-100.00ignoredignored
3) View EOS Recycle Bin Usage¶
Command format:
View files in a user's personal recycle bin:
eosrecyclels# Deletion Time UID GID SIZE TYPE RESTORE-KEY RESTORE-PATH# ==============================================================================================================================SatDec2916:32:032018zhangsanu0713file0000000008b0f7bf/eos/user/z/zhangsan/test.txt
Clean files in a user's personal recycle bin:
Restore files from a user's personal recycle bin:
Example:
Note:Files in the EOS recycle bin are currently kept for only three days.
有问题?输入后跳转到对话页继续交流