Skip to main content

Lustre best practices

    Lustre is best suited to large/huge files Avoid create many small files Avoid perform operations that imply access to many small files Avoid having a large number of files in a single directory Do not perform operations such as find over large directory trees Perform regular backups of your data to a safe location (INCD does not perform data backups) Instead of allowing all processes to do the I/O, choose just a few processes to do the work. Avoid performing many repetitive open/close operations