Overview

Using an external File Management server is efficient and allows for easier storage space scaling without impacting the rest of the platform. Also, it helps in easy backup creation when needed for the files. A local filesystem can be used for initial deployments, but as the system grows - that may not be sufficient for highly available workloads.

The platform uses pyfilesystem2 for file-management and can connect to a variety of backends and with a variety of methods to simplify file management. The backends supported are:

• Local File System: Readily available and easy to use
  • This can also be used for mount points created at the OS-level
• FTP Server: Using an existing FTP server
• SSH-FS: Transferring files over SSH
• AWS S3: Using the S3 Object Store to store/retrieve files