Distributed FileSystem on Cersat platform

Purposes

At Cersat, we manage and use everyday data from dozens of satellite mission archives. This requires a big storage archive capacity since satellite datasets are nowadays about a few hundred gigabyte to hundreds of terabytes, and even petabyte for new missions.

more ...


Software architecture

Overview

The platform software architecture relies on several layers, each containing one or more components :

  • Distributed Processing : Torque/Maui, Hadoop Map/Reduce, Celery, Gearman
  • Virtual Environments / Containers : Chroot, Docker, Eucalyptus/OpenStack
  • Distributed Filesystem : MooseFS, Hadoop HDFS
  • Bare Metal / OS : Ubuntu 12.04 LTS
more ...