• 11/15/2013
    12:00 AM
  • Rating: 
    0 votes
    Vote up!
    Vote down!

Ceph Poised To Change Data Center and Cloud Storage

Ceph, a type of open source file system for Linux, is hitting the mainstream with the potential to have big effects on storage in the data center and the cloud.

You may not have heard the name Ceph before, but that's about to change. This new storage technology is about to enter the data center and change the way we look at data storage and cloud computing.

First, we need to know what Ceph is. Basically, it's an open-source file system for Linux. The opening line on the official Ceph site is a powerful boast:

Ceph uniquely delivers object, block and file storage in one unified system.

The structure of Ceph is built on top of a distributed object store, with a Representational State Transfer (REST is a protocol for transferring data to storage over the Internet) gateway, block device interface, and a Portable Operating Systems Interface (POSIX -- an industry standard for operational compliance) file system. All of the access methods can run on the same object store, and this is made up of commercial, off-the-shelf (COTS) hardware.


There are three types of nodes in the clusters. A metadata node serves up data about the objects. This is a memory-heavy, powerful multicore x86 system. Object storage devices (OSDs) carry the data, and are much less compute intensive. Finally, monitor nodes hold the cluster map. The metadata servers load-balance dynamically, and data is striped across OSDs, so the implementation is relatively free of hot-spots.

OSDs uses a standard file system internally to provide a stable environment for storing the objects. In that sense, Ceph is a piggy-back layer, but the philosophy is to use the best of what is available without attempting to build that better mousetrap, and that seems like a sensible approach.

The current production file system recommended is XFS, which is mature, with Btrfs (B-tree file system) being the longer-term choice. Btrfs is still early life and a bit buggy, but is designed to be very extensible. It handles heterogeneous storage, has snapshots and compression already, and will have deduplication and encryption built in at a future release.

Stepping back from the techy level, Amazon S3 and OpenStack Object Storage (Swift) compatibility is built in to the Ceph product. Right now, that means that Ceph can simulate a Swift or S3 object store, but it is likely that Ceph will expand to build interfaces into these stores at a later data, potentially allowing inter-cloud bridging for geographic dispersion, extension, and for data migration.

The impact of a product like Ceph shouldn't be underestimated.

This is a unique solution right now, giving a truly unified access and view of a single common storage method. Being an open-source solution, the price is right. It has been accepted into the Linux mainstream build process, which highlights the support in the industry, and it is being taken up by other providers in the cloud, including OpenStack.Org, RedHat, and SUSE.

DreamHost is currently running a 3 Petabyte Object Store using Ceph, so it is certainly production-ready.


The evolution of Ceph, and the growth of the surrounding ecosystem, will move rapidly, and it will change storage.


Log in or Register to post comments