Open Source Ceph Storage– Scaling from Gigabytes to Exabytes with Intelligent Nodes

Sage Weil (Inktank)
Average rating: ****.
(4.00, 1 rating)

As the size and performance requirements of storage systems have
increased, file system designers have looked to new architectures to
facilitate system scalability.

Ceph’s architecture consists of an object storage, block storage and a POSIX-compliant file system. It’s in the most significant storage system that has been accepted into the Linux kernel. Ceph has both kernel and userland implementations.The CRUSH algorithm controlled, scalable, decentralized placement of replicated data. In addition, it has a fully leveraged, highly scalable metadata layer. Ceph offers compatibility with S3, Swift and Google Storage and is a drop in replacement for HDFS (and other File Systems).

Ceph is unique because it’s massively scalable to the exabyte level.
The storage system is self-managing and self-healing which means limited system administrator involvement.
It runs on commodity hardware, has no single point of failure, leverages an intelligent storage node system and it open source.

This talk will describe the Ceph architecture and then focus on the
current status and future of the project. This will include a discussion
of Ceph’s integration with Openstack, the file system, RBD clients in the
Linux kernel, RBD support for virtual block devices in Qemu/KVM and
libvirt, and current engineering challenges.

Sage Weil

Inktank

Sage Weil designed Ceph in 2004 as part of his PhD research in Storage Systems at the University of California, Santa Cruz. Since graduating, he has
continued to refine the system with the goal of providing a stable next
generation distributed file system for Linux. Prior to his graduate work, he cofounded New Dream Network, the company behind DreamHost.com, a Los Angeles-based web hosting company.

Sponsors

  • EMC
  • Microsoft
  • HPCC Systems™ from LexisNexis® Risk Solutions
  • MarkLogic
  • Shared Learning Collaborative
  • Cloudera
  • Digital Reasoning Systems
  • Pentaho
  • Rackspace Hosting
  • Teradata Aster
  • VMware
  • IBM
  • NetApp
  • Oracle
  • 1010data
  • 10gen
  • Acxiom
  • Amazon Web Services
  • Calpont
  • Cisco
  • Couchbase
  • Cray
  • Datameer
  • DataSift
  • DataStax
  • Esri
  • Facebook
  • Feedzai
  • Hadapt
  • Hortonworks
  • Impetus
  • Jaspersoft
  • Karmasphere
  • Lucid Imagination
  • MapR Technologies
  • Pervasive
  • Platform Computing
  • Revolution Analytics
  • Scaleout Software
  • Skytree, Inc.
  • Splunk
  • Tableau Software
  • Talend

For information on exhibition and sponsorship opportunities at the conference, contact Susan Stewart at sstewart@oreilly.com.

For information on trade opportunities with O'Reilly conferences contact Kathy Yu at mediapartners
@oreilly.com

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

View a complete list of Strata contacts