Scalable, Open, Software-defined Storage
RedHat Ceph Storage is a scalable, open, software-defined storage platform that combines the most stable version of the Ceph storage system with a Ceph management platform, deployment utilities, and support services. Red Hat Ceph Storage is designed for cloud infrastructure and web-scale object storage. Ceph is designed to run on commodity hardware, which makes building and maintaining petabyte-to-exabyte scale data clusters economically feasible.
Ceph calamari is a management and monitoring system for Ceph storage cluster. It provides a dashboard user interface that makes Ceph cluster monitoring simple and handy. Calamari was initially a part of Inktank’s Ceph Enterprise product offering and it has been open sourced by Red Hat. One node of the Hyperscale appliance would be dedicated for Calamari and would utilize the internal SSD as storage.
The Ceph monitor is a data store for the health of the entire cluster, and contains the cluster log. RedHat strongly recommends using at least three monitors for a cluster quorum in production; though for the PoC purpose one rackgox node is used. Monitor nodes typically have fairly modest CPU and memory requirements. Because logs are stored on local disk(s) on the monitor node, it is important to make sure that sufficient disk space is provisioned. The node uses internal SSD for storing data.
ceph-osd is the object storage daemon for the Ceph distributed file system. It is responsible for storing objects on a local file system and providing access to them over the network. The PoC dedicates 3 rackgox nodes for OSD and connect 2 JBRs as storage pool. Each JBR consists of 2 sets of 14 HDDs; hence altogether 3 x14 drives are dedicated for the OSD storage purposes. The setup ensures that network interface, controllers and drive throughput don’t leave any bottlenecks— e.g.,
fast drives, but networks too slow to accommodate them. The datapath used is 40G and JBR drives are connected through high speed LSI iSCSI interface.
RedHat ceph uses five nodes and 3 channels for JBR for installations. The calamari and monitor uses 1 node each and OSD uses 3 nodes for installations. CEPHrelies on packages in the Red Hat Enterprise Linux 7 Base content set. Each Ceph node must be able to access the full Red Hat Enterprise Linux 7 Base content. To do so, CEPHnodes are connected to the Internet to the Red Hat Content Delivery Network (CDN) and registered with the redhat customer portal. After complete installations, the calamari provides an interface to configure the storage utilizing CEPHdrives.