Ceph is a distributed storage platform that is a contender to become the future of software defined storage, providing unified access to block, object and file interfaces.
However like any complex systems there are various subsystems that may fail and analyzing logs is generally the first line of action.
This is where the ELK stack comes in; to search, analyze and process logs and metadata. From the Kraken release of Ceph, Ceph's Object Storage (Radosgw/RGW)
has integration for metadata search using ElasticSearch making it very easy to get much needed insights into how the object storage is being used for operators and users alike.
Ceph is a distributed storage platform that is a contender to become the future of software defined storage, providing unified access to block, object and file interfaces.
However like any complex systems there are various subsystems that may fail and analyzing logs is generally the first line of action.
This is where the ELK (ElasticSearch LogStash & Kibana, often referred to as "ELK stack" or "elastic stack") stack comes in; to search, analyze and process logs and metadata.
From the Kraken release of Ceph, Ceph's Object Storage (Radosgw/RGW) has integration for metadata search using ElasticSearch making it very easy to get much needed insights into how the object storage is being used for operators and users alike.
We will cover topics such as:
* Current status of ELK and Ceph
* Ceph logging and cluster log parsing with Logstash
* Future of the ELK for Analyzing and Alerting for Ceph
* RGW Metadata export to Elasticsearch - RGW Metadata Search
* A few interesting elasticsearch queries on object storage
