DepC is an open source tool written in Python 3.5+ : https://github.com/ovh/depc
We use it to compute the Quality Of Service (QoS) of our IT infrastructure and customers (14k servers and 5M websites in the WebHosting department).
To be able to do this we use some open source technologies : - TimeSeries databases and Pandas / Numpy for the QoS computing, - Neo4j to store the graph of our dependencies (a customer depends on several servers and some services, like databases, themselves depends on servers. If a server fails, several customers QOS are impacted), - Kafka consumer to update in real time the graph in Neo4j, - Apache Airflow to schedule the jobs used to compute the QOS of the whole infrastructure (the graph in Neo4j contains ~10M nodes).
The goal of this conference is to show you how do we assemble these technologies to construct DepC in OVH.
Speakers: Nicolas Crocfer Anthony Olea