Live broadcast: https://www.youtube.com/watch?v=gwLJZVoXWlg Apache Airflow has become one of the most popular data toolings. Due to its high complexity, it could be challenging for all teams and companies. For example, how to effectively construct an orchestrate architecture on diverse cloud platforms, how to productively accelerate your engineering and machine learning workload at scale, and how to smartly decouple your Python codebase for professional testing and easy maintenance.
In this session, we will present five recipes that have helped us scale data jobs and to reinforce as a data-driven AI-leading company. Key take-ways: - Orchestrate Architecture - Auto-Build Airflow DAG - Data Quality - Auto-Cost Evaluation - Auto-Cataloging
Speakers: MENG Qiang Dahmane Sheikh Grzegorz Skibinski