Abstract: Do you consider productionizing your machine learning workflows and integrating them with all the data processing pipelines you already have? Does your team struggle with multiple people developing their own ways of running team and your monitoring and SRE guys scratching their head on how to efficiently monitor and run all those loosely connected pieces of logic? Airflow 3 to the rescue. With the shiny new Airflow 3 released earlier this year, being result of years of learning and listening to the users and invested time and effort of literally 100s of people to make it happen, you now have the most popular workflow engine that processes data available for you to make all your production pipelines manageable and rock solid. If all you want to hear is just humming of the processing of your data rather than panicky screams of your business that need things working - this talk is for you.

Learn - from an Airflow Maintainer how we adapted and reinvented Airflow to respond to the needs of modern Data + AI + ML processing.

Also there will be a glimpse of what’s next. By reinventing Airflow 3, we laid the foundations for more changes coming in the future, some of them aiming for even more seamless integration with all your future needs, that you might not even realise yet.