Lucas Fonseca
Jul 2, 2021

Thank you, Jéssica. Currently, our platform is thought considering Airflow, but it's a good observation! We do consider leveraging this solution to other orchestrators, since this is a generic strategy; so we may explore adding it to Jenkins, Rundeck, etc.

Please take a look in Databricks post: Integrating Apache Airflow with Databricks and in the Airflow documenation about DatabricksSubmitRunOperator.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

Lucas Fonseca
Lucas Fonseca

Written by Lucas Fonseca

Data Engineering Lead @Inventa. Data lover, curious spirit, amateur musician, and Gym rat.

No responses yet

Write a response