Role: Airflow Engineer

Location: Remote

Contract: Long Term

Job Description:

We’re looking for an experienced Airflow Engineer to join our growing Data Engineering team.

In this role, you’ll help architect and implement intricate, efficient DAGs to orchestrate the ingestion and processing of healthcare and healthcare-related data at scale.

You'll collaborate across teams to translate complex business workflows into reliable, readable Airflow pipelines that power downstream processes and insights.What you’ll do:

• Design and develop modular Airflow DAGs that are clear, testable, and efficient, ideally structured in a way that allows for reuse and interaction between DAGs where appropriate

•Partner with other data engineers to implement a new healthcare data orchestration platform focused on visibility, performance, and scale

• Participate in architectural discussions and shape best practices for Airflow usage across the organization

• Work directly with stakeholders to understand workflows and ensure technical alignment with business goals

• Contribute to a GitHub-driven engineering environment with a focus on code quality and collaboration

• Write unit tests and end-to-end tests for orchestration pipelines to ensure production-grade reliability

• Work with tools like Snowflake, Postgres, and object storage to manage structured and semi-structured batch data workflows What we’re looking for:

• Strong experience developing with Apache Airflow 2+ in a production environment • Fluency in Python and designing modular, testable code

• Deep understanding of DAG design patterns, task dependencies, and Airflow orchestration best practices

• Experience working with cloud platforms and cloud-native technologies

• Experience working with Snowflake, Postgres, and other database and data platforms

• Familiarity with processing and transforming various data types and formats (e.g., JSON, CSV, Parquet)

• Comfort navigating and understanding evolving data schemas across structured and semi-structured sources

• Experience with DAG monitoring, logging, and observability tools

• Solid testing background including both unit testing and end-to-end DAG validation

• Ability to work collaboratively with stakeholders and engineers to map real-world workflows to technical solutions

• Comfort with ambiguity and a passion for making complex systems more visible and manageable

• Familiarity with handling sensitive data in a compliant, secure way Nice to have:

• Experience using Astronomer

• Background in healthcare or healthcare data domains