Role: Databricks Data Engineer
- Location: USA
Key Responsibilities:
- Design and maintain batch/streaming data pipelines using Databricks, Spark, SQL, and Python.
- Build ETL/ELT workflows to ingest and transform data into data lakes or warehouses.
- Optimize pipeline performance and cost efficiency across Azure, AWS, or GCP.
- Ensure data quality and integrity through rigorous testing and monitoring.
- Implement data governance, security practices, and Unity Catalog support.
- Collaborate with teams to deliver curated datasets for analytics and dashboards.
- Document technical designs and support production deployments.