Role: Data Engineer with Databricks Admin, AWS Admin

Location: Raritan, NJ Hybrid ( Nearby State Only)

Duration: 12+ Months

Requirements:

•      We are seeking an experienced AWS Administrator with expertise in

Databricks and other data platforms.

•      The ideal candidate will be responsible for managing cloud

infrastructure, optimizing data pipelines, and ensuring seamless

integration across various cloud services and data solutions.

Responsibilities:

•      Design, deploy, and manage AWS cloud infrastructure, ensuring

security, scalability, and high availability.

•      Administer and optimize Databricks environments, including cluster

management, performance tuning, and cost optimization.

•      Implement and manage data pipelines using AWS services such as AWS

Glue, Lambda, S3, and Redshift.

•      Monitor and troubleshoot AWS cloud resources, ensuring optimal

performance and reliability.

•      Collaborate with data engineers, analysts, and other stakeholders to

integrate Databricks with various data sources.

•      Maintain IAM roles, security policies, and compliance requirements

within AWS.

•      Automate cloud operations using Terraform, CloudFormation, or other

Infrastructure as Code (IaC) tools.

•      Ensure data governance and security best practices are followed across

data platforms.

•      Optimize storage solutions, including data lake architecture, and

manage ETL/ELT processes.

•      Stay up to date with AWS and Databricks updates, recommending

improvements and best practices.