Role: AI/ML Architect – Databricks on AWS

Location:Los Angles,CA

Experience: 10+ years

Role Overview

We are seeking an experienced AI/ML Architect with deep hands-on expertise in Databricks on AWS to lead the design and implementation of scalable, high-performance data and machine learning platforms. The ideal candidate combines architectural thinking with strong engineering execution, demonstrating the ability to build modern lakehouse systems, optimize large-scale pipelines, and drive analytical and ML capabilities across the organization.

This role requires working with large, multi-terabyte datasets, advanced analytics, and end-to-end ML lifecycle management using Databricks, Python, PySpark, and AWS-native services.

---

Must Demonstrate (Critical Competencies)

· Designing Databricks-based lakehouse architectures on AWS (Delta Lake + S3 + Unity Catalog).

· Clear separation of compute vs. serving layers in distributed architectures.

· Low-latency API strategy where Spark is insufficient (e.g., leveraging optimized services or caching).

· Caching strategies to accelerate reads and reduce compute cost.

· Data partitioning, file size tuning, and optimization strategies for large-scale pipelines.

· Experience handling multi-terabyte structured time-series workloads.

· Ability to distill architectural significance from ambiguous business requirements.

· Strong curiosity, questioning, and requirement-probing mindset.

· Player-coach approach: hands-on technical depth + ability to guide design.