Location:
Chicago, Illinois (IL)
Contract Type: C2C
Posted: 1 month ago
Skills: Python, PySpark, AWS,Lambda, Glue,Athena, Kinesis, IAM, EMR/PySpark, Docker,
Role: Data Engineer with AWS Bedrock
Location: Chicago IL (Hybrid)
Contract: Long Term
Responsibilities: -
- Proficient developer in multiple languages, Python is a must, with the ability to quickly learn new ones.
- Expertise in SQL (complex queries, relational databases preferably PostgreSQL, and NoSQL database - Redis and Elasticsearch).
- Extensive big data experience, including EMR, Spark, Kafka/ Kinesis, and optimizing data pipelines, architectures, and datasets.
- AWS expert with hands-on experience in Lambda, Glue,Athena, Kinesis, IAM, EMR/PySpark, Docker,
- Proficient in CI/CD development using Git, Terraform, and agile methodologies.
- Comfortable with stream-processing systems (Storm, Spark-Streaming) and workflow management tools (Airflow).
- Exposure to knowledge graph technologies (Graph DB, OWL, SPARQL) is a plus. .
Mandatory skills