Title: Sr Cloud Data Engineer with Dremio exp
Location: McLean, VA
Duration: 6-12 + Months
Must Have Qualifications:
Dremio application support and management, AWS environment, Hands on AWS.
• Dremio application management with one year or more experience is a must have.
• Strong hands on experience building ETL pipelines using Apache Spark.
• Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
• Proficient in Python and/or Scala programming languages
• Knowledge of application development lifecycles, & continuous integration/deployment practices
• Experience with development on AWS and cloud native applications
• Experience with S3, DynamoDB, Kinesis and Snowflake
• Experience with Developing Data Platforms on AWS
• Proficient in Agile Software Development methodology, processes, and practices.
• Experience with the full ELK Stack - Elasticsearch, Logstash, Kibana, Beat agents and REST API integration.
• Experience with programming languages like GoLang, Java, JSON etc.
• Fine tuning the Search Relevancy according to the business requirements.
• Develop Elastic alerting solutions using Watchers and Kibana.
• Generate Alerts that will integrate into Service Now/Jira for ticketing.