Senior AWS Data Engineer

Senior AWS Data Engineer | 

​Pipeline Development: Design and develop batch and streaming ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions.
​Data Ingestion: Implement frameworks for diverse sources, including APIs, databases, and streaming platforms.
​Architecture Optimization: Build and optimize data lakes and warehouses leveraging Amazon S3, Redshift, Athena, and Lake Formation.
​Governance & Quality: Ensure data quality, security, and governance across all pipelines and environments.
​Collaboration: Partner with data scientists and business stakeholders to deliver reliable, high-performance datasets.
​Maintenance: Monitor and troubleshoot workflows to ensure high availability and performance.
​Required Skills & Qualifications

​AWS Ecosystem: Deep experience with S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS, and SQS.
​Programming: Advanced proficiency in SQL, Python, and PySpark.
​Data Engineering: Expert knowledge of data modeling, schema design, and performance tuning.
​DevOps: Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform or CloudFormation).
​Security: Solid understanding of IAM, encryption, and compliance best practices.