AWS Data Engineer

Job title: AWS Data Engineer
Strong hands on these skills: Pyspark, Python, SQL, AWS Services
 
Key Responsibilities:
Design, develop, and maintain batch and streaming ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions, etc.).
Implement data ingestion frameworks from diverse sources (APIs, databases, streaming platforms).
Ensure data quality, governance, and security across all pipelines.
Build and optimize data lakes and warehouses leveraging Amazon S3, Redshift, Athena, and Lake Formation.
Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets.
Monitor and troubleshoot data workflows, ensuring high availability and performance.
Stay updated with emerging AWS technologies and recommend improvements.
 
Required Skills & Qualifications
Strong experience with AWS cloud services: S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS. SQS.
Proficiency in SQL, Python and PySpark
Knowledge of data modeling, schema design, and performance tuning.
Familiarity with CI/CD pipelines and DevOps practices tool (Terraform, CloudFormation).
Experience with security best practices (IAM, encryption, compliance).