Data Engineer

🔍 Key Responsibilities:
⚡ Design, build, and optimize high-performance Spark workloads using Apache Spark, Spark SQL & PySpark
🐍 Develop scalable data solutions using Python for data engineering
🛠️ Work with complex data transformations (JSON, semi-structured data, joins, aggregations, window functions)
☁️ Build and maintain ETL/ELT pipelines on AWS ecosystem including Amazon EMR Serverless & Amazon S3
🏗️ Implement efficient data lake architectures (partitioning, compression, external tables)
📊 Optimize and tune performance in Amazon Redshift
🔐 Ensure secure data access using concepts like AWS Identity and Access Management, RLS & column-level security
🎯 What We’re Looking For:
🎓 Bachelor’s degree in Computer Science or related field
🧠 12+ years of overall IT experience
🔥 Strong hands-on expertise in Spark + Spark SQL + performance tuning
📈 Proven analytical & problem-solving skills