Senior Data Enginee

🛠️ Key Responsibilities
Design, develop, and orchestrate data workflows and pipelines using Apache Airflow and Apache Spark
Build and optimize large-scale data infrastructure leveraging AWS services
Write robust, modular, and testable Python code for data engineering and analytics use cases
Perform data modeling, transformation, and analysis using advanced SQL
Develop and maintain data warehouse solutions, including star and snowflake schemas, performance tuning, and optimization
Implement real-time streaming and event-driven architectures using Kafka
Build and manage CI/CD pipelines for data applications and infrastructure
Collaborate with cross-functional teams to support marketing analytics and customer data initiatives
Participate in Agile development processes (Scrum, Kanban, SAFe) and communicate effectively with stakeholders
✅ Required Qualifications
10+ years of experience in big data engineering or a related field
Hands-on experience with Customer Data Platforms (CDPs) or Marketing Technology platforms
Strong expertise in Python and SQL
Experience with Snowflake, Amazon Redshift, and traditional data warehousing concepts
Proficiency with Apache Airflow and Apache Spark
Experience with AWS cloud services (S3, Glue, Athena, EMR)
Familiarity with Kafka and real-time data streaming
Experience implementing CI/CD pipelines for data solutions
Solid understanding of Agile methodologies
Excellent communication and collaboration skills
Bachelor’s degree in Computer Science or a related field

Agile Methodologies

Python
SQL
AWS (S3, Glue, Athena, Redshift, EMR)
Apache Airflow
Apache Spark
Snowflake
Kafka
CI/CD Pipelines