Senior Data Engineer
Job Description
We are seeking a highly skilled Senior Data Engineer to lead a critical data engineering migration project. The role involves migrating workflows from Airflow + BigQuery (GCP) to Databricks (AWS). Key Responsibilities: Design and implement migration strategy from GCP (Airflow + BigQuery) to AWS Databricks. Optimize and refactor existing pipelines for scalability and performance. Collaborate with cross-functional teams to ensure smooth transition and minimal downtime. Establish best practices for data engineering in the new Databricks environment. Required Skills & Experience: Strong expertise in Apache Airflow and Google BigQuery. Hands-on experience with Databricks on AWS. Solid understanding of cloud data platforms (GCP & AWS). Proven track record in large-scale data migration projects. Excellent problem-solving and communication skills. Nice to Have: Experience with Spark optimization in Databricks. Familiarity with CI/CD for data pipelines. Exposure to multi-cloud data architecture.
Similar Jobs
Data Engineer
New Jersey
SQL Data Engineers
AZ
Jr. Data Engineer
Texas
Data Engineer
Remote
Data Engineer With AI/ML
Remote