Lead Data Engineer

Lead Data Engineer – Azure

Location: Minnesota (Onsite/Hybrid – Specify as needed)
Employment Type: Full-Time / Contract
Experience Required: 10–14+ Years

Job Summary

We are seeking a highly skilled Lead Data Engineer – Azure to design, architect, and lead the development of scalable data platforms on Microsoft Azure. The ideal candidate will have strong experience in cloud-based data engineering, modern data warehousing, big data processing, and team leadership.

Key Responsibilities

• Design and architect enterprise data solutions on Microsoft Azure.
• Lead development of data pipelines using Azure Data Factory.
• Build and optimize data storage solutions using Azure Data Lake Storage and Azure Synapse Analytics.
• Implement ETL/ELT frameworks for structured and unstructured data.
• Develop scalable data transformation processes using PySpark and SQL.
• Lead migration of on-prem data warehouses to Azure cloud.
• Establish data governance, data quality, and security best practices.
• Optimize performance and cost efficiency of Azure data workloads.
• Mentor junior data engineers and conduct code reviews.
• Collaborate with architects, BI teams, and business stakeholders.

Required Skills & Experience

• 10–14+ years of overall IT experience with strong Data Engineering background.
• 5+ years of hands-on Azure data platform experience.
• Strong experience with:
  • Azure Data Factory (ADF)
  • Azure Synapse
  • Azure Data Lake
  • Databricks (preferred)
• Strong programming skills in Python and SQL.
• Experience with Spark, Delta Lake, or distributed processing frameworks.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience with data modeling and data warehousing concepts.
• Strong understanding of security, RBAC, and cloud networking fundamentals.