Lead Azure Data Engineer
Job Description
Lead Azure Data Engineer with Databricks
Location – Hybrid (2 Days onsite at nearby Deloitte office) ----------- Georgia - Atlanta, Texas – Austin, Dallas, Houston; Arizona – Gilbert, Phoenix; Florida – Lake Mary, Orlando, Tampa; North Carolina – Charlotte; Massachusetts – Boston.
Client: ED Jones Through Deloitte
VISA: USC/GC Only
C2C/1099/W2
Must be 14+ Years
· Proven hands-on experience with Azure Databricks, including designing, building, and optimizing complex data pipelines and Delta Lake solutions.
· Strong background in Azure Data Lake Storage (ADLS)—architecture, best practices, and efficient handling of high-volume and diverse data sets.
· Previous experience designing and developing data models and integration layers that seamlessly pull and harmonize data from multiple ODS and other source systems.
· Demonstrated ability to deliver scalable, performant solutions for both batch and streaming workloads on Azure.
· Track record of driving process efficiency—targeting substantial improvements in workflow automation within the cloud ecosystem.
· Familiarity with Azure suite: ADLS, Azure Data Factory, Azure Synapse Analytics, etc.
· Commitment to data governance, quality management, and cost optimization in cloud environments.
· Advanced coding skills in Python, SQL, and PySpark (Databricks context).
· Nice to have: Experience developing CI/CD pipelines and leveraging Databricks Asset Bundles for deployment and versioning.
· Ability to prepare well-documented, reusable solutions and foster knowledge transfer within the team.
· Experience with additional cloud platforms (AWS, GCP) is a plus, though Azure expertise is paramount.
· Overall knowledge of MLOps and DataOps (such as but not including deployment, monitoring and maintenance)
Similar Jobs
Azure Data Engineer
Texas
Azure Data Engineer
California
Lead Azure Data Engineer
New York
Azure Data Engineer
Remote
Senior Azure Data Engineer
North Carolina