Azure Databricks Developer

🔧 Key Responsibilities
Design & implement large-scale migration pipelines from on-prem systems to Azure Data Lake Storage (ADLS)
Build and manage data pipelines using Azure Data Factory (ADF)
Develop UI components using Scala
Perform data ingestion from multiple sources and ensure data integrity
Transform data using Azure Databricks & Delta Lake
Implement data quality checks, logging, and traceability for compliance
Analyze data and troubleshoot data-related issues
Work in Agile environments and contribute to sprint deliverables
Manage CI/CD pipelines using Azure DevOps
🛠️ Required Skills
Strong experience with Azure Databricks, Scala, ADF, Terraform
Hands-on experience in Azure DevOps CI/CD (Stories, Bugs, Issue tracking)
Expertise in data warehousing concepts and development
Strong SQL skills (joins, duplicate identification, data analysis)
Experience handling high-volume unstructured data efficiently
Ability to work independently and solve complex problems
📊 Experience Required
8–10 years of experience in Data Engineering / Data Warehousing
Minimum 7+ years in data warehouse development
Proven experience building end-to-end data warehouse solutions
Hands-on experience in Scala-based UI development
🔍 Keywords for Search
Azure Databricks | Scala | ADF | Terraform | Delta Lake | Azure DevOps | CI/CD