Azure Data Engineer

Key Skills:
• Azure ADB
• Databricks
• Pyspark
• Azure DevOps
• Data Pipelines

Roles & Responsibilities:
· Experience in generating data pipelines in Azure ADB
· Experience in ingesting data from different Sources using in Azure ADB
· Experience in transforming the data using Azure Databricks & Delta lake and Pyspark
· Experience in Azure DevOps CI/CD – Stories, Bugs, and Issue management
· Implement Integration solution in Microsoft Azure
· Performs data analysis required to troubleshoot data related issues and assist in the resolution
of data issues
· Experience working in agile development projects and sprint deliver
data pipelines.
· Perform data transformations and cleansing operations to ensure data accuracy and
consistency.
· Evolve existing scripts and notebooks to meet client needs.
· Monitor, troubleshoot, and optimize data pipelines for seamless functionality.
· Ensure data solutions align with security and compliance standards
· Work closely with data architects to harmonize data models with project objectives.
· Document programming efforts and processes, technical specifications, and best practices.
Role Descriptions: Databricks