Azure Data Engineer

• Build scalable data processing solutions using Azure Databricks and Apache Spark.
• Manage and optimize data storage in Azure Data Lake Storage (ADLS) and Azure SQL Database.
• Integrate data from multiple sources including APIs, databases, and cloud services.
• Implement data quality, governance, and security best practices.
• Collaborate with data scientists, analysts, and business stakeholders to deliver reliable data solutions.
• Monitor and optimize data pipeline performance and reliability.
• Maintain documentation for data architecture and processes.

Required Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field.
• 3+ years of experience in data engineering or related roles.
• Strong proficiency in SQL and Python.
• Experience with Azure Data Factory, Azure Databricks, and Azure Data Lake.
• Experience building ETL/ELT data pipelines.
• Understanding of data warehousing concepts and data modeling.
• Experience with version control systems such as Git.

Preferred Qualifications

• Microsoft Certified: Azure Data Engineer Associate (DP-203) certification.
• Experience with Power BI for data visualization.
• Familiarity with Azure Synapse Analytics.
• Knowledge of Apache Spark and distributed data processing frameworks.