ETL Architect

Key Responsibilities

· Design, develop, and optimize high-performing ETL pipelines to integrate data from multiple sources using Azure Data Factory (ADF).

· Build and manage complex ETL workflows ensuring data accuracy, validation, security, and availability for analytics and reporting.

· Leverage Azure Databricks, Azure Synapse Analytics, and Azure Purview to process large volumes of structured and unstructured data.

· Perform large-scale data transformations using Spark, Python, and/or Scala.

· Optimize ETL performance to minimize latency and maximize throughput.

· Ensure data governance, security, compliance, and role-based access control (RBAC) across the Azure ecosystem.

· Maintain ETL documentation and enforce best practices for data handling and security.

· Collaborate with data engineers, analysts, business stakeholders, and security teams.

· Act as a technical mentor and provide guidance on ETL and data engineering best practices.

Required Qualifications

· Bachelor’s degree in Computer Science, Information Systems, or related field, or equivalent work experience (including SOA and Azure).

· Minimum 7 years of experience with large, complex database management systems and ETL/data engineering.

· Minimum 3 years of hands-on experience with ADF, Azure Databricks, Azure Synapse Analytics, Azure Purview, and Azure Cloud.

· Strong SQL skills and experience with complex data structures.

· Proven experience building and optimizing large-scale, high-availability ETL pipelines.

· In-depth knowledge of data governance, security protocols, and regulatory compliance.

Preferred Qualifications

· Microsoft certifications: Azure Data Engineer Associate, Azure Solutions Architect Expert, Azure Fundamentals.

· Azure Databricks Data Engineer Associate certification.