Databricks Architect

Required Skills & Experience
7+ years of experience in data engineering/architecture.
3+ years of hands-on experience with Databricks.
Strong expertise in Spark, PySpark, SQL, and distributed data processing.
Deep understanding of Delta Lake features: ACID transactions, OPTIMIZE, ZORDER, Auto Loader.
Experience with workflow orchestration, jobs, and Databricks REST APIs.
Hands-on expertise with at least one cloud platform:
Azure (preferred): ADF, ADLS, Key Vault, Event Hub, Azure DevOps
AWS: S3, Glue, Lambda, Kinesis
GCP: GCS, Dataflow, Pub/Sub
Familiarity with CI/CD, Git, DevOps, and Infrastructure-as-Code (Terraform preferred).
Soft Skills
Strong analytical and problem-solving skills.
Excellent communication and stakeholder management.
Ability to lead design discussions and guide technical teams.
Strong documentation and architectural blueprinting skills.
Preferred Qualifications
Databricks certifications, such as:
Databricks Certified Data Engineer Professional
Databricks Certified Machine Learning Professional
Databricks Lakehouse Fundamentals
Experience with MLflow, Feature Store, or MLOps workflows.
Experience working in regulated industries (BFSI, healthcare, etc.).