AWS Databricks Data Engineer

Job Title: AWS Databricks Data Engineer

Location: Los Angeles, CA (Hybrid)
Employment Type: Contract

Job Summary

We are seeking an experienced AWS Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in AWS cloud services, Databricks, and big data technologies, with a focus on delivering high-performance data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks on AWS
• Build and optimize ETL/ELT workflows for large-scale data processing
• Work with structured and unstructured data from multiple sources
• Implement data models to support analytics and reporting
• Optimize performance of Spark jobs and Databricks clusters
• Collaborate with data scientists, analysts, and stakeholders
• Ensure data quality, governance, and security best practices
• Automate workflows using orchestration tools (e.g., Airflow)
• Monitor and troubleshoot production data pipelines

Required Skills & Qualifications

• 5+ years of experience in Data Engineering
• Strong hands-on experience with AWS services (S3, Lambda, Glue, Redshift, EMR)
• Expertise in Databricks and Apache Spark (PySpark/Scala)
• Proficiency in Python and SQL
• Experience with ETL/ELT pipeline development
• Knowledge of data warehousing concepts
• Familiarity with CI/CD and DevOps practices
• Experience with version control systems (Git)

Preferred Qualifications

• Experience with streaming technologies (Kafka, Kinesis)
• Knowledge of Delta Lake architecture
• Experience with data governance and security frameworks
• Certification in AWS or Databricks is a plus

Soft Skills

• Strong problem-solving abilities
• Excellent communication and collaboration skills
• Ability to work in a fast-paced, agile environment