Data Engineer
Job Description
Must-Have Qualifications:
· 10+ years of hands-on data engineering experience with strong focus on AWS +Databricks environments.
· Proven track record of migrating PostgreSQL workloads from AWS to modern lakehouse platforms.
· DatabricksCertified Data Engineer (Associate or Professional).
· Experience with healthcare data and regulatory formats including X12 837, HL7, EBCDIC files, etc.
· Deep expertise in data masking, governance frameworks, and working in HIPAA-regulated environments.
· Familiarity and working knowledge in adhering to CI/CD processes and practices in a cloud ecosystem.
· Proficiency in PySpark,SQL, DeltaLake, and data transformation in Databricks.
· Solid understanding of dataingestion from AWS (hashtag#S3, Glue, Lambda) into Databricks.
Preferred Skills:
· Familiarity with FHIR, X12 837, HL7, or other clinical data standards.
· Experience with Unity Catalog and Lakehouse governance frameworks.
· Knowledge of Agile methodologies and CI/CD practices for data pipelines.
· This role is healthcare domain-focused, and prior experience working with payers, providers, or healthcare clearinghouses is highly desirable.
Similar Jobs
Big Data Engineer
Remote
Servicenow Engineer
Washington
Data Analyst
Texas
Data Scientist
Remote
Senior Autonomous Software Engineer
Illinois