Palantir Foundry Engineer

Role Summary

We are seeking a hands-on Palantir Foundry Engineer who can design ontology-first data products, engineer highly reliable pipelines, and operationalize them into secure, observable, and reusable building blocks supporting multiple applications (Workshop/Slate, AIP/Actions).
You will own the full data lifecycle — from raw sources to governed, versioned, and materialized datasets integrated with operational applications and AIP agents.

Core Responsibilities Ontology & Data Product Design

·        Design ontology models, including Object Types, relationships, and semantics.

·        Define authoritative datasets with lineage, provenance, and schema evolution strategies.

Pipelines & Materializations

·        Develop and optimize Code Workbook transforms using SQL and PySpark/Scala.

·        Orchestrate multi-stage DAGs, tune cluster/runtime performance, and implement incremental and snapshot patterns.

·        Manage backfills, recovery, and data versioning.

Operationalization

·        Configure schedules, SLAs/SLOs, alerts, and data quality tests (constraints, anomaly/volume checks).

·        Implement idempotency, checkpointing, and automated retries.

Governance & Security

·        Apply RBAC, object-level permissions, and data policy tagging for PII and compliance.

·        Integrate with enterprise identity systems and maintain documentation of data contracts.

Performance Engineering

·        Optimize data joins, partitions, caching, and materialization strategies.

·        Improve file layout (Parquet/Delta) and minimize shuffles for better cost and runtime efficiency.

Dev Productivity & SDLC

·        Manage Git-backed repositories for Foundry code, including branching, versioning, and CI/CD pipelines.

·        Develop unit/integration tests for transforms and reusable templates for domain teams.

Applications & Interfaces

·        Expose ontology-backed data to Workshop/Slate apps and wire AIP agents to governed datasets.

·        Publish APIs and data feeds for downstream consumption.

Reliability & Incident Response

·        Own on-call responsibilities for data products; lead RCA efforts and develop runbooks.

·        Drive preventive engineering and ensure operational resilience.

Documentation & Enablement

·        Create detailed playbooks, data product specifications, and runbooks.

·        Mentor team members on Foundry best practices and reusable engineering patterns.

Required Qualifications

·        15+ years in Data Engineering or Analytics Engineering.

·        5+ years of hands-on experience with Palantir Foundry at enterprise scale.

·        Deep knowledge of Foundry Ontology, Code Workbooks, Pipelines, Materializations, Lineage, and Permissions.

·        Strong SQL and PySpark/Scala skills, including UDFs, window functions, and partitioning/bucketing.

·        Proven operational excellence with SLAs/SLOs, data quality frameworks, and blue/green or canary releases.

·        Proficiency with Git, CI/CD, test automation, and environment promotion in Foundry.

·        Experience with cloud storage & compute (AWS/Azure/GCP), file formats (Parquet/Delta), and cost-performance tuning.

·        Strong understanding of data governance, security models, and PII handling within Foundry.

Nice to Have

·        Experience building Workshop/Slate UX and authoring Actions integrated with AIP use cases.

·        Familiarity with streaming/event ingestion (Kafka, Kinesis) into curated datasets.

·        Exposure to observability tools (Datadog, CloudWatch, Prometheus) for pipeline monitoring.

·        Background in FinOps/cost governance or establishing platform standards and reusable templates.