AI Platform Engineer
Job Description
AI Platform Engineer to design and build the foundational components that power enterprise-scale GenAI
applications. This includes data guardrails, model safety tooling, observability pipelines, evaluation harnesses, and standardized logging/monitoring frameworks. This role is critical for enabling safe, reliable, and compliant AI development across multiple use cases, teams, and business units. Idea is to create the common platform servicesthat AI team will build upon. Governance
Required Qualifications Technical Skills
● 5-10+ years software engineering or ML infrastructure experience.
● Strong Python engineering fundamentals (FastAPI, async, typing/Pydantic, testing).
● Experience with model safety/guardrails approaches (prompt injection defense, PII redaction, toxicity filters, policy enforcement).
● Hands-on with Arize AI, LangSmith, or similar LLM observability platforms.
● Experience creating evaluation frameworks using RAGAS, G-Eval, or custom rubric systems.
● Strong familiarity with vector databases (Pinecone, Weaviate, Milvus), embeddings, and retrieval pipelines.
● Solid understanding of LLM architectures, tokenization, embeddings, context limits, and RAG patterns.
● Experience in cloud (GCP preferred), Kubernetes/GE, containers, and CI/CD.
● Strong understanding of security, governance, DLP, data privacy, RBAC, and enterprise compliance requirements.
Similar Jobs
Platform Engineer GCP With AI
California
AI Engineer
Remote
AI Platform Architect
California
AI Engineer
Remote
Enterprise AI Platform
Remote