QA Engineer

Job Title: QA Engineer with AI Experience

📍 Location: New York City, NY (Onsite – Local Candidates Only)
💼 Employment Type: Contract (C2C)
🧑‍💻 Experience: 12+ Years

Job Summary:

We are seeking a highly experienced QA Engineer with AI expertise to ensure the quality, reliability, and performance of AI-driven applications. The ideal candidate will have a strong background in traditional QA practices along with hands-on experience testing Generative AI (GenAI) and machine learning-based systems.

Key Responsibilities:

• Design and execute test strategies for AI/ML and GenAI-based applications
• Validate LLM outputs, ensuring accuracy, consistency, and relevance
• Develop and maintain automated test frameworks for web, API, and AI systems
• Perform functional, regression, integration, and performance testing
• Test RAG pipelines, including embeddings, retrieval quality, and response generation
• Create test datasets and evaluate model behavior across edge cases
• Collaborate with developers, data scientists, and product teams
• Identify defects, track issues, and ensure timely resolution
• Ensure compliance with quality standards, security, and data privacy

Required Skills:

• 12+ years of experience in Software QA / Testing
• Strong experience in manual and automation testing
• Hands-on experience with test automation tools (Selenium, Cypress, Playwright, etc.)
• Experience in API testing (Postman, RestAssured, etc.)
• Knowledge of programming/scripting languages (Java, Python, or JavaScript)
• Experience testing AI/ML or GenAI systems
• Understanding of LLMs, prompt engineering, and evaluation metrics
• Experience with RAG architectures and vector databases
• Familiarity with CI/CD pipelines and DevOps practices