PwC Hiring AI Testing Specialist (Bengaluru) | ₹18 LPA

Job Description & Summary

At PwC, the data and analytics engineering team uses advanced technologies to design and develop robust data solutions for clients. The work turns raw data into actionable insights that support informed decisions and business growth.

In data engineering at PwC, you will design and build data infrastructure and systems that enable efficient data processing and analysis. You will develop and implement data pipelines, data integration, and data transformation solutions.

Responsibilities

• Define and implement enterprise-wide AI testing and quality assurance strategies.
• Drive continuous improvement in test automation, quality metrics, and release processes.
• Build and maintain scalable automation frameworks for AI applications and APIs.
• Develop automated validation pipelines for machine learning models.
• Integrate automated testing into CI/CD workflows.
• Validate LLM responses using automated evaluation frameworks.
• Design testing strategies for chatbots, copilots, agents, and RAG applications.
• Evaluate prompt effectiveness and response quality.
• Implement automated prompt testing and output validation.
• Conduct load, stress, scalability, and resilience testing for AI applications.

Mandatory Skill Sets

• Playwright
• Selenium
• MLflow
• OpenAI Evaluations
• CI/CD Pipelines

Preferred Skill Sets

• Experience testing LLMs, RAG architectures, AI Agents, and Copilot

A career within Data and Analytics services helps organizations uncover enterprise insights and drive business results using smarter data analytics. The practice covers business intelligence, data management, and data assurance to help clients drive innovation, growth, and change.

We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship.