Virtusa

SDET with GenAI

Job Description

SDET with AI

Collaborate with business stakeholders to identify and define use cases
Design develop and execute automated tests using Python to ensure the functionality and performance of the product
Conduct manual testing where necessary to complement automated tests
Write complex SQL queries for test data generation and validation
Test and validate the product developed by the developers ensuring it meets the specified requirements
Stay informed and proficient in GenAI evaluation frameworks applying them effectively to assess the product
Perform rigorous testing of machine learning ML and deep learning DL components
Knowledge of Synthetic data generation techniques
Demonstrate in depth knowledge of evaluation based frameworks such as RAGAS Retrieval Augmented Generation for Automated Systems and a basic understanding of how RAG Retrieval Augmented Generation works
Define and implement testing strategies
Exhibit excellent communication and documentation skills to clearly report issues document test cases and articulate the results to technical and non technical stakeholders
Apply analytical skills to troubleshoot and resolve complex problems ensuring the highest quality standards are met

Skills and Qualifications
Proven experience in testing AI ML based solutions particularly generative AI GenAI
Proficiency in automated testing with Python
Familiarity with manual testing processes
Strong knowledge of SQL for data manipulation and testing purposes
Demonstrated experience with GenAI evaluation frameworks and testing of ML DL solutions
Expertise in prompt engineering for LLMs including question generation and evaluation metrics
Comprehensive knowledge of RAGAS and RAG frameworks
Experience with evaluating chatbot use cases and ensuring their effectiveness and relevance
Exceptional communication and documentation abilities
Strong analytical and problem solving skills


Jobs at Bangalore

Amazon

Catalog Specialist II, Global Catal…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 1, 2025

Virtusa

QA Automation

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2025

Virtusa

salesforce BA

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 31, 2025

Accolite

Ruby on Rails

4 - 12 Years Exp.

Bangalore, Karnataka

View Details

Last Date: July 5, 2025

Capgemini

SW Development - - 5+ years - Java …

Experienced Professionals

Bangalore, Karnataka

View Details

Last Date: July 2, 2025

Virtusa

Pega SSA Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: June 30, 2025

Capgemini

AMM Author | 2 to 4 years | Bengalu…

Experienced Professionals

Bangalore, Karnataka

View Details

Last Date: June 25, 2025

Capgemini

Lead Software Engineer

Experienced Professionals

Bangalore, Karnataka

View Details

Last Date: June 25, 2025

Amazon

Process Assistant, Inbound Operatio…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 1, 2025

Capgemini

Stress Concession ||4 to 6 Years ||…

Experienced Professionals

Bangalore, Karnataka

View Details

Last Date: June 25, 2025

Amazon

Financial Analyst - FinOps, FinOps …

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Vendor Consultant, French, AVS-NOP

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025




More Jobs at Virtusa

Virtusa

MuleSoft Architect

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Virtusa

Consultant

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

Architect (ATC)

Full Time

Chennai, Tamil Nadu

View Details

Last Date: June 30, 2028

Virtusa

Java App Support

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Virtusa

JAVA Tech Lead

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Oct. 31, 2025

Virtusa

IBM BPM

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Virtusa

QA Lead

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Dec. 31, 2025

Virtusa

Talend + Snowflake

Full Time

Chennai, Tamil Nadu

View Details

Last Date: June 30, 2025

Virtusa

GCP DevOps

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Virtusa

Java FSD

Full Time

Chennai, Tamil Nadu

View Details

Last Date: June 30, 2025

Virtusa

Java AWS Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 14, 2025

Virtusa

Tech Lead

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025




Actively Recruiting Companies at Bangalore, Karnataka