Virtusa

SDET with GenAI

Job Description

SDET with AI

Collaborate with business stakeholders to identify and define use cases
Design develop and execute automated tests using Python to ensure the functionality and performance of the product
Conduct manual testing where necessary to complement automated tests
Write complex SQL queries for test data generation and validation
Test and validate the product developed by the developers ensuring it meets the specified requirements
Stay informed and proficient in GenAI evaluation frameworks applying them effectively to assess the product
Perform rigorous testing of machine learning ML and deep learning DL components
Knowledge of Synthetic data generation techniques
Demonstrate in depth knowledge of evaluation based frameworks such as RAGAS Retrieval Augmented Generation for Automated Systems and a basic understanding of how RAG Retrieval Augmented Generation works
Define and implement testing strategies
Exhibit excellent communication and documentation skills to clearly report issues document test cases and articulate the results to technical and non technical stakeholders
Apply analytical skills to troubleshoot and resolve complex problems ensuring the highest quality standards are met

Skills and Qualifications
Proven experience in testing AI ML based solutions particularly generative AI GenAI
Proficiency in automated testing with Python
Familiarity with manual testing processes
Strong knowledge of SQL for data manipulation and testing purposes
Demonstrated experience with GenAI evaluation frameworks and testing of ML DL solutions
Expertise in prompt engineering for LLMs including question generation and evaluation metrics
Comprehensive knowledge of RAGAS and RAG frameworks
Experience with evaluating chatbot use cases and ensuring their effectiveness and relevance
Exceptional communication and documentation abilities
Strong analytical and problem solving skills


Jobs at Bangalore

Virtusa

Front End Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2025

Capgemini

Application Consultant - C

Experienced Professionals

Bangalore, Karnataka

View Details

Last Date: June 25, 2025

KPMG

Technology Consulting-DT IT Audit E…

KI Professional

Bangalore, Karnataka

View Details

Last Date: June 25, 2025

KPMG

Assistant Manager - SAP- ABAP

KI Professional

Bangalore, Karnataka

View Details

Last Date: June 25, 2025

Capgemini

SAFE Specialist/Scrum Master | 12 t…

Experienced Professionals

Bangalore, Karnataka

View Details

Last Date: June 25, 2025

Amazon

Senior Ontologist based in Munich, …

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Training Specialist QC HUB, GSF L&D

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Software Development Engineer, Alex…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Cluster Security & Loss Prevention …

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Software Development Manager, SC.os

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 1, 2025

Amazon

Business Analyst II (Risk Mining An…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Sr. Recon. Administrator, Service E…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 1, 2025




More Jobs at Virtusa

Virtusa

Oracle DBA

Full Time

Pune, Maharashtra

View Details

Last Date: June 30, 2025

Virtusa

Architect (ATC)

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2026

Virtusa

BA - Data & Banking

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Dec. 31, 2025

Virtusa

Java Developer

Full Time

Pune, Maharashtra

View Details

Last Date: July 31, 2025

Virtusa

React JS Developer

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Dec. 31, 2025

Virtusa

QA Automation (GBS)

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Dec. 31, 2025

Virtusa

Mulesoft Architect (ATC)

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 31, 2025

Virtusa

Product Owner

Full Time

Gurgaon, Haryana

View Details

Last Date: June 30, 2025

Virtusa

Pega SSA

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

IOS developer

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

QA Lead

Full Time

Pune, Maharashtra

View Details

Last Date: Dec. 31, 2025

Virtusa

Java FSD

Full Time

Chennai, Tamil Nadu

View Details

Last Date: June 30, 2025




Actively Recruiting Companies at Bangalore, Karnataka