Virtusa

SDET with GenAI

Job Description

SDET with AI

Collaborate with business stakeholders to identify and define use cases
Design develop and execute automated tests using Python to ensure the functionality and performance of the product
Conduct manual testing where necessary to complement automated tests
Write complex SQL queries for test data generation and validation
Test and validate the product developed by the developers ensuring it meets the specified requirements
Stay informed and proficient in GenAI evaluation frameworks applying them effectively to assess the product
Perform rigorous testing of machine learning ML and deep learning DL components
Knowledge of Synthetic data generation techniques
Demonstrate in depth knowledge of evaluation based frameworks such as RAGAS Retrieval Augmented Generation for Automated Systems and a basic understanding of how RAG Retrieval Augmented Generation works
Define and implement testing strategies
Exhibit excellent communication and documentation skills to clearly report issues document test cases and articulate the results to technical and non technical stakeholders
Apply analytical skills to troubleshoot and resolve complex problems ensuring the highest quality standards are met

Skills and Qualifications
Proven experience in testing AI ML based solutions particularly generative AI GenAI
Proficiency in automated testing with Python
Familiarity with manual testing processes
Strong knowledge of SQL for data manipulation and testing purposes
Demonstrated experience with GenAI evaluation frameworks and testing of ML DL solutions
Expertise in prompt engineering for LLMs including question generation and evaluation metrics
Comprehensive knowledge of RAGAS and RAG frameworks
Experience with evaluating chatbot use cases and ensuring their effectiveness and relevance
Exceptional communication and documentation abilities
Strong analytical and problem solving skills


Jobs at Bangalore

Paypal

Engineering Program Mgmt 3

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 6, 2025

Amazon

Software Development Engineer, Sant…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Business Analyst , Customer Experie…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 1, 2025

Virtusa

QA Automation

Full Time

Bangalore, Karnataka

View Details

Last Date: Sept. 30, 2025

Amazon

IT Manager II, OPSTech IT -Service …

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 1, 2025

Amazon

Team Lead - Last Mile, GSF Last Mile

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Amazon

Software Dev Engineer I, Amazon Uni…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Paypal

Senior Software Engineer - Frontend

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 22, 2025

Capgemini

Product, System & PLM Engineer - B

Experienced Professionals

Bangalore, Karnataka

View Details

Last Date: July 2, 2025

Virtusa

UI Development Lead

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 14, 2025

Amazon

Software Development Engineer - III

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 24, 2025

Virtusa

Data Visualization

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2025




More Jobs at Virtusa

Virtusa

SDET with GenAI

Full Time

Bangalore, Karnataka

View Details

Last Date: June 30, 2025

Virtusa

Senior Consultant- Pega

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Virtusa

Angular Lead

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

Java FSD (CJ)

Full Time

Chennai, Tamil Nadu

View Details

Last Date: July 31, 2025

Virtusa

Angular UI Lead

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Dec. 31, 2025

Virtusa

Thunderhead

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

Oracle DBA

Full Time

Pune, Maharashtra

View Details

Last Date: June 30, 2025

Virtusa

Talend + Snowflake

Full Time

Chennai, Tamil Nadu

View Details

Last Date: June 30, 2025

Virtusa

Azure Devops

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

Pega CSSA Developer

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Jan. 31, 2026

Virtusa

Oracle Fusion

Full Time

Gurgaon, Haryana

View Details

Last Date: Dec. 31, 2025

Virtusa

Senior Business Analyst

Full Time

Mumbai, Maharashtra

View Details

Last Date: June 30, 2025




Actively Recruiting Companies at Bangalore, Karnataka