Amazon

AI Benchmarking Specialist, SP Support - French, International Seller Growth

Job Description

The Seller AI team within International Seller Services organization is focused on helping sellers with the right set of Gen-AI/LLM powered tools and agentic solutions that can enable them to accelerate business growth on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior seller experience to our sellers worldwide. The AI Benchmarking Associate supports the evaluation of AI systems by designing and executing benchmarking and audit activities to assess model quality, compliance, robustness, and fairness. The role combines elements of AI auditing, quality assurance, and traditional audit-style documentation and stakeholder communication. By joining us, you will play a pivotal role in shaping the future of selling on Amazon for sellers worldwide.


Key job responsibilities
As part of your role, you will have the opportunity to,
• Assist in planning and executing benchmarking exercises for AI models, including defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliability
• Support content accuracy, relevancy, and privacy checks by reviewing datasets, model outputs, and data handling practices, escalating potential regulatory risks.
• Validate data based on specific annotation guidelines, ensuring the accuracy and quality of the collected information
• Prepare clear audit and benchmarking reports, including error ratings, root-cause analysis, and recommendations, and contribute to presentations for senior stakeholders
Maintain organized audit documentation, evidence, and benchmarking datasets to support internal review
• You will work closely with your team members and managers to drive process efficiencies and explore opportunities for automation
• You will strive to enhance the productivity and effectiveness of the data generation by contributing to the development and continuous improvement of AI audit methodologies, checklists, and test frameworks as regulations and best practices evolve

We are open to hiring candidates to work out of one of the following locations:

Bengaluru, Karnataka, IND


About the team
There are millions of small and medium businesses across international stores such as India, LatAm, Europe, Middle East, Japan etc. who sign up as sellers on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior seller experience to our sellers worldwide. - Bachelor's degree or equivalent
- Speak, write, and read fluently in French and English with respect to complex technical instructions and concepts. B2 or abover certified


Jobs at Bengaluru

Amazon

System Developement Engineer, XB-SE…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Oracle

Principal Software Developer

Professional

Bengaluru, Karnataka

View Details

Last Date: May 30, 2026

Oracle

Network Developer 3

Professional

Bengaluru, Karnataka

View Details

Last Date: April 14, 2026

Oracle

Temp Staff

Professional

Bengaluru, Karnataka

View Details

Last Date: Sept. 10, 2026

Oracle

Consulting Practice Manager- Java M…

Professional

Bengaluru, Karnataka

View Details

Last Date: April 25, 2026

Amazon

Software Development Engineer, Amaz…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Amazon

Finance Manager - AWS Order to Cash…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Oracle

Software Development Director

Professional

Bengaluru, Karnataka

View Details

Last Date: May 11, 2026

Amazon

Applied Scientist II, Amazon Smart …

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Amazon

Manager, Account Management, NA AVS

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Oracle

Software Developer 3

Professional

Bengaluru, Karnataka

View Details

Last Date: June 7, 2026

Oracle

Full Stack Developer-PLSQL /Java

Professional

Bengaluru, Karnataka

View Details

Last Date: June 8, 2026




More Jobs at Amazon

Amazon

Transportation Spc - Portuguese , C…

Freshers/Experienced

Virtual, Virtual

View Details

Last Date: Jan. 27, 2026

Amazon

Senior Audio Software Development E…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Software Development Manager, Alexa…

Freshers/Experienced

Pune, Maharashtra

View Details

Last Date: Feb. 3, 2026

Amazon

Software Development Manager, Ship …

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: Feb. 3, 2026

Amazon

Software Development Engineer - II,…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: Feb. 3, 2026

Amazon

Sr. Embedded SDE, Hardware Compute …

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Software Development Manager, Prime…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

SDE2

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: Jan. 27, 2026

Amazon

Software Development Manager, AFT F…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Data Centre Linux & HW Engineer, In…

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: Feb. 3, 2026

Amazon

Sr. Business Intel Engineer, Delive…

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: Feb. 3, 2026

Amazon

Associate, Quality Services, Builde…

Freshers/Experienced

Chennai, Tamil Nadu

View Details

Last Date: Jan. 27, 2026




Actively Recruiting Companies at Bengaluru, Karnataka