Amazon

AI Benchmarking Specialist, SP Support - French, International Seller Growth

Job Description

The Seller AI team within International Seller Services organization is focused on helping sellers with the right set of Gen-AI/LLM powered tools and agentic solutions that can enable them to accelerate business growth on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior seller experience to our sellers worldwide. The AI Benchmarking Associate supports the evaluation of AI systems by designing and executing benchmarking and audit activities to assess model quality, compliance, robustness, and fairness. The role combines elements of AI auditing, quality assurance, and traditional audit-style documentation and stakeholder communication. By joining us, you will play a pivotal role in shaping the future of selling on Amazon for sellers worldwide.


Key job responsibilities
As part of your role, you will have the opportunity to,
• Assist in planning and executing benchmarking exercises for AI models, including defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliability
• Support content accuracy, relevancy, and privacy checks by reviewing datasets, model outputs, and data handling practices, escalating potential regulatory risks.
• Validate data based on specific annotation guidelines, ensuring the accuracy and quality of the collected information
• Prepare clear audit and benchmarking reports, including error ratings, root-cause analysis, and recommendations, and contribute to presentations for senior stakeholders
Maintain organized audit documentation, evidence, and benchmarking datasets to support internal review
• You will work closely with your team members and managers to drive process efficiencies and explore opportunities for automation
• You will strive to enhance the productivity and effectiveness of the data generation by contributing to the development and continuous improvement of AI audit methodologies, checklists, and test frameworks as regulations and best practices evolve

We are open to hiring candidates to work out of one of the following locations:

Bengaluru, Karnataka, IND


About the team
There are millions of small and medium businesses across international stores such as India, LatAm, Europe, Middle East, Japan etc. who sign up as sellers on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior seller experience to our sellers worldwide. - Speak, write, and read fluently in French and English with respect to complex technical instructions and concepts
- Bachelor's degree or equivalent


Jobs at Bengaluru

Oracle

Software Developer 1

Campus

Bengaluru, Karnataka

View Details

Last Date: Jan. 7, 2027

Amazon

Transportation Representative, Amaz…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Oracle

Oracle Fusion CX Incentive Compens…

Professional

Bengaluru, Karnataka

View Details

Last Date: May 16, 2026

Oracle

Software Developer 3- OCI

Professional

Bengaluru, Karnataka

View Details

Last Date: Jan. 28, 2026

Oracle

Senior AI Applications Engineer

Professional

Bengaluru, Karnataka

View Details

Last Date: May 2, 2026

Oracle

Fusion HCM Functional (OTL, absence…

Professional

Bengaluru, Karnataka

View Details

Last Date: July 6, 2026

Amazon

AI Benchmarking Specialist, SP Supp…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Oracle

Senior Network Developer 3 (NRB)

Professional

Bengaluru, Karnataka

View Details

Last Date: Feb. 22, 2026

Amazon

Quality Assurance Engineer I, World…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Oracle

Software Development Snr Manager

Professional

Bengaluru, Karnataka

View Details

Last Date: April 26, 2026

Oracle

Java Application Developer

Professional

Bengaluru, Karnataka

View Details

Last Date: June 8, 2026

Oracle

Fusion HCM Functional Lead/Sr Consu…

Professional

Bengaluru, Karnataka

View Details

Last Date: May 11, 2026




More Jobs at Amazon

Amazon

Software Development Engineer

Freshers/Experienced

Chennai, Tamil Nadu

View Details

Last Date: Feb. 3, 2026

Amazon

WHS Officer

Freshers/Experienced

Gurgaon, Haryana

View Details

Last Date: Feb. 3, 2026

Amazon

Software Development Manager- Finan…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Infrastructure Deployment Engineer,…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Software Engineer II, Selection Mon…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Risk Manager, Selling Partner Ident…

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: Jan. 27, 2026

Amazon

Team Lead

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Data Engineer, Amazon

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Software Development Engineer, RBS …

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2026

Amazon

Risk Manager II, FinOps

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

Software Development Engineer, Amaz…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026

Amazon

MIS Specialist

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Jan. 27, 2026




Actively Recruiting Companies at Bengaluru, Karnataka