GenAI Technical Program Manager–Training & Evaluation Platform

Location:Bengaluru, India

About KGeN / KAI

KGeN’s “KAI – Training & Evaluation” business taps a network of 1 M+ verified experts across 60+ countries and 20+ languages, delivering specialised intelligence across domains such as coding, STEM, healthcare, content, design, legal and general annotation/labelling. As our GenAI TPM, you will be pivotal in scaling high‑quality annotation, response‑generation and model evaluation pipelines that power large‑language and multimodal AI systems.

Role Overview

You will own the end‑to‑end operations of GenAI data pipelines — from data collection and human‑annotation through model evaluation and feedback loops. You will build and optimise processes to ensure high throughput, high annotation quality, scalability across modalities (text, image, audio, video), multiple languages and verticals (e.g., healthcare, legal, design). You’ll collaborate with product, engineering, quality, and vendor/annotator networks to drive efficiency, cost control and quality metrics. This is a strategic operational role in a fast‑scaling AI training business.

Key Responsibilities

• Design, implement and manage annotation/response‑generation pipelines for GenAI systems:
• Multi‑modal data collection & preprocessing (text, image, audio, video)
• Human‑in‑the‑loop (HITL) annotation: object detection, localisation, transcription, response generation
• Model evaluation workflows: search & response evaluation, translation quality, geo‑location evaluation
• Set and track KPIs for pipeline performance: throughput, cost per unit, annotation accuracy, inter‑annotator agreement, revision rates, turnaround time, multilingual coverage
• Scale operations: build out annotator networks (in‑house + global contractors), vendor relationships, training programmes for annotators, monitoring and escalation mechanisms
• Collaborate with engineering and data science teams to integrate annotation tools, APIs, dashboards, and automation into pipelines
• Drive process improvement and workflow automation for efficiency and cost optimization across domains
• Ensure data governance, quality, and compliance: maintain annotation standards, audit trails, and data security
• Manage stakeholder relationships with business/product leads and model teams to prioritise and deliver high‑impact annotation projects

Requirements

• Bachelor’s/Master’s degree in Computer Science, Data Science, Engineering or a related field
• 2-5 years of experience in AI/Data annotation/training pipelines, with at least 2 years focused on GenAI operations
• Strong understanding of GenAI ecosystems: large‑language models, multimodal data pipelines, annotation and model evaluation workflows
• Experience scaling annotation and evaluation operations: managing global annotator networks, setting metrics, optimising cost, quality, and throughput
• Excellent stakeholder management skills: collaboration with product, engineering, and data science teams
• Strong analytical and process improvement mindset; comfort with KPIs and data‑driven decision making
• Experience in workflow automation and tooling integration (dashboards, APIs, annotation tools)
• Excellent communication skills; ability to train, mentor, and manage global teams
• Exposure to regulated domains (healthcare, legal) or multilingual/multicultural annotator networks is a plus

What We Offer

• Opportunity to work at the cutting‑edge of GenAI training and evaluation for multimodal AI systems
• Scalable, global operations environment with distributed annotator networks across 60+ countries and 20+ languages
• Competitive salary + performance incentives
• Career growth in a rapidly expanding business within KGeN