Company: CODVO.AI
Department: Engineering
Location: Pune, India (Hybrid)
Employment Type: Full-time
Experience Level: Expert (12–15+ years)
Shift Timing: 2:30 PM – 11:30 PM IST
Work Days: 3 days per week on-site
Role Goal
Provide strategic and operational leadership for a portfolio of high throughput, clinically defensible, audit ready surgical video annotation programs. Own scale, standardization, automation leverage, quality systems, and client trust across multiple programs—ensuring predictable delivery, regulatory readiness, and measurable ROI on human in the loop operations.
What You'll Do
Portfolio & Delivery Ownership (E2E)
- Own end to end delivery for multiple concurrent surgical video annotation programs across clients, procedures, and modalities.
- Set and enforce standard operating models from intake de identification annotation QA/IRR adjudication dataset release + evidence packs.
- Ensure programs meet or exceed SLAs, quality thresholds, and release timelines at scale. Operating Model & Standardization
- Define and institutionalize annotation operating standards: o Program playbooks o SOPs o Quality gates o Evidence pack structure o Dataset versioning discipline
- Ensure every program is reproducible, auditable, and clinically defensible. Ontology & Clinical Governance
- Partner with senior clinical SMEs to: o Define and approve procedure level ontologies (phases, steps, anatomy, tools, events). o Ensure consistent translation into labeling guidelines, UI constraints, and QA checks.
- Own governance mechanisms to resolve clinical ambiguity, manage guideline evolution, and prevent ontology drift across programs.
Automation First Strategy
- Set the automation vision and roadmap for surgical video labeling: o Pre labeling + verification as default o Confidence/uncertainty based task routing o Active learning feedback loops
- Drive continuous reduction in cost per labeled minute and human effort per release.
- Partner with ML, platform, and data engineering leaders to productionize automation gains.
Quality Systems & Audit Readiness
- Design and govern enterprise grade quality systems: o Multi rater strategies by label class o IRR standards (kappa, alpha, IoU/Dice as applicable) o Calibration and retraining frameworks o Acceptance thresholds by use case (R&D vs regulated)
- Ensure every dataset ships with a complete Evidence Pack: o Provenance o QA & IRR reports o Adjudication logs o Clinical and delivery sign offs
Adjudication & Risk Management
- Own disagreement governance across programs: o Escalation paths to senior adjudicators and clinicians o Systematic tracking of ambiguity categories o Closure of recurring issues via guideline and tooling updates
- Proactively identify delivery, quality, compliance, and reputational risks. Security, Privacy & Compliance Leadership
• Ensure all annotation programs comply with: o De identification standards o Data access controls o Logging, retention, and audit requirements • Serve as executive owner for security reviews, audits, and vendor risk assessments (SOC2 / ISO aligned environments).
Client & Executive Leadership
- Act as senior escalation and trusted advisor for clients.
- Lead executive level program reviews, roadmap discussions, and expansion opportunities.
- Ensure PoCs convert into long term, scaled production partnerships.
Build & Scale Organization & Talent
• Build and lead a multi layered delivery organization: o Program Leads o Senior annotators & adjudicators o QA auditors o Training & calibration leads • Define career pathways, certification standards, and succession plans.
Operating Infrastructure
- Enterprise level: o SOP libraries o Training academies o Calibration playbooks o Release governance checklists
- Cross program tooling consistency and metrics instrumentation.
Metrics & Executive Dashboards
- Own portfolio level metrics: o Throughput & cycle time o Rework and defect density o IRR trends by label type o Acceptance pass rate o Cost per labeled minute/hour o Automation leverage and pre label acceptance
- Translate metrics into decision ready insights for leadership and clients
Required Qualifications:
-
12–15+ years of hands-on experience in data operations, annotation programs, QA-led delivery, or clinical data management
-
5+ years leading managers or owning multi-program portfolios
-
Deep, hands-on expertise with video annotation programs, including temporal segmentation, event labeling, and annotation tool workflows at scale
-
Proven track record designing and running enterprise-grade quality systems with IRR accountability
-
Strong executive program management skills: capacity planning, financial control, risk management, and stakeholder leadership
-
Demonstrated ability to operationalize clinical guidelines into enforceable, tool-based workflows
-
Experience working in regulated or high-trust environments (healthcare, life sciences, sensitive data handling)
Preferred Qualifications (Strong Plus)
- Direct experience with surgical video data (endoscopy, robotics, OR cameras).
- Prior ownership of automation or ML assisted labeling programs at scale.
- Experience leading dataset versioning, reproducibility, and audit ready release processes.
- Exposure to enterprise security, privacy, and compliance frameworks.
- Background in building delivery organizations from early scale to maturity.
Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.
