Senior Data & AI Quality Engineer - Chennai (Hybrid)

Hiring for: A US-based, AI-first data solutions company founded by seasoned technology leaders.

Role: Senior Data & AI Quality Engineer - Chennai (Hybrid)

Positions: 1

Experience: 5 to 10 years

Location(s): Chennai

Type: On-site, Hybrid / Permanent

Salary: Up to INR 25 LPA (best as per the fitment)

Notice Period: Immediate to 30 days

Key Responsibilities:

• Ingestion pipelines: Confluence, SharePoint/Microsoft 365 (Graph), and repository connectors - parsing, chunking, metadata, incremental sync, data-quality controls

• Synthetic and non-production data design: corpora shaped to banking IT content (runbooks, incidents, KB articles, change records) with realistic permission structures the foundation of the cloud-first build

• The evaluation harness as a product: golden question sets, retrieval precision/faithfulness/citation-accuracy scoring, the zero-leakage permission suite, the zero-unauthorized-actions agent suite; CI-integrated regression gates

• Performance and load testing with the platform engineer: concurrency profiles, soak tests, degraded-mode behavior

• UAT orchestration and defect triage across both use cases; acceptance evidence packs per milestone

• Measurement reporting foundations: the before/after value metrics (time saved per incident, per search) the client's executives receive monthly

Technical Skills:

• 5+ years across data engineering and quality engineering with production Python; you have built pipelines AND the tests that police them

• LLM evaluation experience: has designed or operated retrieval/generation quality measurement with numeric thresholds (RAGAS-class metrics, custom harnesses, or equivalent) not just eyeballed outputs

• Document-processing depth: parsing real enterprise content (tables, permissions, versions, mess), chunking trade-offs, metadata design

• Test-suite craftsmanship: negative and adversarial test design the leakage suite is a security artifact, and you think like an attacker when writing it

• Load/performance testing experience (Locust, k6, or equivalent) and defect-triage discipline