Product Manager: Data and Evaluation

AI71

Employer Active

Posted on 16 Dec

Experience

5 - 8 Years

Education

Any Graduation

Nationality

Any Nationality

Gender

Not Mentioned

Vacancy

1 Vacancy

Job Description

Roles & Responsibilities


  • Product Data & Analytics
    • Own the product data stack end-to-end across squads: telemetry, event schemas, tracking plans, data quality, warehousing, and accessibility of metrics both for our on-premise and our SaaS offerings.
    • Define the product metrics framework (north stars, input metrics, leading indicators) and help stakeholders build reliable dashboards.
  • ML Evaluation & Experimentation
    • Build/own ML evaluation loops: curate test sets, define KPIs (quality, safety, bias, latency, cost), run offline/online evals, help evaluate agents, tools, finetunes, and retrieval changes; maintain an eval pipeline that s reproducible and automated in CI
    • Lead experimentation: design and analyze A/B tests - help create a framework for testing our customers agents and our hyper-parameters.
  • Strategy & Governance:
    • Ground pricing strategy in data: analyze feature/cost relationships, develop value-based pricing models, and create metrics that link usage patterns to pricing tiers.
    • Set data standards: event naming, governance, PII handling, retention, and privacy-by-design in collaboration with Security/Legal teams.

Desired Candidate Profile


  • 5 8+ years in product roles with a strong engineering or data background (e.g., software, data engineering, ML engineering, analytics engineering) in tech product companies
  • Proven ownership of instrumentation, analytics, and experimentation for a product surface or platform
  • Deep comfort with SQL and experimentation stats (power, MDE, CUPED, guardrail metrics); able to sanity-check analyses and run your own when needed
  • Practical experience working with ML-powered products and their evaluation (offline test sets, online metrics, drift/monitoring)
  • Strong product sense + stakeholder management; able to drive clarity across PM, DS, Eng, and Execs
  • Comfortable using AI tools to prototype analyses or small utilities (e.g., generate code for ETL, dashboards, or validators)

Company Industry

Department / Functional Area

Keywords

  • Product Manager: Data And Evaluation

Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com

AI71


  • we build AI products and deliver AI custom solutions for privacy and data sovereignty sensitive corporations and government entities
  • we're a product company with a strong advisory/forward deployed team
  • Our flagship product is Ask - a customizable AI enterprise platform for knowledge workers productivity. We re also building vertical AI products in construction, health, agriculture, and others
  • We re a young (2023) but fast growing (140 people) company
  • Our team comes from tier 1 product companies (DeepMind, Google, Amazon, Apple) and tier 1 strategy consulting firms (McKinsey QuantumBlack, BCG X)
  • we're based in Abu Dhabi and have strong ties to the region - but we serve international customers

Read More

https://job-boards.eu.greenhouse.io/ai71/jobs/4685276101

Similar Jobs

Data Analyst

Confidential Company

  • 2 - 8 Years
  • Jeddah - Saudi Arabia

Senior Engineer – Data Center

Confidential Company

  • 5 - 7 Years
  • Abu Dhabi - United Arab Emirates (UAE)

Business Analyst

Confidential Company

  • 2 - 8 Years
  • Dubai - United Arab Emirates (UAE)
View All