Product Manager: Data and Evaluation
AI71
Employer Active
Posted on 16 Dec
Send me Jobs like this
Nationality
Any Nationality
Gender
Not Mentioned
Vacancy
1 Vacancy
Job Description
Roles & Responsibilities
- Product Data & Analytics
- Own the product data stack end-to-end across squads: telemetry, event schemas, tracking plans, data quality, warehousing, and accessibility of metrics both for our on-premise and our SaaS offerings.
- Define the product metrics framework (north stars, input metrics, leading indicators) and help stakeholders build reliable dashboards.
- ML Evaluation & Experimentation
- Build/own ML evaluation loops: curate test sets, define KPIs (quality, safety, bias, latency, cost), run offline/online evals, help evaluate agents, tools, finetunes, and retrieval changes; maintain an eval pipeline that s reproducible and automated in CI
- Lead experimentation: design and analyze A/B tests - help create a framework for testing our customers agents and our hyper-parameters.
- Strategy & Governance:
- Ground pricing strategy in data: analyze feature/cost relationships, develop value-based pricing models, and create metrics that link usage patterns to pricing tiers.
- Set data standards: event naming, governance, PII handling, retention, and privacy-by-design in collaboration with Security/Legal teams.
Desired Candidate Profile
- 5 8+ years in product roles with a strong engineering or data background (e.g., software, data engineering, ML engineering, analytics engineering) in tech product companies
- Proven ownership of instrumentation, analytics, and experimentation for a product surface or platform
- Deep comfort with SQL and experimentation stats (power, MDE, CUPED, guardrail metrics); able to sanity-check analyses and run your own when needed
- Practical experience working with ML-powered products and their evaluation (offline test sets, online metrics, drift/monitoring)
- Strong product sense + stakeholder management; able to drive clarity across PM, DS, Eng, and Execs
- Comfortable using AI tools to prototype analyses or small utilities (e.g., generate code for ETL, dashboards, or validators)
Company Industry
- IT - Software Services
Department / Functional Area
- Product Development
- Product Management
Keywords
- Product Manager: Data And Evaluation
Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com
AI71
Similar Jobs
Data Analyst
Confidential Company
- 2 - 8 Years
- Jeddah - Saudi Arabia
Senior Engineer – Data Center
Confidential Company
- 5 - 7 Years
- Abu Dhabi - United Arab Emirates (UAE)
Business Analyst
Confidential Company
- 2 - 8 Years
- Dubai - United Arab Emirates (UAE)