AI Prompt And Quality Engineer

WorkAsPro

About The Role

CoinMarketCap is seeking an AI Prompt and Quality Engineer to ensure the accuracy and performance of its AI chatbot systems. This role is vital for maintaining high-quality user interactions by monitoring chatbot responses, identifying and resolving issues, and contributing to model tuning and data-driven optimization.

Key Responsibilities

• Quality Monitoring: Evaluate AI chatbot responses for accuracy, relevance, and natural flow via manual checks and user feedback
• Issue Resolution: Identify issues, document root causes, and recommend effective improvements
• Model Optimization: Work with engineering teams on tuning and data annotation to improve model performance
• Data Analysis: Analyze user interactions to generate insights for product enhancement
• Process Enhancement: Refine QA processes for consistency and scalability
  
  

Qualifications

• Technical Skills:
• Strong grasp of AI chatbot architecture, evaluation metrics, SQL, Excel
• Basic knowledge of NLP and machine learning concepts
• Experience:
• 2+ years in chatbot QA or AI optimization
• Familiarity with top AI chatbot platforms
• Soft Skills:
• Excellent communication, attention to detail, problem-solving mindset, and adaptability