We are seeking a skilled Content Reviewer to join our team. The ideal candidate will have fluency in German or French and excellent analytical skills.
As a Content Reviewer, your primary goal will be to evaluate health-related prompts, make judgments, and decisions based on predefined options from task guidelines. Your feedback will directly inform positive and negative changes to the underlying AI models and contribute to the refinement of evaluation guidelines.
The key responsibilities of this role include:
* Reading and understanding new evaluation guidelines, including specific criteria and examples for assessing model output
* Evaluating responses based on provided criteria, focusing on areas such as ability to answer user questions, helpfulness of responses, understanding and interpretation of user queries, factuality of information, and overall sentiment
* Documenting any questions, concerns, or issues encountered while applying guidelines to the new model output
* Providing clear, concise, and constructive comments directly on the guidelines to facilitate fast-follow updates
* Participating in calibration sessions with team members, other locations, or clients as instructed
Additionally, you will work effectively both independently and as part of a team, synthesizing evaluation findings into actionable recommendations for modeling and product teams. You will also communicate clearly with internal and external contacts as required.
To be successful in this role, you will need to have native fluency in German (alongside English) and strong analytical skills. Experience in content review, data annotation, or quality assurance is advantageous, but not essential. You will also have expertise of French or German culture and familiarity with local standards, places, important numbers, locally used conversion units, metrics, slangs, nuances, festivals which are not appropriate for a user in France or Germany.
Key Skills & Qualifications:
* Native in German (along English)
* Strong analytical skills and attention to detail in scoring, identifying errors, and providing clear written justifications
* Familiarity with general health and wellness concepts & terms
* Familiarity with common wearable device metrics is a plus