Imagine a world where technology and wellness converge to improve lives. As a Data Scientist, you'll play a crucial role in developing innovative solutions that empower individuals to prioritize their well-being.
">
About the Role
We're seeking a talented Data Scientist to join our GenAI team in Portugal. In this position, you'll collaborate with a multidisciplinary team to create cutting-edge AI applications that address real-world challenges. Your expertise will help us evaluate, measure, and assess Agentic systems designed to enhance user experience.
">
* MetricDesign & Analysis:
Collaborate with product managers and engineers to define and measure key metrics for user engagement, satisfaction, and chatbot effectiveness.
* Data Preparation:
Perform data cleansing, transformation, and quality analysis on product data.
* Evaluation and Testing:
Assist and design robust evaluation metrics to assess agentic AI performance, combining automated evaluation, adversarial testing, human-in-the-loop evaluations, and custom behavioral metrics.
* Prompt Engineering:
Craft reusable templates and clear instructions to measure system behavior, optimizing for challenging edge cases.
* LLM Observability:
Design monitoring systems that track LLM behavior in production, capturing key metrics around information retrieval, hallucinations, and latency.
* A/B testing:
Design, run, and analyze A/B tests to optimize chatbot interactions and user engagement.
Main Requirements
">
Who We Are Looking For
We're looking for a highly skilled Data Scientist with a Bachelor's degree in Computer Science, Data Science, Machine Learning, Statistics, or a related field. You should have proficiency in Python for data handling and analysis, advanced NoSQL and SQL skills for querying large datasets, strong problem-solving abilities, and excellent verbal and written communication skills.
">
Preferred Qualifications
Familiarity with evaluation methodologies for generative AI, including human-in-the-loop assessments, LLM-as-a-judge approaches, and adversarial robustness testing is a plus. Proven track record of tracking and evaluating generative AI models in production is also desirable.
">
Benefits and Perks
We offer a range of benefits to support your well-being, including access to digital fitness programs, online wellness resources, flexible work arrangements, paid time off, parental leave, and career growth opportunities.
"),