Generative AI Data Scientist Opportunity
We are seeking a highly skilled Generative AI Data Scientist to join our team in Portugal. As a key member of our GenAI team, you will play a crucial role in evaluating, measuring, and assessing Agentic systems that aim to improve the wellbeing of all users.
You will collaborate with a multidisciplinary team of product managers, engineers, and domain experts to create innovative AI applications that solve real-world problems. Your impact will be significant, as you will work on designing and implementing robust evaluation metrics, performing data analysis, and optimizing chatbot interactions.
Main Responsibilities:
* Metric Design & Analysis: Collaborate with product managers and engineering teams to define and measure user engagement, satisfaction, and chatbot effectiveness;
* Data Preparation: Perform data cleansing, transformation, and quality analysis on product data;
* Evaluation and Testing: Assist and design robust evaluation metrics to assess agentic AI performance;
* Prompt Engineering: Craft reusable templates and clear instructions to measure system behavior;
* LLM Observability: Design monitoring systems that track LLM behavior in production;
* A/B testing: Design, run, and analyze A/B tests to optimize chatbot interactions;
Requirements:
* Bachelor's degree in Computer Science, Data Science, Machine Learning, Statistics, or a related field;
* Proficiency in Python for data handling and analysis;
* Advanced NoSQL and SQL skills for querying large datasets;
* Strong problem-solving abilities, with a focus on experimental design and data analysis;
* Ability to work collaboratively in a team environment and communicate effectively across different departments;
* Excellent verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders;
Preferred Qualifications:
* Familiarity with evaluation methodologies for generative AI, including human-in-the-loop assessments;
* Proven track record of tracking and evaluating generative AI models in production;
* Experience in multi-agent systems and LLMs;
About Us:
We are a wellness company committed to the health and well-being of our employees. Our benefits include:
* Wellness programs, digital fitness resources, and online support services;
* Fitness subsidies and flexible work arrangements;
* Paid time off and parental leave policies;
* Career growth opportunities and professional development resources;
Our culture values trust, flexibility, and integrity, making us an exciting and supportive environment to grow professionally and personally.