What we're looking for

We are a pioneering company at the forefront of AI evaluation, observability, and data operations, enabling enterprises to develop, deploy, and maintain high-quality AI models. Our solutions empower AI teams to streamline the entire data lifecycle, ensuring precise model evaluations, enhanced observability, and robust monitoring across agentic workflows, large language models (LLMs), and data operations.

Responsibilities

• Product Strategy & Vision: Develop and drive the product roadmap for AI evaluation, observability, and LLM agentic workflows, ensuring alignment with company objectives and evolving industry needs.
• Cross-Functional Collaboration: Work with engineering, data science, design, operations, and marketing teams to bring new features from concept to launch.
• Customer Engagement: Engage directly with AI researchers and developers to understand their workflows, pain points, and evolving requirements in LLMs and agent-based systems.
• LLM & Agentic Workflow Solutions: Develop solutions tailored to agentic workflows, LLM observability, and monitoring. Collaborate with customers to establish effective model evaluation and data quality frameworks.
• Iterative Product Development: Conduct beta programs, gather customer feedback, and iteratively improve features to ensure usability, satisfaction, and high product impact.
• Go-to-Market Strategy: Work with sales and marketing to develop and implement go-to-market plans, training programs, and adoption strategies.

Qualifications

• Experience in AI/ML or DataOps: 4+ years in AI/ML product management or a related role with expertise in LLMs, AI evaluation, and agentic workflows.
• Technical Background: Degree in computer science, data science, or related field; proficiency with ML frameworks (e.g., PyTorch, TensorFlow) and LLM tools (e.g., LangChain, Chainlit). Experience with observability and agent-based workflow tools is highly valued.
• Analytical & Problem-Solving Skills: Strong ability to translate customer needs into actionable product requirements and effectively prioritize features in dynamic environments.
• Communication & Leadership: Excellent interpersonal, communication, and presentation skills; adept at conveying complex technical concepts to diverse audiences.
• Hands-On Approach: Self-driven, adaptable, and comfortable with ambiguity; experience in start-up or agile environments with 0-to-1 product experience is a plus.
• Preferred: Proficiency in SQL, Python, or another programming language, as well as experience working with LLM observability and agentic workflow monitoring.

Benefits

• Cutting-Edge Technology: Engage with the latest advancements in AI, working on projects that push the boundaries of what's possible in post-production AI evaluation.
• Exceptional Talent: Collaborate with some of the brightest minds in the field, fostering a culture of innovation and shared success.
• Competitive Compensation: Receive industry-leading remuneration for your contributions to our pioneering projects.