Director of AI Evaluations at LawZero

Lead LawZero's evaluation efforts as Director of AI Evaluations, ensuring trustworthy assessments of advanced AI systems. Shape the future of AI safety and integrity.
As a key hire, you will design the evaluation framework at LawZero, fostering independent assessments that meet the highest credibility standards. You will guide a team in developing benchmarks for the Scientist AI, emphasizing safety and capability measurement. Collaborate closely with research and product teams to ensure accurate evaluations that enhance public trust.
Key Responsibilities:
• Define and implement evaluation strategies for AI systems
• Build a team of experts in machine learning evaluation
• Design benchmarks to apply consistently across AI models
• Oversee the development of datasets and evaluation tools
• Publicly communicate evaluation findings for transparency
Requirements:
• MSc or higher in machine learning, computer science
• 10+ years in ML, including leadership in ev...