Senior Software Engineer (Eval Efficiency & Optimization)

Join our team as a Senior Software Engineer, where you will tackle complex problems at the intersection of statistics, machine learning, and scalable systems engineering. You will develop quantitative models to address evaluation challenges, enhance the efficiency and scalability of our evaluation infrastructure, and collaborate with various teams to deliver evaluation products. This role offers a competitive compensation package, comprehensive benefits, and a hybrid work model.

• Tackling ill-defined, ambiguous problems and reducing complex systems into tractable quantitative models.
• Developing statistical techniques that enable evaluation pipelines to deliver better signals with fewer resources.
• Designing and building automation to enhance the efficiency and scalability of evaluation infrastructure.

• Fluency in implementing statistical, ML, and general mathematical algorithms for large datasets
• 3-5 years of experience with
• Experience adapting techniques in research papers to applied problems
• Building data processing pipelines
• Strong self-motivation and comfort with ambiguity to navigate complex systems and pursue open-ended problems to completion
• Navigating and modifying a large code base containing a variety of languages, such as C++, Python, and SQL
• Performing statistical analyses
• BS in Math, Physics, or another quantitative field
• Writing, reviewing, and merging code following industry standards for code health and maintainability
• PhD in a quantitative field
• Experience programming in C++ and Python
• Experience developing, evaluating, and deploying products at scale
• Experience with Agentic AI