Preference Model

Preference Model develops machine learning infrastructure software designed to support experimentation in reinforcement learning. They build high-quality RL training environments that reflect real-world complexity, with diverse tasks and robust reward functions, to teach models to perform ML research. The company partners with frontier AI labs to build capabilities for the next generation of LLMs.