# Preference Model **Source:** https://www.startuphub.ai/startups/preferencemodel-com **Profile type:** Startup > Preference Model is building the next generation of training data to power the future of AI by developing machine learning infrastructure software for reinforcement learning experimentation. ## About Preference Model develops machine learning infrastructure software designed to support experimentation in reinforcement learning. They build high-quality RL training environments that reflect real-world complexity, with diverse tasks and robust reward functions, to teach models to perform ML research. The company partners with frontier AI labs to build capabilities for the next generation of LLMs. ## Key facts - **Slug:** preferencemodel-com - **Website:** https://preferencemodel.com - **Location:** San Francisco, United States - **Founded:** 2025-01-01 - **Employees:** 17 - **Operating status:** Active - **Sectors / tags:** Reinforcement Learning, Reinforcement Learning from Human Feedback, Synthetic Data, Synthetic Data Generation, MLOps, Developer Tools, Foundation Model, Large Language Model, AI Safety, AI Alignment, AI Testing, AI Infrastructure, Generative AI, Artificial Intelligence, Machine Learning, Frontier AI Lab, AGI Research - **Social:** - LinkedIn: https://www.linkedin.com/company/preferencemodel - Twitter: https://x.com/preferencemodel ## Frequently asked ### What does Preference Model do? Preference Model develops machine learning infrastructure software designed to support experimentation in reinforcement learning. They build high-quality RL training environments that reflect real-world complexity, with diverse tasks and robust reward functions, to teach models to perform ML research. The company partners with frontier AI labs to build capabilities for the next generation of LLMs. ### Where is Preference Model headquartered? Preference Model is headquartered in San Francisco, United States. ### When was Preference Model founded? Preference Model was founded in 2025. ### What industry does Preference Model operate in? Preference Model operates in Reinforcement Learning, Reinforcement Learning from Human Feedback, Synthetic Data, Synthetic Data Generation, MLOps, Developer Tools. ### How many employees does Preference Model have? Preference Model has approximately 17 people on record. ## JSON-LD Structured data aligned with this page's `