Pareto
Expert data workforce for RLHF, evals, and tool-use environments
Pareto AI runs a managed expert workforce producing labeled data, RLHF, and evaluation/environment work for AI labs across many domains. It is behind the Leap and Attune benchmark efforts.
Leap and Attune benchmarks
| Website | pareto.ai |
|---|---|
| Domains | Multi-Domain, Tool Use, Data Labeling, RLHF |
| Location | San Francisco |
| Team size | 26-50 |
| Founders | Phoebe Yao |
Similar startups
Also listed under Multi-Domain, Tool Use, Data Labeling, RLHF.
| Name | Domains | Location | Team | Funding | Raising |
|---|---|---|---|---|---|
| Rise Data Labs US-based expert human data and custom RL environments for enterprise AI | Computer Use, Coding, Finance, Cybersecurity, Legal, Data Labeling, Enterprise, Multi-Domain, RLHF, Custom Environments | United States | - | - | Yes |
| AfterQuery Expert human data and RL environments across code, finance, and computer use | Multi-Domain, Coding, Finance | San Francisco, New York, Seattle | 51-100 | $30.5M total (reported) | - |
| Anthromind Medical and long-horizon environments and expert data | Medical, Long Horizon, Data Labeling | San Francisco | 1-10 | - | - |
| Artificial Analysis Independent benchmarking of AI models across intelligence, speed, and price | Multi-Domain, Machine Learning | San Francisco | 11-25 | $2.6M (2024) | - |
| Besimple AI Human-in-the-loop annotation and evals, with a voice data focus | Data Labeling, Voice, RLHF | San Francisco | 1-10 | ~$3.5M total | - |
| Chakra Labs Dojo: a hub of computer-use and tool-use environments | Computer Use, Tool Use | Brooklyn | 11-25 | ~$10.1M (reported) | - |