OpenPipe

OpenPipe is a fine-tuning and reinforcement-learning platform purpose-built for agent workloads. You keep a frontier model in production, route through OpenPipe's drop-in proxy, capture traces, then fine-tune smaller open-weight models on the resulting dataset. Reinforcement learning via GRPO and PPO supports real multi-step environments, including browsers, code execution and custom evaluators.