The robotics community has largely bet on end-to-end learning: train a single large policy on massive data, and reasoning, planning, and control will emerge. But a new paper from Stanford researchers argues that this approach has a blind spot — the orchestration gap.
In "Addressing the Orchestration Gap in Generalist Robots via Physical Agency," authors Liane Galanti, Dhruv Shah, and Tri Dao propose a clean architectural split. Instead of cramming all capabilities into one learned policy, they build a closed-loop physical agent orchestrator called Pigey that sits on top of existing vision-language-action (VLA) policies or parametrized skills. Pigey handles high-level planning, decomposes goals into subgoals, issues motor commands, tracks outcomes from low-level observations, and recovers from failures — all without any additional data collection or post-training.
The results are striking. On the LIBERO-PRO benchmark, Pigey advances the state-of-the-art by over 4x — from 12.8% to 53.3% — with zero task-specific fine-tuning. On a real robot, it lifts a frozen policy from near-zero to over 90% on tasks that previously failed due to reasoning limitations. The authors define the orchestration gap as the difference between what frozen motor skills achieve alone and what they achieve inside the agentic loop.
For startup founders building generalist robots, this paper offers a clear architectural signal. The current race to scale data and compute for end-to-end policies may be necessary but not sufficient. The orchestration layer — a lightweight, reusable module that adds reasoning and recovery — could be a high-leverage investment. It means you can decouple the expensive, data-hungry motor skill training from the higher-level cognitive loop, potentially reducing the data requirements for each component.
The Pigey approach is also practical for deployment. Because it requires no post-training or additional data, it can be layered on top of existing policies, including those from third parties or open-source models. This modularity aligns with the trend toward composable robot stacks, where startups can specialize in either the motor skill layer or the orchestration layer.
However, the paper does not address how Pigey itself is built or trained. The orchestrator is presumably hand-designed or learned from limited data, which raises questions about scalability to truly open-ended tasks. The authors also test on relatively structured manipulation benchmarks; it remains to be seen how the approach handles highly dynamic or unstructured environments.
For operators, the takeaway is clear: before investing in another round of data collection or model scaling, audit your system for the orchestration gap. A simple agentic loop around your existing policy might yield disproportionate gains. The paper suggests that the bottleneck for many real-world robot tasks is not motor skill fidelity but the ability to reason, plan, and recover — a gap that can be addressed with a relatively thin orchestration layer.
Source: arXiv.