Autonomous embodied agents require a long decision-making loop involving perception, action, verification, and self-correction. Current systems typically rely on task-specific workflows or trained embodied policies. This paper explores a third approach: agentic embodied control, where a general-purpose agent maintains the loop itself.
The authors propose a minimal-interface zero-shot agent that uses a large language model (LLM) to reason and act in a vision-and-language navigation (VLN) environment. The agent receives only high-level instructions and visual observations, without fine-tuning or task-specific training.
Experiments on standard VLN benchmarks show that this zero-shot agent achieves performance comparable to industrial-scale policies that require extensive training data and compute. The agent demonstrates robust generalization across different environments and instructions.
The key insight is that the agent's ability to self-correct and maintain context over many steps compensates for the lack of specialized training. This suggests that general-purpose agents can be effective for embodied tasks without large-scale resources.
Source: arXiv (2607.26148).