GRACE introduces a gradient-free method for robot action generation by combining diffusion models with Model Predictive Path Integral (MPPI) control. The key innovation is the use of posterior mean estimation from diffusion models to guide MPPI sampling, avoiding the need for differentiable guidance costs.
Traditional diffusion policies rely on differentiable costs to steer action generation toward deployment-time constraints. However, many practical constraints like binary collision checks, joint limits, and black-box rollout costs are nondifferentiable, limiting their applicability.
GRACE addresses this by leveraging the posterior mean of the diffusion model as a prior for MPPI, which then optimizes actions under arbitrary cost functions. This allows the system to handle nondifferentiable constraints effectively.
The method is evaluated on simulated robotic tasks, demonstrating improved constraint satisfaction compared to standard diffusion policies while maintaining high task success rates.
Source: arXiv (2607.21661).