The sim-to-real gap

Simulation provides cheap and safe data but necessarily simplifies contact, sensors, latency and rare failures. A successful policy must therefore tolerate variation and adapt from limited real experience rather than merely perform well inside a digital twin.