Prediction

Assuming a world that mostly changes smoothly, continuous video streams entail implicit supervision that can be effectively exploited for learning visual representations.

An agent’s continuous visual observations include information about how the world responds to its actions. This can provide an effective source of self-supervision for learning visual representations.