Meta's CoTracker3: Simpler, Better Point Tracking by Pseudo-Labeling Real Videos

Last year Meta introduced CoTracker — a transformer-based model that jointly tracks points in a video. After the initial release of CoTracker, the model's GitHub page received 4k stars, which was a signal that point tracking is useful not only for visual effects but also for robotics, video generation, as well as bio and medical domains.

In this talk, our guest, Nikita Karaev, will explain how CoTracker works and share key learnings and research insights from working on CoTracker and CoTracker3 that was introduced a few months ago.

Join the BuzzRobot Slack to connect with the community