https://tylerzhu.com/blog/tags/vlm/ Recent content in Vlm on Tyler Zhu Hugo -- 0.154.3 en-us Sun, 17 Dec 2023 00:00:00 -0800 https://tylerzhu.com/blog/2023/12/remarks-on-spatial-localization-in-vlms/ Sun, 17 Dec 2023 00:00:00 -0800 https://tylerzhu.com/blog/2023/12/remarks-on-spatial-localization-in-vlms/ <h2 id="prelude">Prelude</h2> <p>This all started when I oversaw this tweet from Timothee Darcet (co-first author on DINOv2)</p> <p><img alt="Tweet from Timothee Darcet" loading="lazy" src="https://tylerzhu.com/blog/images/spatial-localization/Screenshot_2023-12-16_at_12.51.07_AM.png"></p> <p><a href="https://x.com/TimDarcet/status/1726320282028360131?s=20">https://x.com/TimDarcet/status/1726320282028360131?s=20</a></p> <p>This was in response to people overreacting to how the <em>final</em> problem in computer vision was for AI to tell the difference between a blueberry muffin and a chihuahua, which, to be fair, is a rather funny joke. It turns out that AI models can do this quite well though, and have been able to already even since CLIP came out! So what&rsquo;s the big deal?</p>