Beyond Bigger Models: Recursion As The Next Scaling Law In AITRACK

Sound

Beyond Bigger Models: Recursion As The Next Scaling Law In AI

37:53 duration0 plays0 favoritesMedium quality
Common
Play now

About this track

A 7-million parameter model outperforming models a thousand times its size on tasks like ARC Prize. That's what recursive reasoning unlocks.In this episode of Decoded, YC's Ankit Gupta and Francois Chaubard break down two recent papers on recursive AI models, HRMs and TRMs, that are achieving state-of-the-art results with a fraction of the parameters of today's largest models.They explain why standard LLMs hit a fundamental ceiling on certain reasoning tasks, how recursion at inference time gives small models the compute depth to break through it, and what happens when you combine these ideas with the power of large-scale foundation models.

From the album

Y Combinator Startup Podcast album coverY Combinator Startup Podcast25 tracks · Track 1

We help founders make something people want. The Y Combinator Podcast is where builders talk about b...

→

More By Y Combinator...

You may also like

Decay cover art
DecayPretty Corpse ClubMusic