More Data Can Make AI Dumber! A Surprising NeurIPS Paper (with Jazmia Henry)TRACK

Sound

More Data Can Make AI Dumber! A Surprising NeurIPS Paper (with Jazmia Henry)

Aunty Camilla
4:06 duration0 plays0 favoritesMedium quality
Business Knowledge
Play now

About this track

Jazmia Henry joins @JonKrohnLearns to break down what it actually takes to build end-to-end foundation models for the energy industry. From wrangling decades of handwritten oil-and-gas documents into usable training data, to bespoke tokenizers, reinforcement learning, and inference at scale, Jazmia walks through every stage of the stack. Along the way she explains why reinforcement learning models are "bursty," what reward hacking is and how her Grounded Continuous Evaluation framework fixes it, and revisits the 2023 NeurIPS paper that argued, to widespread skepticism at the time, that scaling bad data degrades model performance. Additional materials: https://www.superdatascience.com/995

From the album

Super Data Science: ML & AI Podcast with Jon Krohn album coverSuper Data Science: ML & AI Podcast with Jon Krohn25 tracks · Track 22

The latest machine learning, A.I., and data career topics from across both academia and industry are...

→

You may also like

75 cover art
7575Hip-Hop
Аруси cover art
АрусиКурбонали АбдуллоевMusic