How Monte Carlo Simulations Fix AI Evaluation (with Jazmia Henry)TRACK

Sound

How Monte Carlo Simulations Fix AI Evaluation (with Jazmia Henry)

Aunty Camilla
8:46 duration0 plays0 favoritesMedium quality
Business Knowledge
Play now

About this track

Jazmia Henry joins @JonKrohnLearns to break down what it actually takes to build end-to-end foundation models for the energy industry. From wrangling decades of handwritten oil-and-gas documents into usable training data, to bespoke tokenizers, reinforcement learning, and inference at scale, Jazmia walks through every stage of the stack. Along the way she explains why reinforcement learning models are "bursty," what reward hacking is and how her Grounded Continuous Evaluation framework fixes it, and revisits the 2023 NeurIPS paper that argued, to widespread skepticism at the time, that scaling bad data degrades model performance. Additional materials: https://www.superdatascience.com/995

From the album

Super Data Science: ML & AI Podcast with Jon Krohn album coverSuper Data Science: ML & AI Podcast with Jon Krohn25 tracks · Track 21

The latest machine learning, A.I., and data career topics from across both academia and industry are...

→

You may also like