TRACKSound
How Monte Carlo Simulations Fix AI Evaluation (with Jazmia Henry)
About this track
Jazmia Henry joins @JonKrohnLearns to break down what it actually takes to build end-to-end foundation models for the energy industry. From wrangling decades of handwritten oil-and-gas documents into usable training data, to bespoke tokenizers, reinforcement learning, and inference at scale, Jazmia walks through every stage of the stack. Along the way she explains why reinforcement learning models are "bursty," what reward hacking is and how her Grounded Continuous Evaluation framework fixes it, and revisits the 2023 NeurIPS paper that argued, to widespread skepticism at the time, that scaling bad data degrades model performance. Additional materials: https://www.superdatascience.com/995
From the album
Super Data Science: ML & AI Podcast with Jon Krohn25 tracks · Track 21The latest machine learning, A.I., and data career topics from across both academia and industry are...
→










