The Science of Training: Emergence, Prediction, and Steering (STEPS) — NeurIPS 2026 Workshop The Science of Training: Emergence, Prediction, and Steering (STEPS) — NeurIPS 2026 Workshop

Toward actionable training dynamics — describing trajectories, predicting outcomes, and steering training.

📍 NeurIPS 2026 (venue TBA) 🗓 December 2026

View full proposal (PDF)

About the Workshop

Although modern models are extensively evaluated after training, far less work has focused on characterizing how individual training runs unfold. Aggregate predictions such as scaling laws and architecture-based estimators have produced valuable high-level insights, and recent studies of training dynamics shed light on how patterns emerge — yet these analyses are typically descriptive or post-hoc, and do not capture the dynamics of individual trajectories.

Understanding training at the trajectory level reveals signals that final-accuracy evaluations miss: models can score well on downstream evaluations while becoming overtrained and hard to finetune; training dynamics can predict whether subsequent adaptation will succeed, degrade, or induce forgetting. To bridge understanding and practice, methods should move beyond description toward diagnosing dynamic failures and guiding interventions during training.

Prediction is the critical bridge between insight and action. To act on training, we must anticipate how models will evolve with data, scale, and optimization. This workshop aims to move from descriptive to predictive understanding — and to lay the groundwork for translating that understanding into prescriptive interventions.

Three Escalating Goals

We welcome contributions across all three.

1. Descriptive

Characterizing how training unfolds

  • Representation formation, phase transitions, reorganization, and interaction across training
  • Interpretability across time, scale, gradients, and optimizer dynamics
  • Random variations and initial conditions

2. Predictive

Forecasting from early signals

  • Early monitoring of training failures and criteria for stopping
  • Stress-testing of early checkpoints; misrepresentations that lead to downstream malformation
  • Pretraining evaluations and invariants predicting post-training behavior across scale
  • Generalization prediction: what transfers from which data, when, and why
  • Training outcome prediction, including negative results

3. Prescriptive

Steering and repairing training

  • Training repair: reverting to and correcting from earlier checkpoints
  • Causal and interventional methods for training
  • Phase-specific data selection strategies
  • Controlling model behavior during training

Call for Papers

We invite submissions of original work, position papers, and experience reports that advance trajectory-level understanding of training dynamics. Negative results and replication studies are explicitly welcome. Submission portal and template details will be posted here.

Abstract submission

Aug 22, 2026

Paper submission

Aug 29, 2026

Reviewer bidding & assignment

Aug 30 – Sep 2, 2026

Reviewer deadline

Sep 18, 2026

Notification

Sep 29, 2026

Camera-ready

Oct 20, 2026

Final program due

Oct 27, 2026

Workshop

NeurIPS 2026

Submission portal (link TBA)

Tentative Schedule

A full day of invited talks, contributed orals, two poster sessions, and a combined panel and interactive “debugging training” discussion. Subject to change.

09:00 – 09:10Opening remarks
09:10 – 09:50Invited talk 1
09:50 – 10:30Invited talk 2
10:30 – 11:15Poster session 1
11:15 – 11:55Invited talk 3
11:55 – 12:45Contributed orals
12:45 – 13:30Lunch
13:30 – 14:10Invited talk 4
14:10 – 14:50Contributed orals
14:50 – 15:30Poster session 2
15:30 – 16:00Panel discussion
16:00 – 17:00 Interactive “Debugging Training” session

Debugging Training, live

The closing hour pairs a moderated panel on open challenges with a hands-on “debugging training runs” clinic: participants bring real training problems — instabilities, divergences, scaling pathologies — for the panelists and audience to diagnose together. Turning trajectory-level insight into on-the-spot fixes is exactly the kind of actionable training science this workshop is built around.

17:00 – 17:10Closing remarks
EveningAfter-social for organizers, speakers, program committee, and participants — organized by social chair Glenn Matlin (Georgia Tech)

Invited Speakers and Panelists

The division between talks and the panel is still being finalized; all confirmed speakers and panelists are listed together below.

Andrew Saxe

University College London

Confirmed · remote (in person if Paris)

About

Professor at UCL, developing mathematical and experimental tools to understand how learning emerges in brains and artificial neural networks.

Angelica Chen

Google DeepMind

Confirmed

About

Senior research scientist working on Gemini training at Google DeepMind.

Gautam Reddy

Princeton University

Confirmed

About

Assistant professor at Princeton, developing physics-inspired theory and tools for understanding learning and decision-making in biological and artificial systems.

Shikai Qiu

New York University

Confirmed

About

PhD student at NYU researching the science of scaling neural networks and optimization.

Martin Ziqiao Ma

Thinking Machines Lab

Confirmed

About

Member of technical staff at Thinking Machines Lab, working on continual multimodal learning with minimal and natural supervision.

Naomi Saphra

Kempner Institute, Harvard · incoming faculty, Boston University

Confirmed

About

Research fellow at the Kempner Institute (Harvard) and incoming faculty at Boston University, researching NLP training dynamics and interpretability.

Misha Belkin

UC San Diego

Tentative

About

Professor at UCSD developing theory for modern machine learning and deep learning — high-dimensional learning, interpolation, kernel methods, and double descent.

Most of our speakers and panelists are confirmed; possible additions will be announced as further invitations are finalized.

Organizers

Isabelle Lee

University of Southern California

training, interpretability, reasoning

Full bio

Isabelle Lee is a PhD student at the University of Southern California. Her work focuses on interpretability, training, and reasoning. Specifically, her research aims to (1) predict training and (2) predict failures. To this aim, she uses dynamical systems and physics-inspired approaches to analyze small-scale toy learning problems, as well as analyzing larger-scale training from developmental perspectives. She is a recipient of the Viterbi School of Engineering Graduate Fellowship and Coefficient Giving's Technical AI Safety Research Grant. Previously, she was a researcher at Carnegie Mellon University and Amazon Alexa, and her background is in Plasma Physics and Complex Systems.

Emmy Liu

Carnegie Mellon University, LTI

pretraining, cognitive perspectives

Full bio

Emmy Liu is a PhD Candidate at Carnegie Mellon University in the Language Technologies Institute. Her current work is on understanding pretraining from a cognitive perspective. She is a recipient of a Natural Sciences and Engineering Research Council of Canada Doctoral Scholarship, the SoftBank-ARM fellowship, an NEC fellowship as well as a CMU Presidential Fellowship. Her work has received the Best Resource Paper award at ACL 2023. She has co-organized the workshop on Figurative Language Processing at NAACL 2024, the overall Student Research Workshop at NAACL 2025, as well as the Computational Developmental Linguistics workshop at ACL 2026.

Kaiser Sun

Johns Hopkins University

training dynamics, evaluation, interpretability

Full bio

Kaiser Sun is a Ph.D. student in Computer Science at the Data Science and AI Institute and the Center for Language and Speech Processing at Johns Hopkins University. Their research focuses on the training dynamics, evaluation, and interpretability of Large Language Models. Generally, Kaiser is interested in understanding how language models function and exploring how we can change them. Their work has been recognized with an honorable mention at CoNLL 2023, an outstanding paper award at MLRC 2022, and coverage by a few media outlets such as MIT Technology Review and WIRED. Previously, they obtained their B.S. and M.S. from the University of Washington and were a researcher at Meta AI, Together AI, and AWS AI Labs.

Stella Biderman

Executive Director, EleutherAI

open LLMs, learning dynamics, interpretability, evaluation

Full bio

Stella Biderman is the Executive Director of EleutherAI, a non-profit research institute and open science community that does research on large language models, works to make research on large-scale AI technologies more widely accessible around the world, and works to grow and promote the open source AI community. She pioneered the development of open and transparent language models that make the type of research advocated for in this workshop possible, including the first state-of-the-open LLMs to be released alongside their training data and the Pythia model suite, which introduced the idea that releasing partially trained model checkpoints was scientifically valuable and set the standard for maximally open releases adopted by projects such as LLM360, OLMo, and Marin. Her lab has done influential research on learning dynamics and interpretability, including introducing Sparse Autoencoders as a tool for interpretability, introducing the problem of forecasting which specific sequences are memorized by a large language model during training, performing the first study of the stability of circuit analysis over the course of training, and demonstrating that it is possible to use data filtering to eliminate undesirable capabilities in large language models. Her recent position paper at ICML outlines the need for the type of work solicited in this workshop.

Stella co-leads the EvalEval Coalition, a multi-stakeholder initiative bringing methodological rigor and accountability to AI evaluation, is on the advisory board to the Machine Learning Reproducibility Challenge, is organizing an Open-Weight Pre-training Safety Accelerator as part of the Seoul Alignment Workshop (co-located with ICML), and is an AC for NeurIPS. Previously, she was an organizer of the AI Village @ DEF CON (2018–2021), working group lead for the BigScience Research Workshop (2022), and organizer of Dataset Convening. Stella received her M.S. in Computer Science from Georgia Tech, her S.B. (honors) in Mathematics from the University of Chicago, and her A.B. in Philosophy from the University of Chicago. Her work regularly appears at NeurIPS, ICML, ICLR, and ACL.

David Alvarez-Melis

Harvard University · Kempner Institute · Microsoft Research

data-centric ML, optimal transport

Full bio

David Alvarez-Melis is an Assistant Professor of Computer Science at Harvard University, where he leads the Data-Centric Machine Learning (DCML) Lab. He is also Associate Faculty at the Kempner Institute and a Research Scientist at Microsoft Research. The Harvard DCML Lab develops principled methods for characterizing, transforming, and optimizing datasets, working toward a rigorous science of data for machine learning. He has organized or co-organized several workshops at the intersection of machine learning and applied mathematics, including the Optimal Transport and Machine Learning Workshop at NeurIPS 2023, the Optimal Transport Workshop at the Institut d'Études Scientifiques de Cargèse (2024), and the LatinX in AI Workshop at ICML (2023 and 2024). David received his PhD in Computer Science from MIT, his MS in Mathematics from NYU's Courant Institute, and his BSc in Mathematics from ITAM in Mexico City. His work appears regularly at NeurIPS, ICML, ICLR, AISTATS, and UAI.

Contact: lee.isabelle.g@gmail.com