@koustuvsinha
Its a wrap - the first in-person event for #MLRC2025 successfully concluded yesterday - we witnessed some of the best talks I have ever heard on reproducibility issues in AI, ranging from issues regarding leakage and irreproducibility in ML-based science (@random_walker), determinism issues and data access restrictions (@soumithchintala), evaluations and how to make them robust/reproducible (@BlancheMinerva), & real world challenges of deploying LLM agents in production (@jefrankle). The panel discussion among the speakers and @adinamwilliams led by @sayashk painted a picture of the shortcomings in reproducibility and the road ahead. We heard from best +outstanding paper awardees, and the poster session had a lot of footfall! Outstanding support by @PrincetonAInews for hosting the event, and thanks @AIatMeta and @OpenAI for sponsoring it! I hope our efforts further encourage reproducibility research, which in turn strengthen our understanding of ML science! Stay tuned for the release of talk recordings, and looking forward to the next iteration!