@PyTorch
Autotuning is the backbone of Helion, PyTorch's DSL for performance portable ML kernels. Currently Helion searches utilize Likelihood-Free Bayesian Optimization (LFBO) to find the most performant configs. While LFBO works well, it requires grinding through hundreds of compile-and-benchmark cycles per kernel. What if, instead of starting the search blindly, you could ask an LLM to reason about the kernel and propose configurations? In this blog, we look at how LLM-guided autotuning is a practical approach to dramatically faster kernel tuning at production quality. Click the link in the comments section to learn more. @JongsokC @oguz_ulgen