@alvarobartt
Latest `hf-mem` now breaks down Mixture-of-Experts (MoE) memory estimations into base weights, routed experts, and KV cache. Useful for reasoning about residency footprint and serving trade-offs before picking a parallelism strategy for inference. More in the thread ๐งต https://t.co/PWhqvVvmIZ