@PyTorch
NVIDIA highlights vLLM as one of the open source frameworks available for serving Step 3.7 Flash, StepFun's 198B-parameter multimodal Mixture-of-Experts model. NVIDIA's developer blog covers deployment, inference, and fine-tuning workflows for the model, which supports image and video inputs and a 256K context window. Read more: https://t.co/A6VftfrYyK