vLLM

@vllm_project

NVIDIA published a tutorial for deploying Cosmos Reason 2B on Jetson using vLLM — covering AGX Thor, AGX Orin, and Orin Super Nano. FP8 quantized VLM with chain-of-thought reasoning, served via `vllm serve` and connected to a real-time webcam UI for interactive vision analysis. Great to see vLLM powering edge inference on Jetson. 🙏 Thanks to the @NVIDIARobotics Jetson team! 🔗 https://huggingface.co/blog/nvidia/cosmos-on-jetson

huggingface.co

Deploying Open Source Vision Language Models (VLM) on Jetson

A Blog post by NVIDIA on Hugging Face

NVIDIA Robotics

@NVIDIARobotics

· Feb 26

Want to bring open-source vision language models to the edge? 💻 Check out our @huggingface article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖 nvda.ws