Mindket

Alpamayo 2 Edge

Newversion 1 · updated

Overview

Reads multi-camera driving footage, a navigation instruction and motion history, then outputs a driving trajectory with a written reason, and answers questions about the scene. For autonomous vehicle developers and researchers.

Alpamayo 2 Edge is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.

At a glance

You need
  • Python and pip to run the download commands
  • Camera frames with capture timestamps, since the prompt encodes relative times
  • The inference code from the NVIDIA source repository, which the card links as its code
Runs in
  • Windows, macOS or Linux with Python, to download the files
  • NVIDIA DRIVE AGX Thor, the in-vehicle platform the card names for deployment
  • Fine-tuning workflows built on the separate NVIDIA source code repository
Start with
pip install -U huggingface_hub
hf download nvidia/Alpamayo2-Edge

Platform

WindowsOperating system
macOSOperating system
LinuxOperating system

About

What it is

Alpamayo 2 Edge is a vision-language-action model from NVIDIA for autonomous driving research. It reads camera images, a text instruction and the vehicle's recent motion, then returns a planned path and a written explanation of its reasoning.

You can also ask it open questions about what a driving scene shows. It builds on the Cosmos 3 Edge backbone. NVIDIA positions it as a base for fine-tuning, and it can be deployed in cars on the DRIVE AGX Thor platform.

Who it suits

Developers and researchers who work on autonomous vehicle systems and need a compact reasoning model for planning and decision-making.

IndustryWho uses itHow they use itExample
AutomotiveAutonomous driving software teamsFine-tune the model for their vehicle and sensorsAdapt it to a different camera layout
ResearchAutonomous vehicle researchersStudy the written reasons next to each trajectoryCompare reasoning texts across sampled candidates
Embedded systemsTeams deploying in vehiclesRun a compact model on in-vehicle hardwareTarget DRIVE AGX Thor

Skip it if you want a general chatbot or an image tool, since it is built around driving scenes and camera input.

Where to use it

  • Windows, macOS or Linux with Python, to download the files
  • NVIDIA DRIVE AGX Thor, the in-vehicle platform the card names for deployment
  • Fine-tuning workflows built on the separate NVIDIA source code repository
Use caseWhoWhat they get back
Trajectory predictionPlanning engineers64 waypoints from 0.1 through 6.4 seconds, each with a position and rotation
Causal explanationsResearchersWritten reasoning for each trajectory candidate
Scene questionsDevelopersFree-form answers about what the cameras see

How to set it up

  • Python and pip to run the download commands
  • Camera frames with capture timestamps, since the prompt encodes relative times
  • The inference code from the NVIDIA source repository, which the card links as its code
  1. Install the Hugging Face tools.
  2. Download the model files.
  3. Get the inference code from the NVIDIA source repository and follow it.
pip install -U huggingface_hub
hf download nvidia/Alpamayo2-Edge

How to use it

Prepare six camera views over several time steps, a navigation instruction as text and 20 past ego poses at 0.1-second steps. The card says to turn thinking off when applying the chat template, because the template turns it on by default.

enable_thinking=False
ModeWhat it does
Trajectory predictionPredicts a path from six camera views, 22 frames in all, plus the instruction and ego poses
Free-form visual question answeringAnswers open questions from the same six cameras at four frames each

Example

You supply the six camera views, an instruction such as turning at the next junction, and the recent ego poses. The model returns a 64-waypoint path out to 6.4 seconds and a text explanation of why it chose that path.

For newcomers and experts

If you are new to this, think of it as a driving planner that explains itself. Start by downloading the files and reading the NVIDIA code to see how camera frames are prepared.

If you know the field, it is a VLA model with a Cosmos 3 Edge backbone and a diffusion-based action decoder. The action expert predicts acceleration and curvature per step, a unicycle model integrates them, and each trajectory candidate carries its own sampled reasoning.

  1. Six-camera frames and ego pose history
  2. Navigation instruction as text
  3. Backbone writes the driving reasoning
  4. Action expert predicts acceleration and curvature
  5. Unicycle model builds the trajectory

Good to know

  • Weights: about 5.3 GB in BF16, according to Hugging Face
  • NVIDIA frames it as a base to fine-tune and deploy, so treat it as a starting point and not a finished driving product
  • Text output varies in length, and the trajectory output holds XYZ positions and 3x3 rotation matrices
Parameters by part, in billions
Language model1.96 billion
Vision encoder0.41 billion
Projector0.08 billion
Action expert0.2 billion
  • License: OpenMDW-1.1 for the model weights, and Apache License 2.0 for the source code
  • Cost to run: none named, though in-vehicle deployment targets NVIDIA DRIVE AGX Thor hardware
  • Data it reaches: camera images, text instructions and ego motion history you supply
  • Not for: the source lists no exclusions

README and files

README

Alpamayo 2 Edge

Reads multi-camera driving footage, a navigation instruction and motion history, then outputs a driving trajectory with a written reason, and answers questions about the scene. For autonomous vehicle developers and researchers.

Made by nvidia on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: Alpamayo 2 Edge is a vision-language-action model from NVIDIA for autonomous driving research. It reads camera images, a text instruction and the vehicle's recent motion, then returns a planned path and a written explanation of its reasoning.

You can also ask it open questions about what a driving scene shows. It builds on the Cosmos 3 Edge backbone. NVIDIA positions it as a base for fine-tuning, and it can be deployed in cars on the DRIVE AGX Thor platform.

Who it suits: Developers and researchers who work on autonomous vehicle systems and need a compact reasoning model for planning and decision-making.

Industry | Who uses it | How they use it | Example
Automotive | Autonomous driving software teams | Fine-tune the model for their vehicle and sensors | Adapt it to a different camera layout
Research | Autonomous vehicle researchers | Study the written reasons next to each trajectory | Compare reasoning texts across sampled candidates
Embedded systems | Teams deploying in vehicles | Run a compact model on in-vehicle hardware | Target DRIVE AGX Thor

Skip it if you want a general chatbot or an image tool, since it is built around driving scenes and camera input.

Where to use it:

  • Windows, macOS or Linux with Python, to download the files
  • NVIDIA DRIVE AGX Thor, the in-vehicle platform the card names for deployment
  • Fine-tuning workflows built on the separate NVIDIA source code repository
Use case | Who | What they get back
Trajectory prediction | Planning engineers | 64 waypoints from 0.1 through 6.4 seconds, each with a position and rotation
Causal explanations | Researchers | Written reasoning for each trajectory candidate
Scene questions | Developers | Free-form answers about what the cameras see

How to set it up:

  • Python and pip to run the download commands
  • Camera frames with capture timestamps, since the prompt encodes relative times
  • The inference code from the NVIDIA source repository, which the card links as its code
  1. Install the Hugging Face tools.
  2. Download the model files.
  3. Get the inference code from the NVIDIA source repository and follow it.
pip install -U huggingface_hub
hf download nvidia/Alpamayo2-Edge

How to use it: Prepare six camera views over several time steps, a navigation instruction as text and 20 past ego poses at 0.1-second steps. The card says to turn thinking off when applying the chat template, because the template turns it on by default.

enable_thinking=False
Mode | What it does
Trajectory prediction | Predicts a path from six camera views, 22 frames in all, plus the instruction and ego poses
Free-form visual question answering | Answers open questions from the same six cameras at four frames each

Example: You supply the six camera views, an instruction such as turning at the next junction, and the recent ego poses. The model returns a 64-waypoint path out to 6.4 seconds and a text explanation of why it chose that path.

For newcomers and experts: If you are new to this, think of it as a driving planner that explains itself. Start by downloading the files and reading the NVIDIA code to see how camera frames are prepared.

If you know the field, it is a VLA model with a Cosmos 3 Edge backbone and a diffusion-based action decoder. The action expert predicts acceleration and curvature per step, a unicycle model integrates them, and each trajectory candidate carries its own sampled reasoning.

Six-camera frames and ego pose history
Navigation instruction as text
Backbone writes the driving reasoning
Action expert predicts acceleration and curvature
Unicycle model builds the trajectory

Good to know:

  • Weights: about 5.3 GB in BF16, according to Hugging Face
  • NVIDIA frames it as a base to fine-tune and deploy, so treat it as a starting point and not a finished driving product
  • Text output varies in length, and the trajectory output holds XYZ positions and 3x3 rotation matrices
Title: Parameters by part, in billions
Language model: 1.96 billion
Vision encoder: 0.41 billion
Projector: 0.08 billion
Action expert: 0.2 billion
  • License: OpenMDW-1.1 for the model weights, and Apache License 2.0 for the source code
  • Cost to run: none named, though in-vehicle deployment targets NVIDIA DRIVE AGX Thor hardware
  • Data it reaches: camera images, text instructions and ego motion history you supply
  • Not for: the source lists no exclusions

On Hugging Face, 13 November 2026

  • Task: robotics
  • Parameters: 2.7B
  • Weights: about 5.3 GB in BF16; about 1.3 GB at 4-bit (estimate)
  • Formats: Safetensors
  • Downloads in the last 30 days: 921
  • Likes: 41
  • License: openmdw-1.1
  • Languages: en
  • Based on: nvidia/Cosmos3-Edge
  • Fine-tunes: 1
  • Tags: safetensors, alpamayo2_edge, alpamayo, autonomous-driving, vision-language-action, pytorch, robotics

Links

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download nvidia/Alpamayo2-Edge

Then follow the usage in its model card. Nothing in this kit runs by itself.

Files
README.md  6 KB

1 file, 6 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-12

Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

ProductDownloads, last 30 daysLikesParametersLicenseLast change
Alpamayo 2 Edge This page921412.7Bopenmdw-1.1
Jocasta-diff-VLAShares vision-language-action · robotics · pytorch3633—apache-2.0
π₀.₅ (Pi05) (LeRobot)Shares vision-language-action · robotics · safetensors21,9961193.6Bgemma
Microduck PoliciesShares robotics67,16354—apache-2.0
ActionCodec2Shares robotics2173—apache-2.0
all-MiniLM-L6-v2Shares pytorch · safetensors174,740,1846,10422.7Mapache-2.0
Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13.

Reviews

No ratings yet

Write a review

No reviews yet.

What people say

Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.

Searched

More from Mindket

See all from Mindket

anaksor-ocr

Sokheng · Kit

Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…

New

Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…

New

ACE-Step 1.5 XL SFT

ACE-Step · Kit

Generates music from text with a 4B diffusion decoder, 50 steps and guidance control, aiming for higher audio quality than the base. For creators with a GPU of…

New

Similar in Developer

See all in Developer

Claude Code Skills & Plugins

alirezarezvani · Skill

Adds 411 ready-made skills for Claude Code and other coding agents, grouped by role from engineering and product to marketing, finance and compliance. Installs…

New29.8k

buzz

block · Kit

Self-hostable workspace where people and AI agents share the same rooms, built on a Nostr relay that logs every action as a signed event. For teams that want t…

New37.3k

plannotator

backnotprop · Kit

Opens your AI coding agent's plans, specs and code changes in a browser so you can annotate or comment on them and send the feedback straight back to the agent.

New10.5k