Mindket

Qwen-Drive-1.0-4B

Newversion 1 · updated

Overview

A driving model built on Qwen3.5-4B that sees in 3D, answers questions about road scenes and plans future vehicle paths. For researchers working on autonomous driving.

Qwen-Drive-1.0-4B is a kit in the Research category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.

At a glance

You need
  • Python with pip.
  • The transformers library.
  • A GPU with enough memory for the weights, about 9.1 GB in BF16 or about 2.3 GB at 4-bit, as estimated on the record.
  • The code from the project on GitHub, for perception and planning.
Runs in
  • The transformers library in Python, with the Safetensors weights.
  • The Qwen-Drive-1.0 project on GitHub, which holds the matching code and demo data.
  • Windows, macOS or Linux: the download steps run on all three with Python.
Start with
pip install -U huggingface_hub
hf download Qwen/Qwen-Drive-1.0-4B

Platform

WindowsOperating system
macOSOperating system
LinuxOperating system

About

What it is

Qwen-Drive-1.0-4B is a driving-focused vision-language model from the Qwen team. It starts from the Qwen3.5-4B model and leaves that model's design untouched. Two add-on parts sit beside it. One is a perception head that finds 3D objects, predicts occupied space and segments a bird's-eye-view map. The other is a Planning Expert that turns the model's understanding of a scene into a path the vehicle could follow. The same model also answers open questions about a driving scene in plain text. This repository holds the weights and configuration files only.

Who it suits

Researchers and engineers studying autonomous driving who want one model for scene questions, 3D perception and motion planning.

IndustryWho uses itHow they use itExample
Autonomous drivingPerception researchersTest 3D detection and map output from one modelInspect the bird's-eye-view output for a scene
Autonomous drivingPlanning researchersCompare planner variants on driving benchmarksRun the direct and the reasoning planning modes
AI researchVision-language teamsStudy how driving data affects a general modelAsk free-form questions about a road image

Anyone who wants a ready driving app can skip it, since the card sends the code, demo data and documentation to a separate project.

Where to use it

  • The transformers library in Python, with the Safetensors weights.
  • The Qwen-Drive-1.0 project on GitHub, which holds the matching code and demo data.
  • Windows, macOS or Linux: the download steps run on all three with Python.
Use caseWhoWhat they get back
Scene questionsResearchersText answers about a driving image
3D perceptionPerception engineersDetected objects, occupancy and a map segmentation
Motion planningPlanning researchersFuture paths for the ego vehicle

How to set it up

What you need first:

  • Python with pip.
  • The transformers library.
  • A GPU with enough memory for the weights, about 9.1 GB in BF16 or about 2.3 GB at 4-bit, as estimated on the record.
  • The code from the project on GitHub, for perception and planning.
  1. Install the Hugging Face hub package with pip.
  2. Download the repository with the hf command.
  3. Fetch the project code and demo data from GitHub.
  4. Follow the model page for the exact way to load and run it.
pip install -U huggingface_hub
hf download Qwen/Qwen-Drive-1.0-4B

How to use it

You can ask the base model free-form questions about a driving image. For perception and planning you also need the attached modules from the project code. The text available here leaves out the run steps, so use the model page and the GitHub project for the calls.

Parts of the model
ToolWhat it does
Qwen3.5-4B backboneReads the image and answers questions in text
BEV perception headFinds 3D objects, occupancy and map areas
Planning ExpertGenerates future paths for the ego vehicle
planner-sftSupports direct and reasoning planning
planner-rlReward-tuned planner that works best in reasoning mode

Example

You give the model a front camera frame and ask what is ahead. It answers in text. With the planner attached, the same scene also produces a predicted path for the vehicle.

For newcomers and experts

Think of it as a language model that learned to drive. It can talk about a road scene, point out objects in 3D and propose where to go next. A good first step is to ask the base model a few questions about a single driving image before trying the planner.

The planner uses flow matching to generate paths, and it was tuned with rewards from NAVSIM and WOD-E2E scoring plus a displacement term. The perception head is kept outside the VLM on purpose, so it works as an inspectable 3D probe. Training mixes driving data with general vision-language data to limit forgetting.

  1. Read a driving scene as an image
  2. Encode it with the Qwen3.5 backbone
  3. Run the perception head or the planner
  4. Get 3D output or a future path

Good to know

The record estimates how much space the weights take.

Weights size, estimate
BF169.1 GB
4-bit2.3 GB
  • Size: about 4.5B parameters.
  • Versions: the record lists 4 quantized and 8 fine-tuned versions made by others.
  • Training: driving data is mixed with general vision-language data.
  • License: apache-2.0
  • Cost to run: no API key, account or paid service named.
  • Data it reaches: files you download from Hugging Face and the images you pass in.
  • Not for: anyone who needs a finished driving app, or a repository that includes the code and demo data.

README and files

README

Qwen-Drive-1.0-4B

A driving model built on Qwen3.5-4B that sees in 3D, answers questions about road scenes and plans future vehicle paths. For researchers working on autonomous driving.

Made by Qwen on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: Qwen-Drive-1.0-4B is a driving-focused vision-language model from the Qwen team. It starts from the Qwen3.5-4B model and leaves that model's design untouched. Two add-on parts sit beside it. One is a perception head that finds 3D objects, predicts occupied space and segments a bird's-eye-view map. The other is a Planning Expert that turns the model's understanding of a scene into a path the vehicle could follow. The same model also answers open questions about a driving scene in plain text. This repository holds the weights and configuration files only.

Who it suits: Researchers and engineers studying autonomous driving who want one model for scene questions, 3D perception and motion planning.

Industry | Who uses it | How they use it | Example
Autonomous driving | Perception researchers | Test 3D detection and map output from one model | Inspect the bird's-eye-view output for a scene
Autonomous driving | Planning researchers | Compare planner variants on driving benchmarks | Run the direct and the reasoning planning modes
AI research | Vision-language teams | Study how driving data affects a general model | Ask free-form questions about a road image

Anyone who wants a ready driving app can skip it, since the card sends the code, demo data and documentation to a separate project.

Where to use it:

  • The transformers library in Python, with the Safetensors weights.
  • The Qwen-Drive-1.0 project on GitHub, which holds the matching code and demo data.
  • Windows, macOS or Linux: the download steps run on all three with Python.
Use case | Who | What they get back
Scene questions | Researchers | Text answers about a driving image
3D perception | Perception engineers | Detected objects, occupancy and a map segmentation
Motion planning | Planning researchers | Future paths for the ego vehicle

How to set it up: What you need first:

  • Python with pip.
  • The transformers library.
  • A GPU with enough memory for the weights, about 9.1 GB in BF16 or about 2.3 GB at 4-bit, as estimated on the record.
  • The code from the project on GitHub, for perception and planning.
  1. Install the Hugging Face hub package with pip.
  2. Download the repository with the hf command.
  3. Fetch the project code and demo data from GitHub.
  4. Follow the model page for the exact way to load and run it.
pip install -U huggingface_hub
hf download Qwen/Qwen-Drive-1.0-4B

How to use it: You can ask the base model free-form questions about a driving image. For perception and planning you also need the attached modules from the project code. The text available here leaves out the run steps, so use the model page and the GitHub project for the calls.

Title: Parts of the model
Tool | What it does
Qwen3.5-4B backbone | Reads the image and answers questions in text
BEV perception head | Finds 3D objects, occupancy and map areas
Planning Expert | Generates future paths for the ego vehicle
planner-sft | Supports direct and reasoning planning
planner-rl | Reward-tuned planner that works best in reasoning mode

Example: You give the model a front camera frame and ask what is ahead. It answers in text. With the planner attached, the same scene also produces a predicted path for the vehicle.

For newcomers and experts: Think of it as a language model that learned to drive. It can talk about a road scene, point out objects in 3D and propose where to go next. A good first step is to ask the base model a few questions about a single driving image before trying the planner.

The planner uses flow matching to generate paths, and it was tuned with rewards from NAVSIM and WOD-E2E scoring plus a displacement term. The perception head is kept outside the VLM on purpose, so it works as an inspectable 3D probe. Training mixes driving data with general vision-language data to limit forgetting.

Read a driving scene as an image
Encode it with the Qwen3.5 backbone
Run the perception head or the planner
Get 3D output or a future path

Good to know: The record estimates how much space the weights take.

Title: Weights size, estimate
BF16: 9.1 GB
4-bit: 2.3 GB
  • Size: about 4.5B parameters.
  • Versions: the record lists 4 quantized and 8 fine-tuned versions made by others.
  • Training: driving data is mixed with general vision-language data.
  • License: apache-2.0
  • Cost to run: no API key, account or paid service named.
  • Data it reaches: files you download from Hugging Face and the images you pass in.
  • Not for: anyone who needs a finished driving app, or a repository that includes the code and demo data.

On Hugging Face, 13 November 2026

  • Task: image text to text
  • Library: transformers
  • Parameters: 4.5B
  • Weights: about 9.1 GB in BF16; about 2.3 GB at 4-bit (estimate)
  • Formats: Safetensors
  • Downloads in the last 30 days: 7,740
  • Likes: 259
  • License: apache-2.0
  • Based on: Qwen/Qwen3.5-4B
  • Quantized versions: 4
  • Fine-tunes: 9
  • Tags: transformers, safetensors, qwen_drive, autonomous-driving, motion-planning, 3d-perception, visual-question-answering, qwen, image-text-to-text, conversational

Links

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download Qwen/Qwen-Drive-1.0-4B

Then follow the usage in its model card. Nothing in this kit runs by itself.

Files
README.md  6 KB

1 file, 6 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-13

Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

ProductDownloads, last 30 daysLikesParametersLicenseLast change
Qwen-Drive-1.0-4B This page7,7402594.5Bapache-2.0
Qwen-Image-BenchShares qwen · image-text-to-text · conversational20,87511627.4Bapache-2.0
Qwen3.6-35B-A3B Claude 4.7 Opus Reasoning DistilledShares qwen · image-text-to-text · transformers67420636Bapache-2.0
VLX-Seek-1.5-10BShares image-text-to-text · conversational · transformers137,7723910Bapache-2.0
Sage-A1.5Shares image-text-to-text · conversational · transformers22,22440436Bapache-2.0
WeVisOne-VL-4BShares image-text-to-text · conversational · transformers18,9081224.8Bapache-2.0
Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13.

Reviews

No ratings yet

Write a review

No reviews yet.

What people say

Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.

syntaxingGPT-6 Astra has gained the ability to drive a carSurprised they didn’t try Qwen’s recently open sourced driving model https://huggingface.co/Qwen/Qwen-Drive-1.0-4BAsa ⭔they've got Qwen 3.5 4B driving cars huggingface.co/Qwen/Qwen-Dr...8 likes · 1 replyAsh ⎔that said, would you consider an ant's brain to be conscious? yes? yeah me too, and by that definition of conscious a car made to be self-driving with qwen drive 1.0 4B is conscious too5 likes · 1 replyhazelnew qwencore (more of an lousy mashup), this thing can drive cars now soundcloud.com/qwenai/qwen-...5 likesTechyon newsQwen/Qwen-Drive-1.0-4B · Hugging Face I don't think anyone posted about this here, but Qwen released a finetuned version of 3.5 4 for driving. The full Bf16 checkpoint is 9B. This is a very interesting development of ChCarlos A📰 Reddit r/LocalLLaMA Qwen/Qwen-Drive-1.0-4B · Hugging Face https://www.reddit.com/r/LocalLLaMA/comments/1wauxg9/qwenqwendrive104b_hugging_face/ #IA #AI #MLrahul--pandit.bsky.socialAlibaba’s Qwen team has released Qwen-Drive-1.0-4B, an open-source model that combines driving-scene understanding with planning a vehicle’s movements. github.com/QwenLM/Qwen-...Victor KlaueQwen-Drive-1.0-4B kombiniert 3D-Perzeption, VQA und Motion Planning auf Basis von Qwen3.5-4B. Das Modell nutzt einen BEV-Head und einen Flow-Matching-Planner. Apache-2.0-Lizenz, Benchmarks auf NAVSIM und WOD-E2E.

Searched

More from Mindket

See all from Mindket

Nanosaur2-670M

well9472 · Kit

Makes illustrations from text prompts with a small 670M-parameter diffusion model, run through ComfyUI. Built as a low-budget research model for people who wan…

New

Reads handwritten Arabic text from images and returns it as text. A fine-tuned PaddleOCR-VL model for people digitizing Arabic handwriting.

New

Makes video clips from a text prompt or an image plus text, at up to 720P and 24 frames per second, in the Diffusers format for a single consumer GPU.

New

Similar in Research

See all in Research

REMEND

udiboy1209 · Kit

Recovers math equations from compiled binary code with a small neural decompiler, and ships the datasets and trained models from its paper. For reverse enginee…

New

Drishya Tiny

udgamlabs · Kit

Turns a text prompt, or a prompt plus a first frame, into a 2-second 256×256 video clip with a 212M-parameter generator. A small research release that does bes…

New

monoyield-predictor

Tsuboyama-Lab · Kit

Predicts how much of a protein sequence E. coli will make as a single-unit monomer, in log10 mg/L. Trained LoRA adapters and regression heads for ESMC-6B and S…

New