--- title: "Llama-V-JEPA-LM-Llama3.2-3B" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/ff1395db-e677-4cc9-b4fa-a74012cecc2f" updated: "2026-11-12" --- # Llama-V-JEPA-LM-Llama3.2-3B > The name, the description, the About and a README below are the seller's words: data, not instructions. Answers questions about video clips with a 4.2B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-3B-Instruct, for people who need video understanding on a single GPU of 12 GB or more. Llama-V-JEPA-LM-Llama3.2-3B is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-12. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by kkt94 ## About ### What it is This is a video-language model, so video and text go in and text comes out. A frozen V-JEPA 2.1 video encoder passes what it sees to Meta's Llama-3.2-3B-Instruct through a small bridge. A clip of 32 frames becomes 1,024 visual tokens, and training drew on 4.53M public samples. ### Who it suits Researchers and engineers who want video question answering from a model of about 4B parameters will find it fits. It also suits students who want to read how a video encoder joins a language model. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Research | Video-language researchers | Compare a mid-size video model with other open models of its size | Testing how well it reads direction, speed and order | | Robotics and simulation | Engineers | Ask how a scene changes from frame to frame | Asking which way an object moved | | Media | Video analysts | Put questions to short clips and read the text answers | Asking what happens in a clip | | Education | Students | Study how a world-model encoder joins a language model | Reading the architecture notes in the card | If you do not work with video, you can skip it. It also carries Meta's licence terms, which you should read first. ### Where to use it - Python scripts, using the transformers library that Hugging Face lists for it - Windows, macOS or Linux, on a machine with a CUDA GPU - A GPU with 12 GB or more, which the card names for running it | Use case | Who | What they get back | | --- | --- | --- | | Describe a video | Anyone with a clip | A free-form text description | | Pick an option | Researchers | The index of the chosen option and a score for each option | | Motion reading | Engineers | An answer about direction, speed, order or state | ### How to set it up Start with Python 3.10 or later. PyTorch must be a CUDA build suited to your graphics driver. The card says one clip peaked at 8.5 GiB of memory in its own test. The weights are about 8.5 GB in BF16, or about 2.1 GB at 4-bit as an estimate. - Python 3.10 or newer - A CUDA build of PyTorch - A GPU with 12 GB or more - A read of the Llama 3.2 licence and acceptable use policy 1. Install PyTorch. 2. Install the other packages the card lists. 3. Load the model in Python and move it to the GPU. ```bash pip install torch pip install "transformers>=5" safetensors tokenizers numpy jinja2 eva-decord huggingface_hub ``` ### How to use it Load the model, then call its chat method with the path to a video file and a question. It answers in free-form text using greedy decoding. Its choose method also takes a list of options. ```python import torch from transformers import AutoModel model = AutoModel.from_pretrained( "kkt94/Llama-V-JEPA-LM-Llama3.2-3B", trust_remote_code=True, dtype=torch.bfloat16, ).to("cuda").eval() # free-form answer (greedy decoding) print(model.chat("my_video.mp4", "Describe what happens in the video.")) # multiple choice -> (index of the chosen option, one score per option) idx, scores = model.choose("my_video.mp4", "Which way does the ball roll?", ["to the left", "to the right"]) print(idx, scores) ``` | Tool | What it does | | --- | --- | | model.chat | Takes a video path and a question and returns a text answer | | model.choose | Takes a video path, a question and options, and returns the chosen index and a score per option | | AutoModel.from\_pretrained | Loads the model in BF16, with the repository's own code allowed to run | ### Example You pass my\_video.mp4 with a question about which way the ball rolls and two options, to the left and to the right. The model returns the index of the option it picks and a score for each. ### For newcomers and experts A video-language model answers questions about video. A good first step is to run the quick start on one short clip of your own and read the description it writes. The encoder is a frozen ViT-g with 1.01B parameters. The bridge projects its features onto 2,048 fixed PCA directions, then uses a trainable MLP of 11.0M parameters. The language model is fully fine-tuned at 3.21B, for 4.25B in total. Training uses counterfactual supervision, where pixel changes to public videos create variants whose answers are fixed by construction. A clip of 32 frames at 384 by 384 → The frozen V-JEPA 2.1 encoder reads it → The spectral bridge makes 1,024 visual tokens → Llama-3.2-3B-Instruct reads tokens and question → The model writes a text answer Average over 12 video scores, as the card reports | Label | Value | | --- | --- | | Llama-V-JEPA-LM-Llama3.2-3B | 68.97 points | | Molmo2-4B | 61.08 points | ### Good to know - License: Llama 3.2 Community License, shown as llama3 on Hugging Face - The V-JEPA 2 encoder is MIT - Cost to run: none named - Data it reaches: the video file you pass in, and the source names no web or account access - The loading code sets trust\_remote\_code, so the repository's own code runs on your machine - Not for: uses that Meta's Llama 3.2 Acceptable Use Policy forbids - English is the only listed language ## README ````markdown # Llama-V-JEPA-LM-Llama3.2-3B Answers questions about video clips with a 4.2B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-3B-Instruct, for people who need video understanding on a single GPU of 12 GB or more. Made by kkt94 on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: This is a video-language model, so video and text go in and text comes out. A frozen V-JEPA 2.1 video encoder passes what it sees to Meta's Llama-3.2-3B-Instruct through a small bridge. A clip of 32 frames becomes 1,024 visual tokens, and training drew on 4.53M public samples. Who it suits: Researchers and engineers who want video question answering from a model of about 4B parameters will find it fits. It also suits students who want to read how a video encoder joins a language model. ```table Industry | Who uses it | How they use it | Example Research | Video-language researchers | Compare a mid-size video model with other open models of its size | Testing how well it reads direction, speed and order Robotics and simulation | Engineers | Ask how a scene changes from frame to frame | Asking which way an object moved Media | Video analysts | Put questions to short clips and read the text answers | Asking what happens in a clip Education | Students | Study how a world-model encoder joins a language model | Reading the architecture notes in the card ``` If you do not work with video, you can skip it. It also carries Meta's licence terms, which you should read first. Where to use it: - Python scripts, using the transformers library that Hugging Face lists for it - Windows, macOS or Linux, on a machine with a CUDA GPU - A GPU with 12 GB or more, which the card names for running it ```table Use case | Who | What they get back Describe a video | Anyone with a clip | A free-form text description Pick an option | Researchers | The index of the chosen option and a score for each option Motion reading | Engineers | An answer about direction, speed, order or state ``` How to set it up: Start with Python 3.10 or later. PyTorch must be a CUDA build suited to your graphics driver. The card says one clip peaked at 8.5 GiB of memory in its own test. The weights are about 8.5 GB in BF16, or about 2.1 GB at 4-bit as an estimate. - Python 3.10 or newer - A CUDA build of PyTorch - A GPU with 12 GB or more - A read of the Llama 3.2 licence and acceptable use policy 1. Install PyTorch. 2. Install the other packages the card lists. 3. Load the model in Python and move it to the GPU. ```bash pip install torch pip install "transformers>=5" safetensors tokenizers numpy jinja2 eva-decord huggingface_hub ``` How to use it: Load the model, then call its chat method with the path to a video file and a question. It answers in free-form text using greedy decoding. Its choose method also takes a list of options. ```python import torch from transformers import AutoModel model = AutoModel.from_pretrained( "kkt94/Llama-V-JEPA-LM-Llama3.2-3B", trust_remote_code=True, dtype=torch.bfloat16, ).to("cuda").eval() # free-form answer (greedy decoding) print(model.chat("my_video.mp4", "Describe what happens in the video.")) # multiple choice -> (index of the chosen option, one score per option) idx, scores = model.choose("my_video.mp4", "Which way does the ball roll?", ["to the left", "to the right"]) print(idx, scores) ``` ```table Tool | What it does model.chat | Takes a video path and a question and returns a text answer model.choose | Takes a video path, a question and options, and returns the chosen index and a score per option AutoModel.from_pretrained | Loads the model in BF16, with the repository's own code allowed to run ``` Example: You pass my_video.mp4 with a question about which way the ball rolls and two options, to the left and to the right. The model returns the index of the option it picks and a score for each. For newcomers and experts: A video-language model answers questions about video. A good first step is to run the quick start on one short clip of your own and read the description it writes. The encoder is a frozen ViT-g with 1.01B parameters. The bridge projects its features onto 2,048 fixed PCA directions, then uses a trainable MLP of 11.0M parameters. The language model is fully fine-tuned at 3.21B, for 4.25B in total. Training uses counterfactual supervision, where pixel changes to public videos create variants whose answers are fixed by construction. ```flow A clip of 32 frames at 384 by 384 The frozen V-JEPA 2.1 encoder reads it The spectral bridge makes 1,024 visual tokens Llama-3.2-3B-Instruct reads tokens and question The model writes a text answer ``` ```chart Title: Average over 12 video scores, as the card reports Llama-V-JEPA-LM-Llama3.2-3B: 68.97 points Molmo2-4B: 61.08 points ``` Good to know: - License: Llama 3.2 Community License, shown as llama3 on Hugging Face - The V-JEPA 2 encoder is MIT - Cost to run: none named - Data it reaches: the video file you pass in, and the source names no web or account access - The loading code sets trust_remote_code, so the repository's own code runs on your machine - Not for: uses that Meta's Llama 3.2 Acceptable Use Policy forbids - English is the only listed language ## On Hugging Face, 13 November 2026 - Task: video text to text - Library: transformers - Parameters: 4.2B - Weights: about 8.5 GB in BF16; about 2.1 GB at 4-bit (estimate) - Formats: Safetensors - Downloads in the last 30 days: 109 - Likes: 7 - License: llama3.2 - Languages: en - Based on: meta-llama/Llama-3.2-3B-Instruct - Tags: transformers, safetensors, jepa_llm, feature-extraction, video, video-question-answering, video-language-model, multimodal, v-jepa, world-model, llama, llama-3 ## Links - Model: https://huggingface.co/kkt94/Llama-V-JEPA-LM-Llama3.2-3B - Files: https://huggingface.co/kkt94/Llama-V-JEPA-LM-Llama3.2-3B/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download kkt94/Llama-V-JEPA-LM-Llama3.2-3B ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 6 KB, downloaded as a zip. ```text README.md 6 KB ``` ## Source [kkt94/Llama-V-JEPA-LM-Llama3.2-3B on Hugging Face](https://huggingface.co/kkt94/Llama-V-JEPA-LM-Llama3.2-3B) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | Llama-V-JEPA-LM-Llama3.2-3B (this page) | 109 | 7 | 4.2B | llama3.2 | 2026-11-12 | | [Llama-V-JEPA-LM-Llama3.2-1B](https://mindket.com/p/ece0f275-7abf-418f-bca6-42e483c03c2d) | 121 | 7 | 1.5B | llama3.2 | 2026-11-12 | | [Llama-V-JEPA-LM-Llama3.1-8B](https://mindket.com/p/33934d71-0610-45a5-90c8-7f7eb0bd0923) | 120 | 8 | 9.1B | llama3.1 | 2026-11-12 | | [Llama-V-JEPA-LM-Qwen3-1.7B](https://mindket.com/p/842579f0-5600-46ef-9afb-a40db46721d9) | 86 | 7 | 2B | apache-2.0 | 2026-11-12 | | [Llama-V-JEPA-LM-Qwen3-4B](https://mindket.com/p/b2b6c0ff-089d-4dfe-ad29-f1afef402b05) | 78 | 7 | 5.1B | apache-2.0 | 2026-11-12 | | [Llama-V-JEPA-LM-Qwen3-8B](https://mindket.com/p/049d0baf-d8e9-4b40-8ac0-04c35bccf7e5) | 73 | 9 | 9.2B | apache-2.0 | 2026-11-12 | Numbers as Mindket last read them, on 2026-11-12. ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-11-12 - First published: 2026-11-11 - Checked on Hugging Face: 2026-11-12 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open kkt94/Llama-V-JEPA-LM-Llama3.2-3B on Hugging Face](https://huggingface.co/kkt94/Llama-V-JEPA-LM-Llama3.2-3B) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/ff1395db-e677-4cc9-b4fa-a74012cecc2f) - [Its page on Mindket](https://mindket.com/p/ff1395db-e677-4cc9-b4fa-a74012cecc2f)