Nanosaur2-670M
well9472 · Kit
Makes illustrations from text prompts with a small 670M-parameter diffusion model, run through ComfyUI. Built as a low-budget research model for people who wan…
Encodes video clips and single images into feature vectors, trained by self-supervised learning on about 5,300 video hours. A video encoder for researchers, under a non-commercial license.
LeVJEPA 1.5 Large is a kit in the Research category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download galilai-group/LeVJEPA-1.5-Large
LeVJEPA 1.5 Large is a video encoder trained without labels. It turns a short clip, or one image, into feature vectors that other models can build on. Its mean score over 22 image and video datasets is 78.76%. Training used roughly 5,300 distinct hours of video and 151 exaflops.
It suits researchers who study video representation learning and want an encoder trained on far less data than earlier ones. The license is non-commercial.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Research | Representation learning researchers | Probe the frozen encoder on image and video datasets | Reproduce the card's attentive probing results |
| Software | Computer vision developers | Extract clip features for a downstream classifier | Feed clip features into a small classifier |
| Medical imaging | Teams studying medical image sets | Test the encoder on sets such as the MNIST-style medical ones | Check scores on BloodMNIST or DermaMNIST |
If you need a model for a commercial product, you can skip it.
| Use case | Who | What they get back |
|---|---|---|
| Clip features | Researchers | A 1024-number summary vector per clip |
| Per-frame patch features | Vision developers | Patch tokens for each of the 16 frames |
| Image features | Developers | A vector for a single image, repeated along the time axis |
pip install -U huggingface_hub hf download galilai-group/LeVJEPA-1.5-Large
Pass a tensor shaped batch, channels, time, height, width. The card samples clips at about 7.5 frames per second, so 16 frames cover about 2 s. The result starts with the [cls] token, then lists the patch tokens for each frame in turn.
import torch
from transformers import AutoModel
model = AutoModel.from_pretrained("galilai-group/LeVJEPA-1.5-Large", trust_remote_code=True).eval()
video = torch.randn(1, 3, 16, 224, 224) # (B, C, T, H, W), ImageNet-normalized
with torch.no_grad():
out = model(pixel_values=video)
out.last_hidden_state # (1, 3137, 1024): [cls] + 16 * 14 * 14 patch tokens, in (frame, row, column) order
out["pooler_output"] # (1, 1024): the [cls] token| Tool | What it does |
|---|---|
| last_hidden_state | Holds the [cls] token and the patch tokens of every frame |
| pooler_output | Gives the [cls] token alone as a 1024-number vector |
| trust_remote_code | Must be on, because the modeling code ships with the weights |
| attn_mode | Leave it at block_causal, since full attention returns worse features |
You pass one clip of 16 frames at 224 by 224, about 2 s of video. The model returns a 1024-number vector for the whole clip and one patch token per image region per frame. For a single image, you repeat it 16 times along the time axis first.
If you are new, this model does not label a video for you. It turns a clip into numbers that describe it, and other tools use those numbers. The first small thing to try is the sample code with random numbers in place of a real clip.
If you know the field, a single encoder learns by matching wide and narrow views of the same clip, with SIGReg as a regularizer. There is no moving-average teacher, no stop-gradient step, no predictor and no decoder back to pixels. The architecture is a ViT-L/16 with 24 layers. The trade-off is video accuracy: the 7-dataset video mean is 68.94, against 72.79 for V-JEPA 1 and 74.61 for V-JEPA 2.
Encodes video clips and single images into feature vectors, trained by self-supervised learning on about 5,300 video hours. A video encoder for researchers, under a non-commercial license.
Made by galilai-group on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: LeVJEPA 1.5 Large is a video encoder trained without labels. It turns a short clip, or one image, into feature vectors that other models can build on. Its mean score over 22 image and video datasets is 78.76%. Training used roughly 5,300 distinct hours of video and 151 exaflops.
Who it suits: It suits researchers who study video representation learning and want an encoder trained on far less data than earlier ones. The license is non-commercial.
Title: Who runs it
Industry | Who uses it | How they use it | Example
Research | Representation learning researchers | Probe the frozen encoder on image and video datasets | Reproduce the card's attentive probing results
Software | Computer vision developers | Extract clip features for a downstream classifier | Feed clip features into a small classifier
Medical imaging | Teams studying medical image sets | Test the encoder on sets such as the MNIST-style medical ones | Check scores on BloodMNIST or DermaMNIST
If you need a model for a commercial product, you can skip it.
Where to use it:
Title: Jobs it does
Use case | Who | What they get back
Clip features | Researchers | A 1024-number summary vector per clip
Per-frame patch features | Vision developers | Patch tokens for each of the 16 frames
Image features | Developers | A vector for a single image, repeated along the time axis
How to set it up:
pip install -U huggingface_hub
hf download galilai-group/LeVJEPA-1.5-Large
How to use it: Pass a tensor shaped batch, channels, time, height, width. The card samples clips at about 7.5 frames per second, so 16 frames cover about 2 s. The result starts with the [cls] token, then lists the patch tokens for each frame in turn.
import torch
from transformers import AutoModel
model = AutoModel.from_pretrained("galilai-group/LeVJEPA-1.5-Large", trust_remote_code=True).eval()
video = torch.randn(1, 3, 16, 224, 224) # (B, C, T, H, W), ImageNet-normalized
with torch.no_grad():
out = model(pixel_values=video)
out.last_hidden_state # (1, 3137, 1024): [cls] + 16 * 14 * 14 patch tokens, in (frame, row, column) order
out["pooler_output"] # (1, 1024): the [cls] token
Title: What to know about the call
Tool | What it does
last_hidden_state | Holds the [cls] token and the patch tokens of every frame
pooler_output | Gives the [cls] token alone as a 1024-number vector
trust_remote_code | Must be on, because the modeling code ships with the weights
attn_mode | Leave it at block_causal, since full attention returns worse features
Example: You pass one clip of 16 frames at 224 by 224, about 2 s of video. The model returns a 1024-number vector for the whole clip and one patch token per image region per frame. For a single image, you repeat it 16 times along the time axis first.
For newcomers and experts: If you are new, this model does not label a video for you. It turns a clip into numbers that describe it, and other tools use those numbers. The first small thing to try is the sample code with random numbers in place of a real clip.
If you know the field, a single encoder learns by matching wide and narrow views of the same clip, with SIGReg as a regularizer. There is no moving-average teacher, no stop-gradient step, no predictor and no decoder back to pixels. The architecture is a ViT-L/16 with 24 layers. The trade-off is video accuracy: the 7-dataset video mean is 68.94, against 72.79 for V-JEPA 1 and 74.61 for V-JEPA 2.
Sample 16 frames at 224 by 224
Normalize with ImageNet statistics
Run the encoder in block-causal mode
Read the cls token and patch tokens
Good to know:
Title: Mean score across 22 datasets
LeVJEPA 1.5 Large: 78.76%
V-JEPA 1: 79.77%
V-JEPA 2: 81.63%
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download galilai-group/LeVJEPA-1.5-Large
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| LeVJEPA 1.5 Large This page | 269 | 18 | 303M | cc-by-nc-4.0 | |
| VideoJev-4BShares video · feature-extraction · transformers | 8,518 | 31 | 4.5B | apache-2.0 | |
| MOSS-VL-RealtimeShares video · feature-extraction · transformers | 1,934 | 117 | 11.3B | apache-2.0 | |
| IMUDINOShares self-supervised-learning · feature-extraction | 0 | 3 | — | gpl-3.0 | |
| H-JEPAShares jepa | 0 | 25 | — | mit | |
| MERT-v2-FullSongShares feature-extraction · transformers · safetensors | 13,790 | 57 | 632M | cc-by-nc-4.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
well9472 · Kit
Makes illustrations from text prompts with a small 670M-parameter diffusion model, run through ComfyUI. Built as a low-budget research model for people who wan…
Waqf-AI · Kit
Reads handwritten Arabic text from images and returns it as text. A fine-tuned PaddleOCR-VL model for people digitizing Arabic handwriting.
Wan-AI · Kit
Makes video clips from a text prompt or an image plus text, at up to 720P and 24 frames per second, in the Diffusers format for a single consumer GPU.
udiboy1209 · Kit
Recovers math equations from compiled binary code with a small neural decompiler, and ships the datasets and trained models from its paper. For reverse enginee…
udgamlabs · Kit
Turns a text prompt, or a prompt plus a first frame, into a 2-second 256×256 video clip with a 212M-parameter generator. A small research release that does bes…
Tsuboyama-Lab · Kit
Predicts how much of a protein sequence E. coli will make as a single-unit monomer, in log10 mg/L. Trained LoRA adapters and regression heads for ESMC-6B and S…