anaksor-ocr
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…
Generates motion for skeletons of any shape, from animals to humanoids to rigged objects, from a text description. Suits animation researchers and technical artists, under a non-commercial license.
UniMate is a kit in the Research category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download Linzhan/UniMate
UniMate turns a text prompt into motion for a skeleton of any shape, whether an animal, a humanoid or a rigged object. It is built on flow matching. This repo holds its pretrained checkpoints. The paper behind it is titled One Unified Model to Animate Diverse Skeletons.
Animation researchers and technical artists who want to turn a written motion description into movement for a rigged character or creature.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Animation | Technical artists | Generate motion for a rigged character from text | Make a quadruped trot forward |
| Games | Prototype teams | Test movement ideas on varied skeletons | Animate an eagle or a shark asset |
| Research | Motion researchers | Study one model across many skeleton types | Compare checkpoints on the same prompt |
If you need to use it commercially, you can skip it, since the license is non-commercial.
| Use case | Who | What they get back |
|---|---|---|
| Text to motion | Animators | 60 frames at 30 fps of joint motion |
| Animate a mesh | Technical artists | One GLB or FBX per motion |
| Mixamo or Truebones rigs | Researchers | Dedicated checkpoints for those skeleton sets |
pip install -U huggingface_hub hf download Linzhan/UniMate
From the code repository's root, download one model, generate motion for an example asset with a text prompt, then drive the asset's mesh with the motions.
hf download Linzhan/UniMate --repo-type model --local-dir outputs \
--include "unimate_uniml3d_f60_v3/*.json" --include "unimate_uniml3d_f60_v3/*.npy" \
--include "unimate_uniml3d_f60_v3/checkpoints/checkpoint_step_150000.pt"python -m unimate.inference.sample --exp_dir outputs/unimate_uniml3d_f60_v3 --asset assets/examples/unitree_go2 \
--prompt "An object trots forward." "An object rears up on its hind legs." --num_repetitions 3 \
--output_dir outputs/samples/custombash scripts/run_animate_motion.sh outputs/samples/custom
| Tool | What it does |
|---|---|
| unimate.inference.sample | Generates motion from text for an asset |
| scripts/run_animate_motion.sh | Drives each asset's mesh with its motions |
| data_process.rig_preprocess | Labels the joints of your own rigged file |
You run the sample command on the example quadruped asset with the prompts that it trots forward and that it rears up. You get three repetitions of each, and the last script turns each motion into a mesh file.
If you are new, run the three commands on the shipped example asset first. Then try your own rig through the preprocessing step, which stops so you can check the joint labels.
The recommended model is a transformer denoiser with graph attention and text conditioning through AdaLN, trained with flow matching on skeletons of 5 to 70 joints. Text comes from a frozen flan-t5-base encoder, downloaded on first use. Output is position, rotation relative to the T-pose and velocity for each joint.
Generates motion for skeletons of any shape, from animals to humanoids to rigged objects, from a text description. Suits animation researchers and technical artists, under a non-commercial license.
Made by Linzhan on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: UniMate turns a text prompt into motion for a skeleton of any shape, whether an animal, a humanoid or a rigged object. It is built on flow matching. This repo holds its pretrained checkpoints. The paper behind it is titled One Unified Model to Animate Diverse Skeletons.
Who it suits: Animation researchers and technical artists who want to turn a written motion description into movement for a rigged character or creature.
Industry | Who uses it | How they use it | Example
Animation | Technical artists | Generate motion for a rigged character from text | Make a quadruped trot forward
Games | Prototype teams | Test movement ideas on varied skeletons | Animate an eagle or a shark asset
Research | Motion researchers | Study one model across many skeleton types | Compare checkpoints on the same prompt
If you need to use it commercially, you can skip it, since the license is non-commercial.
Where to use it:
Use case | Who | What they get back
Text to motion | Animators | 60 frames at 30 fps of joint motion
Animate a mesh | Technical artists | One GLB or FBX per motion
Mixamo or Truebones rigs | Researchers | Dedicated checkpoints for those skeleton sets
How to set it up:
pip install -U huggingface_hub
hf download Linzhan/UniMate
How to use it: From the code repository's root, download one model, generate motion for an example asset with a text prompt, then drive the asset's mesh with the motions.
hf download Linzhan/UniMate --repo-type model --local-dir outputs \
--include "unimate_uniml3d_f60_v3/*.json" --include "unimate_uniml3d_f60_v3/*.npy" \
--include "unimate_uniml3d_f60_v3/checkpoints/checkpoint_step_150000.pt"
python -m unimate.inference.sample --exp_dir outputs/unimate_uniml3d_f60_v3 --asset assets/examples/unitree_go2 \
--prompt "An object trots forward." "An object rears up on its hind legs." --num_repetitions 3 \
--output_dir outputs/samples/custom
bash scripts/run_animate_motion.sh outputs/samples/custom
Tool | What it does
unimate.inference.sample | Generates motion from text for an asset
scripts/run_animate_motion.sh | Drives each asset's mesh with its motions
data_process.rig_preprocess | Labels the joints of your own rigged file
Example: You run the sample command on the example quadruped asset with the prompts that it trots forward and that it rears up. You get three repetitions of each, and the last script turns each motion into a mesh file.
For newcomers and experts: If you are new, run the three commands on the shipped example asset first. Then try your own rig through the preprocessing step, which stops so you can check the joint labels.
The recommended model is a transformer denoiser with graph attention and text conditioning through AdaLN, trained with flow matching on skeletons of 5 to 70 joints. Text comes from a frozen flan-t5-base encoder, downloaded on first use. Output is position, rotation relative to the T-pose and velocity for each joint.
A text prompt and a skeleton go in
flan-t5-base encodes the text
The denoiser runs flow matching
60 frames of joint motion come out
A script drives the mesh
Good to know:
Title: Denoiser parameters in millions
unimate_uniml3d_f60_v3: 74.1 million
unimate_uniml3d_f60_v3_cross_attn: 66.2 million
unimate_mixamo_f60_v2: 47.8 million
unimate_truebones_f60_v2: 47.8 million
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download Linzhan/UniMate
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| UniMate This page | 533 | 97 | — | cc-by-nc-4.0 | |
| Cola DLMShares flow-matching · pytorch | 93 | 51 | — | apache-2.0 | |
| RFD4-ProteinaShares flow-matching | 14,235 | 45 | 436M | bsd-3-clause | |
| RFD4-Proteina-DiffusersShares flow-matching | 403 | 5 | 178M | bsd-3-clause | |
| NLLB-200 3.3BShares pytorch | 293,185 | 493 | — | cc-by-nc-4.0 | |
| Hy-NomasShares pytorch | 90,896 | 153 | — | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
ACE-Step · Kit
Generates music from text with a 4B diffusion decoder, 50 steps and guidance control, aiming for higher audio quality than the base. For creators with a GPU of…
AbdomenAtlas · Kit
Detects and outlines tumors in 9 organs on CT scans, trained with the R-Super method that learns from radiology reports. A research model for medical imaging g…
dBenf · Kit
Answers typed questions about satellite image patches from all 12 Sentinel-2 bands, returning a probability for each option without writing text. A Qwen3.5-0.8…
zimmerk4 · Kit
Plays the full game Getting Over It from the bottom to the end with a small trained policy network that learned inside a JAX physics simulator. For reinforceme…