Mindket

MAI-UI-8B

Newversion 1 · updated

Overview

Reads a screenshot and an instruction to decide what to tap or type on a phone or computer screen. An 8B model from the MAI-UI family of GUI agents, for developers building device agents.

MAI-UI-8B is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.

At a glance

You need
  • Python
  • vllm 0.11.0 or newer and transformers 4.57.0 or newer
  • Room for about 17.5 GB of BF16 weights
Runs in
  • A vLLM server on your own machine, which exposes an OpenAI style API
  • Python agent code that sends screenshots and instructions to that server
  • The transformers library, which the model is tagged for
  • Windows, macOS or Linux for downloading the files
Start with
pip install -U huggingface_hub
hf download Tongyi-MAI/MAI-UI-8B

Platform

WindowsOperating system
macOSOperating system
LinuxOperating system

About

What it is

MAI-UI-8B is a vision-language model that looks at a screen image and an instruction and works out how to operate the interface. It belongs to the MAI-UI family of GUI agents, which comes in 2B, 8B, 32B and 235B-A22B sizes. This page covers the 8B model.

Who it suits

Developers who build agents that control phones or computers, and researchers who study GUI grounding and navigation, will use it most. It also suits teams that want to host such a model on their own server.

IndustryWho uses itHow they use itExample
SoftwareAgent developersDrive an app interface from screenshots and instructionsFind the right button on a settings screen
MobileMobile app teamsTest navigation flows with a model that reads the screenWalk through an app on a phone
ResearchAI researchersCompare GUI grounding and navigation results across model sizesRun the model against a screen benchmark
Self-hostingPlatform teamsServe the model behind their own APIStart the vLLM server and connect an agent

People who only need a text chatbot can skip it, because its job is operating on-screen interfaces.

Where to use it

  • A vLLM server on your own machine, which exposes an OpenAI style API
  • Python agent code that sends screenshots and instructions to that server
  • The transformers library, which the model is tagged for
  • Windows, macOS or Linux for downloading the files
Use caseWhoWhat they get back
GUI groundingAgent developersA decision about where on the screen to act
Mobile navigationMobile app teamsThe next step to take in a phone app
On-device and cloud routingResearch teamsA way to study when to run locally and when to call a cloud model

How to set it up

  • Python
  • vllm 0.11.0 or newer and transformers 4.57.0 or newer
  • Room for about 17.5 GB of BF16 weights
  1. Install the Hugging Face hub tools with pip, and download the files if you want a local copy first.
  2. Install vLLM.
  3. Start the API server with the model name.
pip install -U huggingface_hub
hf download Tongyi-MAI/MAI-UI-8B
# Install vLLM
pip install vllm

# Start vLLM API server
python -m vllm.entrypoints.openai.api_server \
    --model Tongyi-MAI/MAI-UI-8B \
    --served-model-name MAI-UI-8B \
    --host 0.0.0.0 \
    --port 8000 \
    --tensor-parallel-size 1 \
    --trust-remote-code

How to use it

Once the server runs, your agent code calls it on port 8000 under the /v1 path, using the served name MAI-UI-8B. Each request carries a screenshot and an instruction. The card does not show a request body, so follow the vLLM documentation for the exact call.

ToolWhat it does
--modelPicks the model that vLLM loads
--served-model-nameSets the name clients use in requests
--portSets the port the server listens on, 8000 here
--tensor-parallel-sizeSets how many GPUs share the model, 1 here
--trust-remote-codeLets code stored in the model repository run

Example

An agent sends a screenshot of a phone settings page and the instruction to open a particular option. The model answers in text that tells the agent what to do next on that screen.

For newcomers and experts

A GUI agent is software that looks at a screen and decides where to click or type. For a first try, start the server from the steps above and send it one screenshot with a short instruction.

The authors describe a self-evolving data pipeline that adds user interaction and MCP tool calls to the navigation data. They also describe a device-cloud setup that routes work by task state and data sensitivity, and an online reinforcement learning stage. Scaling its parallel environments from 32 to 512 added 5.2 points, and raising the step budget from 15 to 50 added 4.3.

  1. A screenshot and an instruction go in
  2. The model picks the next interface action
  3. Your agent carries the action out
  4. A new screenshot goes back to the model

Good to know

Scores: The authors report these figures for the MAI-UI family, and the card does not say which size each comes from.

Benchmark results reported by the authors
MMBench GUI L291.3 percent
AndroidWorld76.7 percent
ScreenSpot-Pro73.5 percent
OSWorld-G70.9 percent
UI-Vision49.2 percent
MobileWorld41.7 percent
  • Device and cloud: The authors say their routing raises on-device performance by 33% and cuts cloud API calls by more than 40%.
  • Network: The sample command sets the host to 0.0.0.0, which accepts connections from other machines on the network.
  • License: Apache 2.0.
  • Cost to run: none named. The sample runs on your own vLLM server and names no paid service.
  • Data it reaches: The screenshots and instructions you send to your server. The research setup can route some work to a cloud model.
  • Not for: The source names no forbidden uses. It is built for GUI tasks, not general chat.

README and files

README

MAI-UI-8B

Reads a screenshot and an instruction to decide what to tap or type on a phone or computer screen. An 8B model from the MAI-UI family of GUI agents, for developers building device agents.

Made by Tongyi-MAI on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: MAI-UI-8B is a vision-language model that looks at a screen image and an instruction and works out how to operate the interface. It belongs to the MAI-UI family of GUI agents, which comes in 2B, 8B, 32B and 235B-A22B sizes. This page covers the 8B model.

Who it suits: Developers who build agents that control phones or computers, and researchers who study GUI grounding and navigation, will use it most. It also suits teams that want to host such a model on their own server.

Industry | Who uses it | How they use it | Example
Software | Agent developers | Drive an app interface from screenshots and instructions | Find the right button on a settings screen
Mobile | Mobile app teams | Test navigation flows with a model that reads the screen | Walk through an app on a phone
Research | AI researchers | Compare GUI grounding and navigation results across model sizes | Run the model against a screen benchmark
Self-hosting | Platform teams | Serve the model behind their own API | Start the vLLM server and connect an agent

People who only need a text chatbot can skip it, because its job is operating on-screen interfaces.

Where to use it:

  • A vLLM server on your own machine, which exposes an OpenAI style API
  • Python agent code that sends screenshots and instructions to that server
  • The transformers library, which the model is tagged for
  • Windows, macOS or Linux for downloading the files
Use case | Who | What they get back
GUI grounding | Agent developers | A decision about where on the screen to act
Mobile navigation | Mobile app teams | The next step to take in a phone app
On-device and cloud routing | Research teams | A way to study when to run locally and when to call a cloud model

How to set it up:

  • Python
  • vllm 0.11.0 or newer and transformers 4.57.0 or newer
  • Room for about 17.5 GB of BF16 weights
  1. Install the Hugging Face hub tools with pip, and download the files if you want a local copy first.
  2. Install vLLM.
  3. Start the API server with the model name.
pip install -U huggingface_hub
hf download Tongyi-MAI/MAI-UI-8B
# Install vLLM
pip install vllm

# Start vLLM API server
python -m vllm.entrypoints.openai.api_server \
    --model Tongyi-MAI/MAI-UI-8B \
    --served-model-name MAI-UI-8B \
    --host 0.0.0.0 \
    --port 8000 \
    --tensor-parallel-size 1 \
    --trust-remote-code

How to use it: Once the server runs, your agent code calls it on port 8000 under the /v1 path, using the served name MAI-UI-8B. Each request carries a screenshot and an instruction. The card does not show a request body, so follow the vLLM documentation for the exact call.

Tool | What it does
--model | Picks the model that vLLM loads
--served-model-name | Sets the name clients use in requests
--port | Sets the port the server listens on, 8000 here
--tensor-parallel-size | Sets how many GPUs share the model, 1 here
--trust-remote-code | Lets code stored in the model repository run

Example: An agent sends a screenshot of a phone settings page and the instruction to open a particular option. The model answers in text that tells the agent what to do next on that screen.

For newcomers and experts: A GUI agent is software that looks at a screen and decides where to click or type. For a first try, start the server from the steps above and send it one screenshot with a short instruction.

The authors describe a self-evolving data pipeline that adds user interaction and MCP tool calls to the navigation data. They also describe a device-cloud setup that routes work by task state and data sensitivity, and an online reinforcement learning stage. Scaling its parallel environments from 32 to 512 added 5.2 points, and raising the step budget from 15 to 50 added 4.3.

A screenshot and an instruction go in
The model picks the next interface action
Your agent carries the action out
A new screenshot goes back to the model

Good to know: Scores: The authors report these figures for the MAI-UI family, and the card does not say which size each comes from.

Title: Benchmark results reported by the authors
MMBench GUI L2: 91.3 percent
AndroidWorld: 76.7 percent
ScreenSpot-Pro: 73.5 percent
OSWorld-G: 70.9 percent
UI-Vision: 49.2 percent
MobileWorld: 41.7 percent
  • Device and cloud: The authors say their routing raises on-device performance by 33% and cuts cloud API calls by more than 40%.
  • Network: The sample command sets the host to 0.0.0.0, which accepts connections from other machines on the network.
  • License: Apache 2.0.
  • Cost to run: none named. The sample runs on your own vLLM server and names no paid service.
  • Data it reaches: The screenshots and instructions you send to your server. The research setup can route some work to a cloud model.
  • Not for: The source names no forbidden uses. It is built for GUI tasks, not general chat.

On Hugging Face, 13 November 2026

  • Task: image text to text
  • Library: transformers
  • Parameters: 8.8B
  • Weights: about 17.5 GB in BF16; about 4.4 GB at 4-bit (estimate)
  • Formats: Safetensors
  • Downloads in the last 30 days: 10,445
  • Likes: 206
  • License: apache-2.0
  • Quantized versions: 7
  • Fine-tunes: 1
  • Tags: transformers, safetensors, qwen3_vl, image-text-to-text, conversational

Links

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download Tongyi-MAI/MAI-UI-8B

Then follow the usage in its model card. Nothing in this kit runs by itself.

Files
README.md  6 KB

1 file, 6 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-13

Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

ProductDownloads, last 30 daysLikesParametersLicenseLast change
MAI-UI-8B This page10,4452068.8Bapache-2.0
Qwen3.8-27BShares image-text-to-text · conversational · transformers6,960,39519,79527.8Bapache-2.0
gemma-4-31B-itShares image-text-to-text · conversational · transformers6,692,3674,34831.3Bapache-2.0
GLM-5.3-FlashShares image-text-to-text · conversational · transformers6,397,7743,138321Bmit
Qwen3.5-9BShares image-text-to-text · conversational · transformers6,259,8092,3539.7Bapache-2.0
Qwen2.5-VL-7B-InstructShares image-text-to-text · conversational · transformers5,894,4711,7728.3Bapache-2.0
Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13.

Reviews

No ratings yet

Write a review

No reviews yet.

More from Mindket

See all from Mindket

upscaler

uwg · Kit

Holds a set of image upscaling models gathered from the OpenModelDB community, for people who want to enlarge low-resolution pictures with AI on their own comp…

New

Pixel Art XL

nerijs · Kit

A pixel art style add-on for Stable Diffusion XL that turns text prompts into pixel-style images, with an optional LCM LoRA for faster runs. For game makers, d…

New

VibeVoice-1.5B

microsoft · Kit

Turns written conversations into spoken audio with up to four speakers and about 90 minutes of speech, an open Microsoft text-to-speech model for research on p…

New

Similar in Developer

See all in Developer

voicetut-egyptian-tashkeel

masterofaudio2077 · Kit

Reads Egyptian Arabic text aloud and follows the short vowel marks you write into it. A fine-tune of VoiceTut-TTS that keeps its 19 built-in voices and voice c…

New

Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…

New

Ru-Jev

besktech · Kit

Scores a Russian-first decision from a context and a list of options, giving a probability for yes/no, choice or rating questions. Runs on a plain CPU, for tea…

New