Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…

LangGenius’s open-source platform for building LLM apps: visual workflows, RAG, model management and agents with a sandbox. Its difyctl tool and skill let Claude Code, Codex, Cursor and other agents build and run the apps.
Dify is an open-source project on GitHub in the Developer category, listed by Mindket. It is free. This is version 2, last updated on . Install it from GitHub as its README says. Get Mindket’s setup notes on your Mindket account, as a zip.
git clone --branch "$(curl -s https://api.github.com/repos/langgenius/dify/releases/latest | jq -r .tag_name)" https://github.com/langgenius/dify.git cd dify/docker cp .env.example .env
And 2 more in Where to use it
Dify is an open-source platform for building LLM apps, made by LangGenius. On one visual canvas you join model calls, knowledge retrieval, code and branching into a Workflow or a Chatflow. The same workspace holds model management, RAG pipelines, agents that work in a sandbox of their own, and logs for watching an app in production. Every app comes with an API. This listing is Mindket’s setup notes. They cover running Dify yourself and letting a coding agent build and run your apps through Dify’s command-line tool.
Developers and small teams who want to build agent and RAG apps on a visual canvas instead of wiring each piece by hand. So do teams that need to host the platform on their own servers, since the docs say Dify runs anywhere Docker runs.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Customer support | Support leads and developers | Build a chat assistant that looks things up and answers | A support lead builds an Agent that looks things up and answers, then publishes it as a web app. |
| Reports and data work | Analysts and developers | Run a Workflow from start to finish, by hand or on a schedule | An analyst builds a Workflow for report generation and adds a schedule Trigger to run it. |
| Research | Researchers and writers | Give an Agent the job of gathering sources and summarizing them | A researcher chats with an Agent that gathers sources and writes the summary. |
| Developer tooling | Developers who use coding agents | Let the agent build and run apps through difyctl, or call an app as an MCP tool | A developer publishes an app as an MCP server, and Cursor lists it as a tool. |
Skip it if you plan to run it as a shared service for several customers. The license bars a multi-tenant setup unless LangGenius authorizes it in writing.
Dify is a web app, so you build in a browser, on LangGenius’s hosted Cloud or on a server you run. Coding agents reach your apps through a command-line tool called difyctl.
Get it saves a zip of Mindket’s setup notes in your downloads folder, with each route’s steps from LangGenius’s README and docs. The main self-hosted route is Docker Compose.
| Need | Detail |
|---|---|
| A machine | At least 2 CPU cores and 4 GiB of RAM |
| Docker | Docker with a running daemon, and Docker Compose v2.35.0 or later |
| macOS | 10.14 or later, Docker Desktop with its VM set to at least 2 virtual CPUs and 8 GiB of memory |
| Windows | Docker Desktop with WSL 2 enabled, with the code and data in the Linux file system |
| OpenSSL | Makes the token for the agent sandbox |
| git, curl and jq | The docs page’s clone line uses all three |
| A model provider | At least one, set up in the console. On a self-hosted server you add its API key |
git clone --branch "$(curl -s https://api.github.com/repos/langgenius/dify/releases/latest | jq -r .tag_name)" https://github.com/langgenius/dify.git cd dify/docker cp .env.example .env openssl rand -hex 32
docker compose up -d docker compose ps --all
The one-time init_permissions service exits with code 0. That is expected. To let a coding agent work with your apps, install difyctl and sign in, then give your agent the skill. A self-hosted server must run Dify 1.18.0 or later, with OPENAPI_ENABLED and ENABLE_OAUTH_BEARER both set to true. The installer below is for macOS and Linux, on x64 and arm64. It checks the download’s checksum and installs to ~/.local/bin/difyctl.
curl -fsSL https://raw.githubusercontent.com/langgenius/dify/main/cli/scripts/install-cli.sh | sh difyctl login --server https://dify.example.com difyctl install skills ~/.claude/skills
On Windows, x64 only, the installer is a PowerShell line.
irm https://raw.githubusercontent.com/langgenius/dify/main/cli/scripts/install.ps1 | iex
For Codex, Cursor, Gemini CLI, GitHub Copilot, OpenCode and most other agents, the skill goes in ~/.agents/skills. For any other agent, look up its skills folder in its documentation.
difyctl install skills ~/.agents/skills
In the console you build a Workflow, a Chatflow or an Agent. A Workflow and a Chatflow share one canvas where you connect nodes that each do a step, such as calling a model, retrieving knowledge, running code or branching on a condition.
| App | How it runs | Starts with | Ends with |
|---|---|---|---|
| Workflow | Once, start to finish: an input goes through the flow and a result comes back | User Input or a Trigger | An Output node, which is optional |
| Chatflow | Users chat, and each message runs the flow before a reply is made | User Input | An Answer node, which is required |
An Agent works another way. You set it up once and use it two ways: on its own as a chat app, or as a step inside a workflow. It works in a sandbox of its own, where it runs commands and reads and writes files. The Agent is in beta, and it is on by default on Docker Compose.
From a terminal, list your apps, or describe a job to help and it names the matching commands. Only apps with Service API access turned on are listed.
difyctl get console_app difyctl help publish app
You self-host Dify on your laptop and want Claude Code to see your apps. You sign in against your server. Pass the address you open Dify at in your browser. For a local server on http://, add --insecure. It applies to every later command until you sign in again without it, so keep it to local development. The server needs OPENAPI_ENABLED and ENABLE_OAUTH_BEARER set to true first.
difyctl login --server https://dify.example.com difyctl get console_app
The terminal prints a code. On the Authorize difyctl page, you enter the code and click Continue within 15 minutes, then check the account and the workspace and click Authorize. The list that follows holds the apps whose Service API access is on. Once the skill is installed, you can ask the agent to build, run or update them.
If you are new. A model provider is the company or server whose AI model your app calls. Every Dify app needs at least one model provider. On a self-hosted server you add the provider’s key, which bills your account with that provider. On Dify Cloud, the docs say you can use your AI credits or connect your own provider accounts and keys. Most of the canvas work is drag, connect and configure, with code only where your logic needs it. If you would rather not run Docker, Dify Cloud skips the install.
For experts. COMPOSE_PROFILES picks the bundled database, vector store and WebSocket API. The default is weaviate,postgresql,collaboration. DB_TYPE or VECTOR_STORE with a matching profile swaps them, and a new database does not migrate existing data.
| What | Where it goes |
|---|---|
| COMPOSE_PROFILES, published ports, volume paths | Root .env, because service env files cannot change them |
| A service setting, such as nginx’s upload limit | A copy of its .defaults file in envs/, usually saved as .env |
| PLUGIN_DAEMON_KEY and PLUGIN_DIFY_INNER_API_KEY | Root .env, one shared value for every service |
Root .env beats a service .env, which beats the tracked defaults. Run docker compose up -d after an edit, because docker compose restart does not reload environment variables. Editing the plugin keys only in a service file can cause HTTP 401 responses. Behind Cloudflare or another proxy, everyone can share one rate limit until nginx is told which proxy to trust. From source, the API needs uv and runs on port 5001, and the web service needs Node.js 24.22.1 or later and PNPM 12.
On a self-hosted install, these paths reach outside your server.
This kit holds setup notes only. Mindket wrote them. Dify itself, its Docker images and its command-line tool come from LangGenius's own repository: https://github.com/langgenius/dify
These notes are not made or endorsed by LangGenius. Its README calls Dify "an open-source LLM app development platform". The documentation starts at https://docs.dify.ai
The notes come from the README and the documentation pages named in each file. They were not checked against the source code, and Mindket did not run the commands.
Dify uses its own license, the Dify Open Source License. GitHub lists it as "Other", with no SPDX identifier. The LICENSE file (https://github.com/langgenius/dify/blob/HEAD/LICENSE) says Dify "is licensed under a modified version of the Apache License 2.0, with the following additional conditions".
web/ directory or the "web" image.These notes do not interpret the license. If you plan to run Dify for other customers or ship a modified version, read the file and ask LangGenius.
Dify is a web platform with a server behind it. The README and docs give these ways to run or reach it:
The Compose route needs the source code first, so clone it. The Docker Compose docs page gives this line, which finds the latest release tag through the GitHub API. It needs git, curl and jq.
git clone --branch "$(curl -s https://api.github.com/repos/langgenius/dify/releases/latest | jq -r .tag_name)" https://github.com/langgenius/dify.git
Then the README runs these from the repository root:
cd docker
cp .env.example .env
openssl rand -hex 32
Open .env and set DIFY_AGENT_LOCAL_SANDBOX_AUTH_TOKEN to the generated value. Keep the default COMPOSE_PROFILES value. Then, from the same docker directory:
docker compose up -d
docker compose ps --all
Open http://localhost/install to finish the first setup. The one-time init_permissions service is expected to exit with code 0.
Sources: https://github.com/langgenius/dify/blob/HEAD/README.md and https://docs.dify.ai/en/self-host/deploy/quick-start/docker-compose
Each file names the page its steps and commands came from. Where the README and a docs page disagree, the file says so.
The Compose docs page says upgrade steps vary between releases, so read the upgrade guide for your target version on the Releases page. After an upgrade, compare each .env.example with its matching .env for new or changed variables. The FAQ page says to back up before upgrading, and gives this line to copy the dify folder:
cp -r dify "dify.bak.$(date +%Y%m%d%H%M%S)"
Sources: https://docs.dify.ai/en/self-host/deploy/quick-start/docker-compose and https://docs.dify.ai/en/self-host/deploy/quick-start/faqs
The pages used here give no uninstall steps.
The model providers page warns that an API key gives workspace-wide model access and bills the provider account behind it. Source: https://docs.dify.ai/en/self-host/use-dify/workspace/model-providers
The environments page lists these connections for a self-hosted Dify. Source: https://docs.dify.ai/en/self-host/deploy/configuration/environments
CHECK_UPDATE_URL defaults to https://updates.dify.ai. The console checks it for newer versions, and an empty value turns the check off.MARKETPLACE_ENABLED defaults to true and MARKETPLACE_API_URL to https://marketplace.dify.ai. Plugins come from there, and FORCE_VERIFYING_SIGNATURE defaults to true, so unsigned plugin packages are refused.NEXT_TELEMETRY_DISABLED defaults to 0. The page says the Compose stack leaves Next.js's anonymous telemetry on unless you set it to 1.WEAVIATE_DISABLE_TELEMETRY defaults to false, so Weaviate's telemetry is on unless you set it to true.ENABLE_CHECK_UPGRADABLE_PLUGIN_TASK defaults to true: the marketplace is checked for newer plugin versions every 15 minutes.API_SENTRY_DSN disables Sentry for the backend. OpenTelemetry stays off until ENABLE_OTEL is true.README.md 8 KB setup/claude-code.md 3 KB setup/cloud-and-other-deployments.md 4 KB setup/codex-cursor-and-other-agents.md 2 KB setup/difyctl.md 11 KB setup/docker-compose.md 11 KB setup/local-source-code.md 6 KB setup/mcp-server.md 2 KB setup/models-and-first-app.md 6 KB
Updated by Mindket to the current version of this kit.
Listed GitHub projects in the same category that share the most topics with this one.
| Product | Stars | Activity | Language | License | Last change |
|---|---|---|---|---|---|
| Dify This page | 160,579 | — | — | — | — |
| SimShares agentic-workflow · low-code · automation | 30,071 | — | — | Apache-2.0 | — |
| RufloShares agentic-framework · agentic-workflow · agentic-ai | 81,187 | — | — | MIT | — |
| OpenHands Agent CanvasShares gpt · agent · llm | 92,839 | — | — | MIT | — |
| Agent Development Kit (ADK) for GoShares genai · llm · ai | 8,945 | Active | Go | Apache-2.0 | |
| CopilotKitShares agent · agentic-ai · ai | 38,557 | Active | TypeScript | MIT |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
simstudioai · Kit
Sim Studio’s workspace for building, deploying and managing AI agents and workflows, with an Apache 2.0 core. Use Sim Cloud, self-host with Docker or run the M…
ruvnet · Kit
ruvnet’s free, MIT-licensed layer that adds agent swarms, shared memory, a console and an MCP server to Claude Code and Codex. It was called Claude Flow. The s…
NousResearch · Kit
Nous Research’s open source agent that you run in a terminal, in a desktop app or from a chat app. It keeps memory, writes skills from experience, runs schedul…