Edit of asset "LLM Toolkit Lite" Accepted
| Old/Current | New/Edit | |
|---|---|---|
| Title | LLM Toolkit Lite | LLM Toolkit Lite |
| Description |
LLM Toolkit Lite lets your game talk to a language model running on the player's machine, through LM Studio, Ollama or llama.cpp. Replies stream in as they're written, and the game never freezes. Pure GDScript, no plugins or binaries. - Never blocks. Requests poll once per frame, with no threads. A character split across network packets comes out whole. - Streams. Text arrives piece by piece, ready to type into a speech bubble. - Fails clearly. Cancel at any time; a server that goes silent times out; errors say what went wrong ("No models loaded", "Is the server running?") and keep the text that had arrived. It's free to use in any project, commercial ones included. LLM Toolkit, the full version, has the same API and adds OpenAI, Claude and keyed servers, JSON with schemas (repaired, adjusted and validated), conversations, retries and queueing, settings for thinking models, and a mock provider for tests. Upgrading is replacing the addons/llm_toolkit folder: https://debugalot.itch.io/llm-toolkit Requirements: Godot 4.7 (tested on 4.7.2), and LM Studio, Ollama or llama.cpp with a model loaded. There is no plugin to enable: Llm and LlmProvider are available everywhere. This download contains only addons/llm_toolkit/. The demo (talk to an innkeeper) and 31 automated tests are in the GitHub repository. Documentation: https://github.com/debugalot/llm-toolkit-lite More Godot addons: https://excalibug.com |
LLM Toolkit Lite lets your game talk to a language model running on the player's machine, through LM Studio, Ollama or llama.cpp. Replies stream in as they're written, and the game never freezes. Pure GDScript, no plugins or binaries. - Never blocks. Requests poll once per frame, with no threads. A character split across network packets comes out whole. - Streams. Text arrives piece by piece, ready to type into a speech bubble. - Fails clearly. Cancel at any time; a server that goes silent times out; errors say what went wrong ("No models loaded", "Is the server running?") and keep the text that had arrived. It's free to use in any project, commercial ones included. LLM Toolkit, the full version, has the same API and adds OpenAI, Claude and keyed servers, JSON with schemas (repaired, adjusted and validated), conversations, retries and queueing, settings for thinking models, and a mock provider for tests. Upgrading is replacing the addons/llm_toolkit folder: https://debugalot.itch.io/llm-toolkit Requirements: Godot 4.7 (tested on 4.7.2), and LM Studio, Ollama or llama.cpp with a model loaded. There is no plugin to enable: Llm and LlmProvider are available everywhere. This download contains only addons/llm_toolkit/. The demo (talk to an innkeeper) and 31 automated tests are in the GitHub repository. Documentation: https://github.com/debugalot/llm-toolkit-lite More Godot addons: https://excalibug.com |
| Category | Scripts | Scripts |
| License | Proprietary | Proprietary |
| Repository Provider | GitHub | GitHub |
| Repository Url | https://github.com/debugalot/llm-toolkit-lite | https://github.com/debugalot/llm-toolkit-lite |
| Issues Url | https://github.com/debugalot/llm-toolkit-lite/issues | https://github.com/debugalot/llm-toolkit-lite/issues |
| Godot version | Godot 4.7 | Godot 4.7 |
| Version String | 1.0.0 | 1.0.0 |
| Download Commit | 158650d15e4be13483317732fcffb72606f0f011 | 158650d15e4be13483317732fcffb72606f0f011 |
| Download Url (Computed) | https://github.com/debugalot/llm-toolkit-lite/archive/158650d15e4be13483317732fcffb72606f0f011.zip | https://github.com/debugalot/llm-toolkit-lite/archive/158650d15e4be13483317732fcffb72606f0f011.zip |
| Icon Url |
https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/icon.png
|
https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/icon.png
|
| Preview Insert | ||
|---|---|---|
| Type | image | |
| Image/Video URL |
https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_demo.png
|
|
| Thumbnail |
https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_demo.png
|
|
| Preview Insert | ||
|---|---|---|
| Type | image | |
| Image/Video URL |
https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_code.png
|
|
| Thumbnail |
https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_code.png
|
|