Edit of asset "LLM Toolkit Lite" Accepted

Old/Current New/Edit
Title LLM Toolkit Lite LLM Toolkit Lite
Description LLM Toolkit Lite lets your game talk to a language model running on the player's machine, through LM Studio, Ollama or llama.cpp. Replies stream in as they're written, and the game never freezes. Pure GDScript, no plugins or binaries.

- Never blocks. Requests poll once per frame, with no threads. A character split across network packets comes out whole.
- Streams. Text arrives piece by piece, ready to type into a speech bubble.
- Fails clearly. Cancel at any time; a server that goes silent times out; errors say what went wrong ("No models loaded", "Is the server running?") and keep the text that had arrived.

It's free to use in any project, commercial ones included. LLM Toolkit, the full version, has the same API and adds OpenAI, Claude and keyed servers, JSON with schemas (repaired, adjusted and validated), conversations, retries and queueing, settings for thinking models, and a mock provider for tests. Upgrading is replacing the addons/llm_toolkit folder: https://debugalot.itch.io/llm-toolkit

Requirements: Godot 4.7 (tested on 4.7.2), and LM Studio, Ollama or llama.cpp with a model loaded. There is no plugin to enable: Llm and LlmProvider are available everywhere.

This download contains only addons/llm_toolkit/. The demo (talk to an innkeeper) and 31 automated tests are in the GitHub repository.

Documentation: https://github.com/debugalot/llm-toolkit-lite
More Godot addons: https://excalibug.com
LLM Toolkit Lite lets your game talk to a language model running on the player's machine, through LM Studio, Ollama or llama.cpp. Replies stream in as they're written, and the game never freezes. Pure GDScript, no plugins or binaries.

- Never blocks. Requests poll once per frame, with no threads. A character split across network packets comes out whole.
- Streams. Text arrives piece by piece, ready to type into a speech bubble.
- Fails clearly. Cancel at any time; a server that goes silent times out; errors say what went wrong ("No models loaded", "Is the server running?") and keep the text that had arrived.

It's free to use in any project, commercial ones included. LLM Toolkit, the full version, has the same API and adds OpenAI, Claude and keyed servers, JSON with schemas (repaired, adjusted and validated), conversations, retries and queueing, settings for thinking models, and a mock provider for tests. Upgrading is replacing the addons/llm_toolkit folder: https://debugalot.itch.io/llm-toolkit

Requirements: Godot 4.7 (tested on 4.7.2), and LM Studio, Ollama or llama.cpp with a model loaded. There is no plugin to enable: Llm and LlmProvider are available everywhere.

This download contains only addons/llm_toolkit/. The demo (talk to an innkeeper) and 31 automated tests are in the GitHub repository.

Documentation: https://github.com/debugalot/llm-toolkit-lite
More Godot addons: https://excalibug.com
Category Scripts Scripts
License Proprietary Proprietary
Repository Provider GitHub GitHub
Repository Url https://github.com/debugalot/llm-toolkit-lite https://github.com/debugalot/llm-toolkit-lite
Issues Url https://github.com/debugalot/llm-toolkit-lite/issues https://github.com/debugalot/llm-toolkit-lite/issues
Godot version Godot 4.7 Godot 4.7
Version String 1.0.0 1.0.0
Download Commit 158650d15e4be13483317732fcffb72606f0f011 158650d15e4be13483317732fcffb72606f0f011
Download Url (Computed) https://github.com/debugalot/llm-toolkit-lite/archive/158650d15e4be13483317732fcffb72606f0f011.zip https://github.com/debugalot/llm-toolkit-lite/archive/158650d15e4be13483317732fcffb72606f0f011.zip
Icon Url https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/icon.png
https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/icon.png
Preview Insert
Type image
Image/Video URL https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_demo.png
Thumbnail https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_demo.png
Preview Insert
Type image
Image/Video URL https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_code.png
Thumbnail https://raw.githubusercontent.com/debugalot/llm-toolkit-lite/main/assetlib/preview_code.png