Godot LLM 0.3 Tools 4.2 Community
Submitted by user Adriankhl; MIT; 2024-05-11
This plugin adds GdLlama, GDEmbedding, and GDLlava node which provides functionalities to generate text using large language model (LLM).
Feature:
* Simple text generation
* Enforce the format of text generation output by Json schema
* Instruct and interactive mode
* Sentence Embedding
* Multimodal: generate text from image or game screen
Currently only support Windows, Linux and Android
v0.2.2 -> v0.3 breaking change
* Rename GDLlama "generate_text" method to "generate_text_simple", you may also just call "generate_text(prompt, "", "") to achieve the same output
* Switch from cpu build to vulkan build because of an upstream bug that prevents embedding from working
View files Download Submit an issue Recent Edits