go-koboldcpp-discordbot

Super basic, proof-of-concept Go script to make a locally hosted LLM (in this case using https://github.com/LostRuins/koboldcpp) available as a convenient Discord bot (the prompting/context system is very "simple" and relies heavily on the LLM)

required DISCORD_TOKEN, API_URL, PERSONA go in a new .env file:

DISCORD_TOKEN=
API_URL=http://localhost:5001/api
PERSONA=Kobold

go run .

experimental, more like an example, made for personal use