opnsense-ports/misc/koboldcpp/pkg-descr
Franco Fichtner fa89bd5e52 */*: sync with upstream
Taken from: FreeBSD
2024-08-12 10:12:12 +02:00

8 lines
537 B
Text

KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF
models, inspired by the original KoboldAI. It's a single self-contained
distributable from Concedo, that builds off llama.cpp, and adds a versatile
KoboldAI API endpoint, additional format support, Stable Diffusion image
generation, speech-to-text, backward compatibility, as well as a fancy UI with
persistent stories, editing tools, save formats, memory, world info, author's
note, characters, scenarios and everything KoboldAI and KoboldAI Lite have to
offer.