opnsense-ports/misc/py-llama-cpp-python/pkg-descr

llama-cpp-python is the Python bindings for the llama.cpp library/

The main goal of llama.cpp is to enable LLM inference with minimal setup and
state-of-the-art performance on a wide variety of hardware - locally and in
the cloud.