llama-cpp-python

Python bindings for llama.cpp

Local inference

Open llama-cpp-python in AirStack

What llama-cpp-python’s own pages say

What it says it doesPython bindings for llama.cpp github.com
IntegrationsLangChain, LlamaIndex, OpenAI API github.com
LicenseMIT license github.com
SDK languagesPython github.com
Models supportedllava-v1.5-13b, llava-v1.5-7b, llava-v1.6-34b, moondream2, nanollava github.com

Each value is a quote AirStack found on the product’s own pages, read 2026-11-04. A missing field means AirStack has not found it on its pages.

llama-cpp-python alternatives