llama-cppv9030
- Updated
LLM inference in C/C++
- Project website: https://github.com/ggml-org/llama.cpp
#Supported Platforms
All platforms supported.
#Features
No default features.
#download
Support downloading a model from an URL
Host Dependencies:
2 transitive dependencies:
- vcpkg-cmake (through curl)
- vcpkg-cmake-config (through curl)
#server
Build llama-server and llama-cli
Dependencies:
No dependencies.
Host Dependencies:
No dependencies.
#Used By
- hanjingo-high-jump (feature
llama)
#Host Tool For
No ports use this.
#Contributors
Stefano Sinigardi
Kai Pastor
talregev
Ankur Verma
miyan