LLM inference in C/C++
Swift library to work with llama and other large language models.
Run your favourite LLMs locally on macOS from Swift
3 packages.