Swift Package IndexNerd Snipe Inc welcomes support for AIChatKitLlama through GitHub Sponsors. If you find this package useful, please consider supporting it.
When working with an Xcode project:
When working with a Swift Package Manager manifest:
Select a package version:
1.0.3
main
Adds on-device GGUF inference via llama.cpp to any app already using AIChatKit. Models run entirely in-process using Metal GPU acceleration — no network calls after the initial download.