Packages for keyword “gguf”
These packages are available as a package collection, usable in Xcode or SwiftPM.
LLM
LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.
LocalLLMClient
Swift package to run local LLMs on iOS, macOS, Linux
AIChatKitLlama
Adds on-device GGUF inference via llama.cpp to any app already using AIChatKit. Models run entirely in-process using Metal GPU acceleration — no network calls after the initial download.
swift-llama
Run LLMs natively in Swift. Actor-safe. Streaming. Tool-calling. Metal-accelerated.
swift-gguf
A parser for the GGUF file format. Done using swift-binary-parsing.
5 packages.