Packages for keyword “llm”
These packages are available as a package collection, usable in Xcode or SwiftPM.
LLM
LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.
SpeziLLM
Large Language Model (LLM) module for the Spezi Ecosystem
AgentRunKit
Swift 6 agent SDK: type-safe tools, streaming, cloud + on-device inference via MLX on Apple Silicon
CoreMLLLM
Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU
OllamaKit
Ollama client for Swift
swift-cactus
Crossplatform Swift SDK for Cactus hybrid inference and running LLMs locally in your app.
SwiftLLMKit
One Swift interface for Anthropic, OpenAI, Gemini, Ollama, OpenRouter and 10+ more LLM providers — tool calling, reasoning/effort controls, structured output, capability-aware model catalog, Keychain-stored keys.
coreai-kit
Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels integration, and runnable examples with documented OS, SDK and model requirements.
ManifoldKit
Reusable SwiftUI chat framework for local and cloud LLM inference on Apple platforms
DProvenanceKit
Local-first AI reasoning observability for Swift: record, diff, attest, and CI-gate agent execution paths. Complements OpenTelemetry and tools like LangSmith — does not replace them.
LocalLLMClient
Swift package to run local LLMs on iOS, macOS, Linux
swift-extract
Typed structured extraction from PDFs, photos & text via any LLM — Instructor for Swift, document-first
SwiftStreamingMarkdown
A performant markdown library for iOS & macOS that supports streaming
AIChatKit
A Swift package that gives every app a single, unified chat interface across cloud and on-device AI providers. OpenAI, Anthropic, and Apple Intelligence all share the same protocol, message model, and optional SwiftUI components — swap providers with a one-line change.
swift-tokenizers
High-performance tokenizers
NRouter
nRouter SDK — one API key for models across six provider clouds (Alibaba US, OpenAI, AWS Bedrock, Azure Foundry, Google Vertex AI, Anthropic). Speaks the OpenAI and Anthropic wire formats natively, plus embeddings, audio, images and video.
PortableMemory
An open, vendor-neutral AI memory format and protocol
Sophon
Gemini AI client kit for Swift (iOS, macOS, Mac Catalyst): structured output, retry policies, model catalog with automatic fallback, lenient LLM JSON decoding. Ships in three App Store apps.
SwiftAgentCore
A bare-bones Swift agent runtime with built-in tool execution, skill support, conversation-state handling with a unified multi-provider LLM layer (OpenAI-compatible/Responses, Anthropic, Gemini, and MiniMax, plus codex OAuth)
swift-argument-parser-mcp
A Swift library that turns any ArgumentParser CLI into an MCP server, letting AI agents call your commands as tools.