Swift Package Index

Packages for keyword “llm-inference”

These packages are available as a package collection, usable in Xcode or SwiftPM.

• LLM

  LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

  • eastriverlee/LLM.swift
  • Active 2 months ago
  • 882 stars

• swift-cactus

  Crossplatform Swift SDK for Cactus hybrid inference and running LLMs locally in your app.

  • mhayes853/swift-cactus
  • Active 5 months ago
  • 25 stars
  • Has documentation

• NobodyWho

  On-device AI inference for Swift apps. Run LLMs locally on iOS, macOS, visionOS and watchOS.

  • nobodywho-ooo/nobodywho-swift
  • Active 2 days ago
  • 5 stars

• VeloxQuant

  Swift SDK for VeloxQuant (Apple Silicon MLX KV-cache compression) — sibling to the TS, Go, Rust, and Kotlin client SDKs.

  • rajveer43/veloxquant-swift
  • Active 16 days ago
  • 0 stars

4 packages.