Swift Package Index

Packages for keyword “kv-cache”

These packages are available as a package collection, usable in Xcode or SwiftPM.

• VeloxQuant

  Swift SDK for VeloxQuant (Apple Silicon MLX KV-cache compression) — sibling to the TS, Go, Rust, and Kotlin client SDKs.

  • rajveer43/veloxquant-swift
  • Active about 1 month ago
  • 0 stars

• KVCacheEstimator

  Size an LLM's KV cache from its config.json (Swift): GQA-aware, head_dim-aware, fp16/fp8/int4

  • theluckystrike/KVCacheEstimator
  • Active 7 hours ago
  • 0 stars

2 packages.