These packages are available as a package collection, usable in Xcode or SwiftPM.
Size an LLM's KV cache from its config.json (Swift): GQA-aware, head_dim-aware, fp16/fp8/int4
1 package.
Swift Package Index