Swift Package Index

Packages for keyword “tokenizers”

These packages are available as a package collection, usable in Xcode or SwiftPM.

• swift-tokenizers

  High-performance tokenizers

  • DePasqualeOrg/swift-tokenizers
  • Active 27 days ago
  • 9 stars

• swift-tiktoken

  A pure Swift implementation of OpenAI's tiktoken tokenizer

  • DePasqualeOrg/swift-tiktoken
  • Active 10 months ago
  • 6 stars

2 packages.