Swift Package IndexBuild Information
Successful build of swift-tokenizers, reference 0.7.4 (8a6682), with Swift 6.3 for macOS (SPM) on 19 Sep 2026 21:11:51 UTC.
Swift 6 data race errors: 0
Build Command
env DEVELOPER_DIR=/Applications/Xcode-26.5.0.app xcrun swift build --arch arm64Build Log
========================================
RunAll
========================================
Builder version: 5.1.0
Interrupt handler set up.
========================================
Checkout
========================================
Clone URL: https://github.com/DePasqualeOrg/swift-tokenizers.git
Reference: 0.7.4
Initialized empty Git repository in /Users/admin/builder/spi-builder-workspace/.git/
From https://github.com/DePasqualeOrg/swift-tokenizers
* tag 0.7.4 -> FETCH_HEAD
HEAD is now at 8a66828 Pin Rust artifactbundle to tokenizers-rust-0.7.3
Cloned https://github.com/DePasqualeOrg/swift-tokenizers.git
Revision (git rev-parse @):
8a66828e7a094d94e282754321c831150129ea25
SPI manifest file found: $PWD/.spi.yml
SUCCESS checkout https://github.com/DePasqualeOrg/swift-tokenizers.git at 0.7.4
Fetching https://github.com/DePasqualeOrg/swift-hf-api.git
[1/1748] Fetching swift-hf-api
Fetched https://github.com/DePasqualeOrg/swift-hf-api.git from cache (1.20s)
Computing version for https://github.com/DePasqualeOrg/swift-hf-api.git
Computed https://github.com/DePasqualeOrg/swift-hf-api.git at 0.4.4 (1.82s)
Fetching https://github.com/apple/swift-crypto
[1/18549] Fetching swift-crypto
Fetched https://github.com/apple/swift-crypto from cache (2.34s)
Computing version for https://github.com/apple/swift-crypto
Computed https://github.com/apple/swift-crypto at 4.5.2 (5.27s)
Fetching https://github.com/apple/swift-asn1.git
[1/1983] Fetching swift-asn1
Fetched https://github.com/apple/swift-asn1.git from cache (1.02s)
Computing version for https://github.com/apple/swift-asn1.git
Computed https://github.com/apple/swift-asn1.git at 1.7.3 (1.68s)
Creating working copy for https://github.com/apple/swift-crypto
Working copy of https://github.com/apple/swift-crypto resolved at 4.5.2
Creating working copy for https://github.com/apple/swift-asn1.git
Working copy of https://github.com/apple/swift-asn1.git resolved at 1.7.3
Creating working copy for https://github.com/DePasqualeOrg/swift-hf-api.git
Working copy of https://github.com/DePasqualeOrg/swift-hf-api.git resolved at 0.4.4
Downloading binary artifact https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip
Downloading binary artifact https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.6/HFAPIRust-0.4.6.artifactbundle.zip
[16375/17881530] Downloading https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip
[11399763/55319177] Downloading https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip, https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.6/HFAPIRust-0.4.6.artifactbundle.zip
Downloaded https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip (1.25s)
Downloaded https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.6/HFAPIRust-0.4.6.artifactbundle.zip (2.18s)
========================================
ResolveProductDependencies
========================================
Resolving dependencies ...
{
"identity": ".resolve-product-dependencies",
"name": "resolve-dependencies",
"url": "/Users/admin/builder/spi-builder-workspace/.resolve-product-dependencies",
"version": "unspecified",
"path": "/Users/admin/builder/spi-builder-workspace/.resolve-product-dependencies",
"traits": [
"default"
],
"dependencies": [
{
"identity": "swift-tokenizers",
"name": "swift-tokenizers",
"url": "https://github.com/DePasqualeOrg/swift-tokenizers.git",
"version": "unspecified",
"path": "/Users/admin/builder/spi-builder-workspace/.resolve-product-dependencies/.build/checkouts/swift-tokenizers",
"traits": [
"default"
],
"dependencies": [
]
}
]
}
Fetching https://github.com/DePasqualeOrg/swift-tokenizers.git
[1/3261] Fetching swift-tokenizers
Fetched https://github.com/DePasqualeOrg/swift-tokenizers.git from cache (1.39s)
Creating working copy for https://github.com/DePasqualeOrg/swift-tokenizers.git
Working copy of https://github.com/DePasqualeOrg/swift-tokenizers.git resolved at 0.7.4 (8a66828)
Fetching binary artifact https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip from cache
Fetched https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip from cache (0.78s)
warning: '.resolve-product-dependencies': dependency 'swift-tokenizers' is not used by any target
Found 0 product dependencies
========================================
Build
========================================
Selected platform: macosSpm
Swift version: 6.3
Building package at path: $PWD
https://github.com/DePasqualeOrg/swift-tokenizers.git
Running build ...
env DEVELOPER_DIR=/Applications/Xcode-26.5.0.app xcrun swift build --arch arm64
Building for debugging...
[0/5] Copying libtokenizers_rust.a
[0/5] Copying PrivacyInfo.xcprivacy
[2/5] Write sources
[4/5] Write swift-version-69A768CDF2A0BEE1.txt
[6/8] Compiling TokenizersFFI TokenizersFFI.swift
/Users/admin/builder/spi-builder-workspace/Sources/TokenizersFFI/Generated/TokenizersFFI.swift:12:22: warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
10 | // this module. This is a bit of light hackery to work with both.
11 | #if canImport(TokenizersRust)
12 | @_implementationOnly import TokenizersRust
| `- warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
13 | #endif
14 |
[#ImplementationOnlyDeprecated]: <https://docs.swift.org/compiler/documentation/diagnostics/implementation-only-deprecated>
[7/8] Compiling TokenizersFFI resource_bundle_accessor.swift
[8/8] Emitting module TokenizersFFI
/Users/admin/builder/spi-builder-workspace/Sources/TokenizersFFI/Generated/TokenizersFFI.swift:12:22: warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
10 | // this module. This is a bit of light hackery to work with both.
11 | #if canImport(TokenizersRust)
12 | @_implementationOnly import TokenizersRust
| `- warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
13 | #endif
14 |
[#ImplementationOnlyDeprecated]: <https://docs.swift.org/compiler/documentation/diagnostics/implementation-only-deprecated>
[9/15] Compiling Tokenizers TokenizerRuntimeConfiguration.swift
[10/15] Compiling Tokenizers StreamingDetokenizer.swift
[11/15] Compiling Tokenizers ChatTemplate.swift
[12/15] Compiling Tokenizers RustTokenizer.swift
[13/15] Compiling Tokenizers AutoTokenizerDirectoryLoader.swift
[14/15] Emitting module Tokenizers
[15/15] Compiling Tokenizers Tokenizer.swift
Build complete! (7.17s)
Build complete.
{
"dependencies" : [
{
"identity" : "swift-hf-api",
"requirement" : {
"range" : [
{
"lower_bound" : "0.4.2",
"upper_bound" : "0.5.0"
}
]
},
"type" : "sourceControl",
"url" : "https://github.com/DePasqualeOrg/swift-hf-api.git"
}
],
"manifest_display_name" : "swift-tokenizers",
"name" : "swift-tokenizers",
"path" : "/Users/admin/builder/spi-builder-workspace",
"platforms" : [
{
"name" : "ios",
"version" : "17.0"
},
{
"name" : "macos",
"version" : "14.0"
}
],
"products" : [
{
"name" : "Tokenizers",
"targets" : [
"Tokenizers"
],
"type" : {
"library" : [
"automatic"
]
}
}
],
"targets" : [
{
"c99name" : "TokenizersTests",
"module_type" : "SwiftTarget",
"name" : "TokenizersTests",
"path" : "Tests/TokenizersTests",
"product_dependencies" : [
"HFAPI"
],
"resources" : [
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/bert_uncased_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/distilbert_cased_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/falcon_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/gemma_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/gpt2_encoded_tokens.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/llama_3.2_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/llama_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/t5_base_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer_config.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer_tests.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/whisper_large_v2_encoded.json",
"rule" : {
"process" : {
}
}
},
{
"path" : "/Users/admin/builder/spi-builder-workspace/Tests/TokenizersTests/Resources/whisper_tiny_en_encoded.json",
"rule" : {
"process" : {
}
}
}
],
"sources" : [
"AlgorithmTests.swift",
"BaselineTests.swift",
"ChatTemplateTests.swift",
"FactoryTests.swift",
"TestHFClient.swift",
"ThrowingAPITests.swift",
"TokenizerTests.swift",
"UniffiSpikeTests.swift"
],
"target_dependencies" : [
"Tokenizers",
"TokenizersFFI"
],
"type" : "test"
},
{
"c99name" : "TokenizersRust",
"module_type" : "BinaryTarget",
"name" : "TokenizersRust",
"path" : "remote/archive/TokenizersRust-0.7.3.artifactbundle.zip",
"product_memberships" : [
"Tokenizers"
],
"sources" : [
],
"type" : "binary"
},
{
"c99name" : "TokenizersFFI",
"module_type" : "SwiftTarget",
"name" : "TokenizersFFI",
"path" : "Sources/TokenizersFFI",
"product_memberships" : [
"Tokenizers"
],
"resources" : [
{
"path" : "/Users/admin/builder/spi-builder-workspace/Sources/TokenizersFFI/Resources/PrivacyInfo.xcprivacy",
"rule" : {
"process" : {
}
}
}
],
"sources" : [
"Generated/TokenizersFFI.swift"
],
"target_dependencies" : [
"TokenizersRust"
],
"type" : "library"
},
{
"c99name" : "Tokenizers",
"module_type" : "SwiftTarget",
"name" : "Tokenizers",
"path" : "Sources/Tokenizers",
"product_memberships" : [
"Tokenizers"
],
"sources" : [
"AutoTokenizerDirectoryLoader.swift",
"ChatTemplate.swift",
"RustTokenizer.swift",
"StreamingDetokenizer.swift",
"Tokenizer.swift",
"TokenizerRuntimeConfiguration.swift"
],
"target_dependencies" : [
"TokenizersFFI"
],
"type" : "library"
}
],
"tools_version" : "6.2"
}
✅ Doc result (pending) reported
========================================
GenerateDocs
========================================
Generating docs at path: $PWD/.docs/depasqualeorg/swift-tokenizers/0.7.4
Repository: DePasqualeOrg/swift-tokenizers
Swift version used: 6.3
.package(url: "https://github.com/swiftlang/swift-docc-plugin", from: "1.4.0")
Target: Tokenizers
error: Unknown subcommand or plugin name ‘generate-documentation’
Usage: swift package <options> <subcommand>
error: Unknown subcommand or plugin name ‘generate-documentation’
Usage: swift package <options> <subcommand>
Error while generating docs: retryLimitExceeded(lastError: Optional(Shell command failed:
env DEVELOPER_DIR=/Applications/Xcode-26.5.0.app xcrun swift package --allow-writing-to-directory .docs/depasqualeorg/swift-tokenizers/0.7.4 generate-documentation --emit-digest --disable-indexing --output-path .docs/depasqualeorg/swift-tokenizers/0.7.4 --hosting-base-path depasqualeorg/swift-tokenizers/0.7.4 --source-service github --source-service-base-url https://github.com/DePasqualeOrg/swift-tokenizers/blob/0.7.4 --checkout-path $PWD --target Tokenizers))
✅ Doc result (failed) reported
Done.