The Swift Package Index logo.Swift Package Index

Build Information

Successful build of swift-tokenizers, reference 0.7.5 (1e2788), with Swift 6.3 for Linux on 20 Nov 2026 05:27:54 UTC.

Swift 6 data race errors: 0

Build Command

bash -c docker run --pull=always --rm -v "checkouts-54344849-0":/host -w "$PWD" -e JAVA_HOME="/root/.sdkman/candidates/java/current" -e SPI_BUILD="1" -e SPI_PROCESSING="1" registry.gitlab.com/saguaro1/spi-images:linux-6.3-latest swift build --triple x86_64-unknown-linux-gnu 2>&1

Build Log

========================================
RunAll
========================================
Builder version: 5.1.4
Interrupt handler set up.
========================================
Checkout
========================================
Clone URL: https://github.com/DePasqualeOrg/swift-tokenizers.git
Reference: 0.7.5
Initialized empty Git repository in /host/spi-builder-workspace/.git/
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint:
hint: 	git config --global init.defaultBranch <name>
hint:
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint:
hint: 	git branch -m <name>
From https://github.com/DePasqualeOrg/swift-tokenizers
 * tag               0.7.5      -> FETCH_HEAD
HEAD is now at 1e27881 Pin Rust artifactbundle to tokenizers-rust-0.7.5
Cloned https://github.com/DePasqualeOrg/swift-tokenizers.git
Revision (git rev-parse @):
1e2788195405287307108420997df41f8bb75db9
SPI manifest file found: $PWD/.spi.yml
SUCCESS checkout https://github.com/DePasqualeOrg/swift-tokenizers.git at 0.7.5
========================================
Build
========================================
Selected platform:         linux
Swift version:             6.3
Building package at path:  $PWD
https://github.com/DePasqualeOrg/swift-tokenizers.git
Running build ...
bash -c docker run --pull=always --rm -v "checkouts-54344849-0":/host -w "$PWD" -e JAVA_HOME="/root/.sdkman/candidates/java/current" -e SPI_BUILD="1" -e SPI_PROCESSING="1" registry.gitlab.com/saguaro1/spi-images:linux-6.3-latest swift build --triple x86_64-unknown-linux-gnu 2>&1
linux-6.3-latest: Pulling from saguaro1/spi-images
Digest: sha256:2d5b74478f792f87932467cb1c47b1b25df4173cb6dae554d34910d5911b073a
Status: Image is up to date for registry.gitlab.com/saguaro1/spi-images:linux-6.3-latest
Fetching https://github.com/DePasqualeOrg/swift-hf-api.git
[1/1789] Fetching swift-hf-api
Fetched https://github.com/DePasqualeOrg/swift-hf-api.git from cache (0.47s)
Computing version for https://github.com/DePasqualeOrg/swift-hf-api.git
Computed https://github.com/DePasqualeOrg/swift-hf-api.git at 0.4.7 (0.66s)
Fetching https://github.com/apple/swift-crypto
[1/18984] Fetching swift-crypto
Fetched https://github.com/apple/swift-crypto from cache (1.20s)
Computing version for https://github.com/apple/swift-crypto
Computed https://github.com/apple/swift-crypto at 4.5.2 (2.13s)
Fetching https://github.com/apple/swift-asn1.git
[1/2079] Fetching swift-asn1
Fetched https://github.com/apple/swift-asn1.git from cache (0.44s)
Computing version for https://github.com/apple/swift-asn1.git
Computed https://github.com/apple/swift-asn1.git at 1.7.4 (0.62s)
Creating working copy for https://github.com/apple/swift-crypto
Working copy of https://github.com/apple/swift-crypto resolved at 4.5.2
Creating working copy for https://github.com/apple/swift-asn1.git
Working copy of https://github.com/apple/swift-asn1.git resolved at 1.7.4
Creating working copy for https://github.com/DePasqualeOrg/swift-hf-api.git
Working copy of https://github.com/DePasqualeOrg/swift-hf-api.git resolved at 0.4.7
Downloading binary artifact https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.5/TokenizersRust-0.7.5.artifactbundle.zip
Downloading binary artifact https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.7/HFAPIRust-0.4.7.artifactbundle.zip
[16375/17964163] Downloading https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.5/TokenizersRust-0.7.5.artifactbundle.zip
Downloaded https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.5/TokenizersRust-0.7.5.artifactbundle.zip (1.05s)
[7714/38436065] Downloading https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.7/HFAPIRust-0.4.7.artifactbundle.zip
Downloaded https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.7/HFAPIRust-0.4.7.artifactbundle.zip (5.79s)
Building for debugging...
[0/5] Copying PrivacyInfo.xcprivacy
[1/5] Write sources
[3/5] Copying libtokenizers_rust.a
[4/5] Write swift-version-24593BA9C3E375BF.txt
[6/8] Compiling TokenizersFFI TokenizersFFI.swift
/host/spi-builder-workspace/Sources/TokenizersFFI/Generated/TokenizersFFI.swift:12:22: warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  10 | // this module. This is a bit of light hackery to work with both.
  11 | #if canImport(TokenizersRust)
  12 | @_implementationOnly import TokenizersRust
     |                      `- warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  13 | #endif
  14 |
[#ImplementationOnlyDeprecated]: <https://docs.swift.org/compiler/documentation/diagnostics/implementation-only-deprecated>
[7/8] Compiling TokenizersFFI resource_bundle_accessor.swift
[8/8] Emitting module TokenizersFFI
/host/spi-builder-workspace/Sources/TokenizersFFI/Generated/TokenizersFFI.swift:12:22: warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  10 | // this module. This is a bit of light hackery to work with both.
  11 | #if canImport(TokenizersRust)
  12 | @_implementationOnly import TokenizersRust
     |                      `- warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  13 | #endif
  14 |
[#ImplementationOnlyDeprecated]: <https://docs.swift.org/compiler/documentation/diagnostics/implementation-only-deprecated>
[10/16] Compiling Tokenizers TokenizerRuntimeConfiguration.swift
[11/16] Compiling Tokenizers ChatTemplate.swift
[12/16] Emitting module Tokenizers
[13/16] Compiling Tokenizers AutoTokenizerDirectoryLoader.swift
[14/16] Compiling Tokenizers RustTokenizer.swift
[15/16] Compiling Tokenizers Tokenizer.swift
[16/16] Compiling Tokenizers StreamingDetokenizer.swift
Build complete! (15.39s)
Build complete.
{
  "dependencies" : [
    {
      "identity" : "swift-hf-api",
      "requirement" : {
        "range" : [
          {
            "lower_bound" : "0.4.7",
            "upper_bound" : "0.5.0"
          }
        ]
      },
      "type" : "sourceControl",
      "url" : "https://github.com/DePasqualeOrg/swift-hf-api.git"
    }
  ],
  "manifest_display_name" : "swift-tokenizers",
  "name" : "swift-tokenizers",
  "path" : "/host/spi-builder-workspace",
  "platforms" : [
    {
      "name" : "ios",
      "version" : "17.0"
    },
    {
      "name" : "macos",
      "version" : "14.0"
    }
  ],
  "products" : [
    {
      "name" : "Tokenizers",
      "targets" : [
        "Tokenizers"
      ],
      "type" : {
        "library" : [
          "automatic"
        ]
      }
    }
  ],
  "targets" : [
    {
      "c99name" : "TokenizersTests",
      "module_type" : "SwiftTarget",
      "name" : "TokenizersTests",
      "path" : "Tests/TokenizersTests",
      "product_dependencies" : [
        "HFAPI"
      ],
      "resources" : [
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/bert_uncased_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/distilbert_cased_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/falcon_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/gemma_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/gpt2_encoded_tokens.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/llama_3.2_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/llama_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/t5_base_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer_config.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer_tests.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/whisper_large_v2_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/whisper_tiny_en_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        }
      ],
      "sources" : [
        "AlgorithmTests.swift",
        "BaselineTests.swift",
        "ChatTemplateTests.swift",
        "FactoryTests.swift",
        "TestHFClient.swift",
        "ThrowingAPITests.swift",
        "TokenizerTests.swift",
        "UniffiSpikeTests.swift"
      ],
      "target_dependencies" : [
        "Tokenizers",
        "TokenizersFFI"
      ],
      "type" : "test"
    },
    {
      "c99name" : "TokenizersRust",
      "module_type" : "BinaryTarget",
      "name" : "TokenizersRust",
      "path" : "remote/archive/TokenizersRust-0.7.5.artifactbundle.zip",
      "product_memberships" : [
        "Tokenizers"
      ],
      "sources" : [
      ],
      "type" : "binary"
    },
    {
      "c99name" : "TokenizersFFI",
      "module_type" : "SwiftTarget",
      "name" : "TokenizersFFI",
      "path" : "Sources/TokenizersFFI",
      "product_memberships" : [
        "Tokenizers"
      ],
      "resources" : [
        {
          "path" : "/host/spi-builder-workspace/Sources/TokenizersFFI/Resources/PrivacyInfo.xcprivacy",
          "rule" : {
            "process" : {
            }
          }
        }
      ],
      "sources" : [
        "Generated/TokenizersFFI.swift"
      ],
      "target_dependencies" : [
        "TokenizersRust"
      ],
      "type" : "library"
    },
    {
      "c99name" : "Tokenizers",
      "module_type" : "SwiftTarget",
      "name" : "Tokenizers",
      "path" : "Sources/Tokenizers",
      "product_memberships" : [
        "Tokenizers"
      ],
      "sources" : [
        "AutoTokenizerDirectoryLoader.swift",
        "ChatTemplate.swift",
        "RustTokenizer.swift",
        "StreamingDetokenizer.swift",
        "Tokenizer.swift",
        "TokenizerRuntimeConfiguration.swift"
      ],
      "target_dependencies" : [
        "TokenizersFFI"
      ],
      "type" : "library"
    }
  ],
  "tools_version" : "6.2"
}
linux-6.3-latest: Pulling from saguaro1/spi-images
Digest: sha256:2d5b74478f792f87932467cb1c47b1b25df4173cb6dae554d34910d5911b073a
Status: Image is up to date for registry.gitlab.com/saguaro1/spi-images:linux-6.3-latest
Done.