The Swift Package Index logo.Swift Package Index

Build Information

Successful build of swift-tokenizers, reference 0.7.4 (8a6682), with Swift 6.2 for Linux on 19 Sep 2026 21:06:32 UTC.

Swift 6 data race errors: 0

Build Command

bash -c docker run --pull=always --rm -v "checkouts-54344845-1":/host -w "$PWD" -e JAVA_HOME="/root/.sdkman/candidates/java/current" -e SPI_BUILD="1" -e SPI_PROCESSING="1" registry.gitlab.com/saguaro1/spi-images:basic-6.2-latest swift build --triple x86_64-unknown-linux-gnu 2>&1

Build Log

========================================
RunAll
========================================
Builder version: 5.1.0
Interrupt handler set up.
========================================
Checkout
========================================
Clone URL: https://github.com/DePasqualeOrg/swift-tokenizers.git
Reference: 0.7.4
Initialized empty Git repository in /host/spi-builder-workspace/.git/
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint:
hint: 	git config --global init.defaultBranch <name>
hint:
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint:
hint: 	git branch -m <name>
From https://github.com/DePasqualeOrg/swift-tokenizers
 * tag               0.7.4      -> FETCH_HEAD
HEAD is now at 8a66828 Pin Rust artifactbundle to tokenizers-rust-0.7.3
Cloned https://github.com/DePasqualeOrg/swift-tokenizers.git
Revision (git rev-parse @):
8a66828e7a094d94e282754321c831150129ea25
SPI manifest file found: $PWD/.spi.yml
SUCCESS checkout https://github.com/DePasqualeOrg/swift-tokenizers.git at 0.7.4
========================================
Build
========================================
Selected platform:         linux
Swift version:             6.2
Building package at path:  $PWD
https://github.com/DePasqualeOrg/swift-tokenizers.git
Running build ...
bash -c docker run --pull=always --rm -v "checkouts-54344845-1":/host -w "$PWD" -e JAVA_HOME="/root/.sdkman/candidates/java/current" -e SPI_BUILD="1" -e SPI_PROCESSING="1" registry.gitlab.com/saguaro1/spi-images:basic-6.2-latest swift build --triple x86_64-unknown-linux-gnu 2>&1
basic-6.2-latest: Pulling from saguaro1/spi-images
Digest: sha256:813c8e8a77634154d7d247705cb89167ff1c866446abbe321f542129dc4cf5a7
Status: Image is up to date for registry.gitlab.com/saguaro1/spi-images:basic-6.2-latest
Fetching https://github.com/DePasqualeOrg/swift-hf-api.git
[1/1748] Fetching swift-hf-api
Fetched https://github.com/DePasqualeOrg/swift-hf-api.git from cache (0.51s)
Computing version for https://github.com/DePasqualeOrg/swift-hf-api.git
Computed https://github.com/DePasqualeOrg/swift-hf-api.git at 0.4.4 (0.71s)
Fetching https://github.com/apple/swift-crypto
[1/18549] Fetching swift-crypto
Fetched https://github.com/apple/swift-crypto from cache (1.23s)
Computing version for https://github.com/apple/swift-crypto
Computed https://github.com/apple/swift-crypto at 4.5.2 (2.41s)
Fetching https://github.com/apple/swift-asn1.git
[1/1983] Fetching swift-asn1
Fetched https://github.com/apple/swift-asn1.git from cache (0.46s)
Computing version for https://github.com/apple/swift-asn1.git
Computed https://github.com/apple/swift-asn1.git at 1.7.3 (0.64s)
Creating working copy for https://github.com/DePasqualeOrg/swift-hf-api.git
Working copy of https://github.com/DePasqualeOrg/swift-hf-api.git resolved at 0.4.4
Creating working copy for https://github.com/apple/swift-crypto
Working copy of https://github.com/apple/swift-crypto resolved at 4.5.2
Creating working copy for https://github.com/apple/swift-asn1.git
Working copy of https://github.com/apple/swift-asn1.git resolved at 1.7.3
Downloading binary artifact https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.6/HFAPIRust-0.4.6.artifactbundle.zip
Downloading binary artifact https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip
[16375/17881530] Downloading https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip
[557038/55319177] Downloading https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip, https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.6/HFAPIRust-0.4.6.artifactbundle.zip
Downloaded https://github.com/DePasqualeOrg/swift-tokenizers/releases/download/tokenizers-rust-0.7.3/TokenizersRust-0.7.3.artifactbundle.zip (1.50s)
Downloaded https://github.com/DePasqualeOrg/swift-hf-api/releases/download/hfapi-rust-0.4.6/HFAPIRust-0.4.6.artifactbundle.zip (2.64s)
Building for debugging...
[0/5] Write sources
[0/5] Copying PrivacyInfo.xcprivacy
[2/5] Write sources
[3/5] Copying libtokenizers_rust.a
[4/5] Write swift-version-24593BA9C3E375BF.txt
[6/8] Compiling TokenizersFFI resource_bundle_accessor.swift
[7/8] Emitting module TokenizersFFI
/host/spi-builder-workspace/Sources/TokenizersFFI/Generated/TokenizersFFI.swift:12:22: warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  10 | // this module. This is a bit of light hackery to work with both.
  11 | #if canImport(TokenizersRust)
  12 | @_implementationOnly import TokenizersRust
     |                      `- warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  13 | #endif
  14 |
[#ImplementationOnlyDeprecated]: <https://docs.swift.org/compiler/documentation/diagnostics/implementation-only-deprecated>
[8/8] Compiling TokenizersFFI TokenizersFFI.swift
/host/spi-builder-workspace/Sources/TokenizersFFI/Generated/TokenizersFFI.swift:12:22: warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  10 | // this module. This is a bit of light hackery to work with both.
  11 | #if canImport(TokenizersRust)
  12 | @_implementationOnly import TokenizersRust
     |                      `- warning: using '@_implementationOnly' without enabling library evolution for 'TokenizersFFI' may lead to instability during execution [#ImplementationOnlyDeprecated]
  13 | #endif
  14 |
[#ImplementationOnlyDeprecated]: <https://docs.swift.org/compiler/documentation/diagnostics/implementation-only-deprecated>
[10/16] Compiling Tokenizers TokenizerRuntimeConfiguration.swift
[11/16] Compiling Tokenizers StreamingDetokenizer.swift
[12/16] Compiling Tokenizers RustTokenizer.swift
[13/16] Compiling Tokenizers AutoTokenizerDirectoryLoader.swift
[14/16] Compiling Tokenizers Tokenizer.swift
[15/16] Emitting module Tokenizers
[16/16] Compiling Tokenizers ChatTemplate.swift
Build complete! (13.61s)
Build complete.
{
  "dependencies" : [
    {
      "identity" : "swift-hf-api",
      "requirement" : {
        "range" : [
          {
            "lower_bound" : "0.4.2",
            "upper_bound" : "0.5.0"
          }
        ]
      },
      "type" : "sourceControl",
      "url" : "https://github.com/DePasqualeOrg/swift-hf-api.git"
    }
  ],
  "manifest_display_name" : "swift-tokenizers",
  "name" : "swift-tokenizers",
  "path" : "/host/spi-builder-workspace",
  "platforms" : [
    {
      "name" : "ios",
      "version" : "17.0"
    },
    {
      "name" : "macos",
      "version" : "14.0"
    }
  ],
  "products" : [
    {
      "name" : "Tokenizers",
      "targets" : [
        "Tokenizers"
      ],
      "type" : {
        "library" : [
          "automatic"
        ]
      }
    }
  ],
  "targets" : [
    {
      "c99name" : "TokenizersTests",
      "module_type" : "SwiftTarget",
      "name" : "TokenizersTests",
      "path" : "Tests/TokenizersTests",
      "product_dependencies" : [
        "HFAPI"
      ],
      "resources" : [
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/bert_uncased_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/distilbert_cased_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/falcon_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/gemma_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/gpt2_encoded_tokens.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/llama_3.2_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/llama_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/t5_base_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer_config.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/tokenizer_tests.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/whisper_large_v2_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        },
        {
          "path" : "/host/spi-builder-workspace/Tests/TokenizersTests/Resources/whisper_tiny_en_encoded.json",
          "rule" : {
            "process" : {
            }
          }
        }
      ],
      "sources" : [
        "AlgorithmTests.swift",
        "BaselineTests.swift",
        "ChatTemplateTests.swift",
        "FactoryTests.swift",
        "TestHFClient.swift",
        "ThrowingAPITests.swift",
        "TokenizerTests.swift",
        "UniffiSpikeTests.swift"
      ],
      "target_dependencies" : [
        "Tokenizers",
        "TokenizersFFI"
      ],
      "type" : "test"
    },
    {
      "c99name" : "TokenizersRust",
      "module_type" : "BinaryTarget",
      "name" : "TokenizersRust",
      "path" : "remote/archive/TokenizersRust-0.7.3.artifactbundle.zip",
      "product_memberships" : [
        "Tokenizers"
      ],
      "sources" : [
      ],
      "type" : "binary"
    },
    {
      "c99name" : "TokenizersFFI",
      "module_type" : "SwiftTarget",
      "name" : "TokenizersFFI",
      "path" : "Sources/TokenizersFFI",
      "product_memberships" : [
        "Tokenizers"
      ],
      "resources" : [
        {
          "path" : "/host/spi-builder-workspace/Sources/TokenizersFFI/Resources/PrivacyInfo.xcprivacy",
          "rule" : {
            "process" : {
            }
          }
        }
      ],
      "sources" : [
        "Generated/TokenizersFFI.swift"
      ],
      "target_dependencies" : [
        "TokenizersRust"
      ],
      "type" : "library"
    },
    {
      "c99name" : "Tokenizers",
      "module_type" : "SwiftTarget",
      "name" : "Tokenizers",
      "path" : "Sources/Tokenizers",
      "product_memberships" : [
        "Tokenizers"
      ],
      "sources" : [
        "AutoTokenizerDirectoryLoader.swift",
        "ChatTemplate.swift",
        "RustTokenizer.swift",
        "StreamingDetokenizer.swift",
        "Tokenizer.swift",
        "TokenizerRuntimeConfiguration.swift"
      ],
      "target_dependencies" : [
        "TokenizersFFI"
      ],
      "type" : "library"
    }
  ],
  "tools_version" : "6.2"
}
basic-6.2-latest: Pulling from saguaro1/spi-images
Digest: sha256:813c8e8a77634154d7d247705cb89167ff1c866446abbe321f542129dc4cf5a7
Status: Image is up to date for registry.gitlab.com/saguaro1/spi-images:basic-6.2-latest
Done.