LiteRTLM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Written by Google AI Edge and 53 other contributors.
This package includes binary-only targets where source code may not be available. There may be more info available in the README or LICENSE.
In development for over 1 year, with 2,598 commits and 23 releases.
There are 224 open issues and 461 open pull requests. The last issue was closed 18 hours ago and the last pull request was merged/closed 3 hours ago.
This package has no package dependencies.
Including all transitive and test dependencies.
Apache 2.0 licensed
6,590 stars
2 libraries
No executables
No plugins
No macros
No data race safety information availableWhat is data race safety and how is it tested?

Compatibility

Full Build Results

This package currently has no compatibility information. We are currently processing a large build job backlog and it may take much longer than usual for compatibility information to appear.

You can see what builds the system is currently processing by checking the build system monitoring page.

Package ID	F3C55203-9635-40C7-ADA3-40AE6C8EAFEF
Score	135

Swift Package Index

When working with an Xcode project:

When working with a Swift Package Manager manifest:

Compatibility