tokenizer

cab.ml

tokenizer is a Java jar artifact published under the cab.ml group on Maven Central. 3 versions are indexed here. Select a version below for Maven, Gradle and SBT snippets plus CVE data.

Recommended: 0.1.1 3 versions jarChecking...
Analyze DependenciesCompare Artifact

Add to your project0.1.1

<dependency>
    <groupId>cab.ml</groupId>
    <artifactId>tokenizer</artifactId>
    <version>0.1.1</version>
</dependency>

Version Details — 0.1.1

Packaging
jar
Direct Deps
0
Total Deps
0
Published
Unknown
License
Unknown

Tokenizer — DJL SentencePiece wrapper, chat template formatter, BPE support for LLaMA 2/3, Mistral, Gemma

Checking security advisories...