Microsoft.ML.Tokenizers 0.22.0-preview.24162.2

Microsoft.ML.Tokenizers contains the implmentation of the tokenization used in the NLP transforms.

Showing the top 20 packages that depend on Microsoft.ML.Tokenizers.

Packages Downloads
Microsoft.Agents.AI
Provides Microsoft Agent Framework core functionality.
2
Microsoft.Agents.AI
Provides Microsoft Agent Framework core functionality.
1
Microsoft.Extensions.AI.Evaluation
A library containing core abstractions for evaluating responses received from an LLM.
1
Microsoft.Agents.AI.Workflows
Provides Microsoft Agent Framework support for workflows.
1

.NET 8.0

.NET Standard 2.0

Version Downloads Last updated
3.0.0-preview.26160.2 1 05/28/2026
2.0.0 1 05/28/2026
2.0.0-preview.25527.5 1 05/28/2026
2.0.0-preview.25503.2 1 05/28/2026
2.0.0-preview.25373.1 1 05/28/2026
2.0.0-preview.1.25127.4 1 05/28/2026
2.0.0-preview.1.25125.4 1 05/28/2026
1.0.3 1 05/28/2026
1.0.2 1 05/28/2026
1.0.1 1 05/28/2026
1.0.0 1 05/28/2026
0.22.0 1 05/28/2026
0.22.0-preview.24526.1 1 05/28/2026
0.22.0-preview.24522.7 1 05/28/2026
0.22.0-preview.24378.1 1 05/28/2026
0.22.0-preview.24271.1 1 05/28/2026
0.22.0-preview.24179.1 1 05/28/2026
0.22.0-preview.24162.2 1 05/28/2026
0.21.1 1 05/28/2026
0.21.0 1 05/28/2026
0.21.0-preview.23511.1 1 05/28/2026
0.21.0-preview.23266.6 1 05/28/2026
0.21.0-preview.22621.2 1 05/28/2026
0.20.1 1 05/28/2026
0.20.1-preview.22573.9 1 05/28/2026
0.20.0 1 05/28/2026
0.20.0-preview.22551.1 1 05/28/2026