Microsoft.ML.Tokenizers 0.20.1

Microsoft.ML.Tokenizers contains the implmentation of the tokenization used in the NLP transforms.

Showing the top 20 packages that depend on Microsoft.ML.Tokenizers.

Packages Downloads
Microsoft.Agents.AI
Provides Microsoft Agent Framework core functionality.
2
Microsoft.Agents.AI
Provides Microsoft Agent Framework core functionality.
1
Microsoft.Extensions.AI.Evaluation
A library containing core abstractions for evaluating responses received from an LLM.
1
Microsoft.Agents.AI.Workflows
Provides Microsoft Agent Framework support for workflows.
1

.NET Standard 2.0

Version Downloads Last updated
3.0.0-preview.26160.2 1 05/28/2026
2.0.0 1 05/28/2026
2.0.0-preview.25527.5 1 05/28/2026
2.0.0-preview.25503.2 1 05/28/2026
2.0.0-preview.25373.1 1 05/28/2026
2.0.0-preview.1.25127.4 1 05/28/2026
2.0.0-preview.1.25125.4 1 05/28/2026
1.0.3 1 05/28/2026
1.0.2 1 05/28/2026
1.0.1 1 05/28/2026
1.0.0 1 05/28/2026
0.22.0 1 05/28/2026
0.22.0-preview.24526.1 1 05/28/2026
0.22.0-preview.24522.7 1 05/28/2026
0.22.0-preview.24378.1 1 05/28/2026
0.22.0-preview.24271.1 1 05/28/2026
0.22.0-preview.24179.1 1 05/28/2026
0.22.0-preview.24162.2 1 05/28/2026
0.21.1 1 05/28/2026
0.21.0 1 05/28/2026
0.21.0-preview.23511.1 1 05/28/2026
0.21.0-preview.23266.6 1 05/28/2026
0.21.0-preview.22621.2 1 05/28/2026
0.20.1 1 05/28/2026
0.20.1-preview.22573.9 1 05/28/2026
0.20.0 1 05/28/2026
0.20.0-preview.22551.1 1 05/28/2026