counter

package

v0.1.1 Latest Latest Go to latest Published: Jul 8, 2026 License: MIT Imports: 1 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/CycleZero/blades

Links

Open Source Insights

Documentation ¶

Index ¶

func NewCharBasedCounter() blades.TokenCounter

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func NewCharBasedCounter ¶

func NewCharBasedCounter() blades.TokenCounter

NewCharBasedCounter returns a TokenCounter that approximates 1 token per 4 characters. This is suitable as a default when no model-specific tokenizer is available.

Types ¶

This section is empty.

Source Files ¶

View all Source files

counter.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL