tokencount

package

v0.1.5 Latest Latest Go to latest Published: Mar 3, 2026 License: MIT Imports: 2 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/rickcrawford/tokenomics

Links

Open Source Insights

Documentation ¶

Index ¶

func Count(model, text string) (int, error)
func CountMessages(model string, messages []map[string]interface{}) (int, error)

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func Count ¶

func Count(model, text string) (int, error)

Count returns the number of tokens in the given text for the specified model. Falls back to cl100k_base encoding if the model is not recognized.

func CountMessages ¶

func CountMessages(model string, messages []map[string]interface{}) (int, error)

CountMessages estimates token usage for a chat completion messages array. Uses the OpenAI token counting heuristic: each message adds overhead tokens.

Types ¶

This section is empty.

Source Files ¶

View all Source files

counter.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL