tools

func (*Parser) Add ¶

func (p *Parser) Add(s string) (calls []api.ToolCall, content string)

Add processes a string input to parse tool calls and content that should be sent back to the user.

func (*Parser) Content ¶ added in v0.9.1

func (p *Parser) Content() string

Content returns any remaining content that should be sent to the user. This should be the empty string string unless the tag is { or [ and a tool call was not found

func (*Parser) GetBuffer ¶ added in v0.11.1

func (p *Parser) GetBuffer() []byte

func (*Parser) PreservedTokens ¶

func (p *Parser) PreservedTokens() []string

PreservedTokens returns the token strings that should be preserved during llama-server detokenization so the parser can still observe its opening tag. Some templates glue a special token directly to plain JSON punctuation, e.g. "[TOOL_CALLS][", where only the leading special token can be stripped by the detokenizer. In those cases we preserve just the leading special token while still parsing against the full tag.

func (*Parser) Tag ¶ added in v0.30.0

func (p *Parser) Tag() string

Tag returns the tool-call tag string the parser is looking for in the output stream. Callers can pass this to llama-server's preserved_tokens field so the tag is rendered as text instead of being stripped during detokenization.