compliance

package
v0.1.13 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 15, 2025 License: MIT Imports: 5 Imported by: 0

Documentation

Overview

Package compliance provides a test suite to verify provider implementations.

The compliance suite tests that LLM providers correctly implement the standard interfaces and behave consistently across different implementations.

Usage:

func TestProviderCompliance(t *testing.T) {
    model, err := provider.New()
    if err != nil {
        t.Fatal(err)
    }

    suite := compliance.NewSuite("provider", model)
    suite.Run(t)
}

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type Suite

type Suite struct {
	// Provider is the provider name.
	Provider string

	// Model is the model to test.
	Model llms.Model

	// SkipTests contains test names to skip.
	SkipTests map[string]bool

	// Timeout for individual tests.
	Timeout time.Duration
}

Suite tests provider compliance with the LLM interface.

func NewSuite

func NewSuite(provider string, model llms.Model) *Suite

NewSuite creates a new compliance test suite.

func (*Suite) Run

func (s *Suite) Run(t *testing.T)

Run executes all compliance tests.

func (*Suite) Skip

func (s *Suite) Skip(testName string)

Skip marks a test to be skipped.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL