cache

type InMemorySemanticCache ¶

type InMemorySemanticCache struct {
	// contains filtered or unexported fields
}

InMemorySemanticCache is a lightweight, concurrent-safe semantic cache. For production, this could be backed by Redis + Vector Search (like RedisVL).

func NewInMemorySemanticCache() *InMemorySemanticCache

func (c *InMemorySemanticCache) Get(ctx context.Context, queryEmbedding []float32, threshold float32) (string, bool, error)

func (c *InMemorySemanticCache) Set(ctx context.Context, queryEmbedding []float32, response string) error