testing

func ReadPythonEmbeddingsList ¶

func ReadPythonEmbeddingsList(path string) ([]float32, error)

ReadPythonEmbeddingsList returns all the embedding values written as text as a large []float32. It's up to the caller to split it according to the expected shape.

It's called "Python" because these embeddings are generated by the test python scripts in internal/py.

func ValidateEmbeddingTensor ¶

func ValidateEmbeddingTensor(t *testing.T, got []float32, expected []float32, name string,
	batchSize, gotSentenceLen, expectedSentenceLen int)

ValidateEmbeddingTensor validates the values of a tensor. It checks the values of the first expectedSentenceLen tokens only, ignoring the padding in case gotSentencenLen > expectedSentenceLen.