Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

utils

package

Go to main page

Versions in this module

v1

v1.1.13

May 26, 2026

v1.1.11

May 23, 2026

v1.1.10

May 11, 2026

Changes in this version

+ func CheckAndDownload(modelID, modelFile string, observer DownloadObserver) (string, error)

+ func Clean(s string) string

+ func CleanNoise(text string) string

+ func DesensitizePII(text string) string

+ func ExtractKeywords(s string) []string

+ func GenerateID(content []byte) string

+ func GetModelPath(modelID, file string) string

+ func Normalize(s string) string

+ func NormalizeChinese(text string) string

+ func NormalizeParagraphs(text string) string

+ func RemoveLineNumbers(text string) string

+ func RemoveLinks(text string) string

+ func RemoveStopWords(s string) string

+ func RemoveWatermarks(text string) string

+ func ToHalfWidth(text string) string

+ type DownloadEvent struct

+ Current int64

+ File string

+ Message string

+ Total int64

+ Type EventType

+ type DownloadObserver interface

+ OnEvent func(event DownloadEvent)

+ type EventType int

+ const EventAllComplete

+ const EventComplete

+ const EventError

+ const EventProgress

+ const EventStart

+ type ModelDownloader struct

+ func NewModelDownloader(cacheDir string) (*ModelDownloader, error)

+ func (d *ModelDownloader) Download(modelID string, files []string) (string, error)

+ func (d *ModelDownloader) WithObserver(observer DownloadObserver) *ModelDownloader

v1.0.3

Mar 10, 2026

v1.0.2

Mar 9, 2026

v1.0.1

Mar 9, 2026

v1.0.0

Mar 8, 2026

v0

v0.6.0

Mar 7, 2026

Changes in this version

+ func GenerateLargeHTMLFile(filePath string, sizeMB int) error

+ func GenerateLargeJSONFile(filePath string, sizeMB int) error

+ func GenerateLargeTextFile(filePath string, sizeMB int) error

v0.5.0

Mar 6, 2026

v0.3.0

Mar 6, 2026

Changes in this version

+ type ConnectionPool struct

+ func NewConnectionPool(opts PoolOptions) *ConnectionPool

+ func (p *ConnectionPool) Close() error

+ func (p *ConnectionPool) Get(ctx context.Context) (interface{}, error)

+ func (p *ConnectionPool) Put(conn interface{})

+ type Pool interface

+ Close func() error

+ Get func(ctx context.Context) (interface{}, error)

+ Put func(conn interface{})

+ type PoolOptions struct

+ CloseConn func(interface{}) error

+ CreateConn func() (interface{}, error)

+ IdleTimeout time.Duration

+ MaxActive int

+ MaxIdle int

+ ValidateConn func(interface{}) bool