README
¶
AIStore extensions
| Name | Folder | Documentation |
|---|---|---|
| ETL | ext/etl | docs/etl.md |
| Dsort (Distributed Shuffle) | ext/dsort | docs/dsort.md |
| Downloader | ext/dload | docs/downloader.md |
Directories
¶
| Path | Synopsis |
|---|---|
|
Package dload implements functionality to download resources into AIS cluster from external source.
|
Package dload implements functionality to download resources into AIS cluster from external source. |
|
Package dsort provides distributed massively parallel resharding for very large datasets.
|
Package dsort provides distributed massively parallel resharding for very large datasets. |
|
shard
Package shard provides Extract(shard), Create(shard), and associated methods across all supported archival formats (see cmn/archive/mime.go)
|
Package shard provides Extract(shard), Create(shard), and associated methods across all supported archival formats (see cmn/archive/mime.go) |
|
Package etl provides utilities to initialize and use transformation pods.
|
Package etl provides utilities to initialize and use transformation pods. |
|
webserver
Package webserver provides a framework to impelemnt etl transformation webserver in golang.
|
Package webserver provides a framework to impelemnt etl transformation webserver in golang. |
Click to show internal directories.
Click to hide internal directories.