README
¶
AIStore extensions
| Name | Folder | Documentation |
|---|---|---|
| ETL | ext/etl | docs/etl.md |
| DSort (Distributed Shuffle) | ext/dsort | docs/dsort.md |
| Downloader | ext/dload | docs/downloader.md |
Directories
¶
| Path | Synopsis |
|---|---|
|
Package dload implements functionality to download resources into AIS cluster from external source.
|
Package dload implements functionality to download resources into AIS cluster from external source. |
|
Package dsort provides distributed massively parallel resharding for very large datasets.
|
Package dsort provides distributed massively parallel resharding for very large datasets. |
|
extract
Package extract provides provides functions for working with compressed files
|
Package extract provides provides functions for working with compressed files |
|
filetype
Package filetype provides the implementation of custom content file type for dsort.
|
Package filetype provides the implementation of custom content file type for dsort. |
|
Package etl provides utilities to initialize and use transformation pods.
|
Package etl provides utilities to initialize and use transformation pods. |
|
runtime
Package runtime provides skeletons and static specifications for building ETL from scratch.
|
Package runtime provides skeletons and static specifications for building ETL from scratch. |
Click to show internal directories.
Click to hide internal directories.