multitool

multitool

Swiss army knife to work with the dataset. Written in Go, easy to install and use.

The following commands exist:

• discover - extract the needed information from GHTorrent MySQL dump on the fly. Requires only 1.5 GB of storage.
• select - compile the list of repositories to clone according to various filters, such as stars or languages.
• get-index - download the index file of the latest dataset generated by source{d}.
• get-dataset - download the Siva files from the specified list.

Installation

There are 64-bit binaries for Linux, MacOS and Windows on Releases page.

Build from source

go get -v github.com/src-d/datasets/PublicGitArchive/multitool