bulk-file-loader

Bulk File Loader

Automated bulk data download manager for patent data from EPO, USPTO, and DPMA.

Features

• Download bulk patent data from EPO BDDS, USPTO ODP, and DPMA Connect Plus
• Web UI for configuration and monitoring
• CLI for scripting, cron jobs, and data pipeline integration
• Automatic scheduled downloads with retry
• Webhook notifications
• Multi-database support (SQLite, PostgreSQL, MySQL)

Quick Start

Web UI

docker run -p 8080:8080 -v ./data:/app/data patentdev/bulk-file-loader serve

Open http://localhost:8080 and set your passphrase.

CLI

# Set passphrase (protects stored credentials)
export BULK_LOADER_PASSPHRASE=my-secret

# Enable a data source
bulk-file-loader source enable epo-bdds --username user@example.com --password secret

# Sync and download everything
bulk-file-loader pull

Files are downloaded to ./data/downloads/. See docs/cli.md for the full CLI reference.

Common CLI commands

bulk-file-loader source ls                               # list sources
bulk-file-loader product ls --source epo-bdds            # list products
bulk-file-loader file ls --status available               # list available files
bulk-file-loader download all --source epo-bdds           # download all available
bulk-file-loader file ls -q --status failed | xargs \
  bulk-file-loader file download                          # retry failed
bulk-file-loader status --format json                     # machine-readable status

Configuration

Environment variables:

Related Projects

Part of the patent.dev open-source patent data ecosystem:

• uspto-odp - USPTO Open Data Portal client (search, PTAB, XML full text)
• epo-ops - EPO Open Patent Services client (search, biblio, legal status, family, images)
• epo-bdds - EPO Bulk Data Distribution Service client
• dpma-connect-plus - DPMA Connect Plus client (patents, designs, trademarks)

License

MIT - See LICENSE