csv2json

csv2json

Fast, simple, and extensible CSV to JSON converter for developers with PostgreSQL integration.

This is the public repository containing installation steps, usage examples, and documentation

Features

• Upload CSV files via REST API
• Automatic CSV to JSON conversion
• PostgreSQL database storage for all converted data
• JSONB support for efficient querying
• Connection pooling and optimized database operations

Prerequisites

• Go 1.24 or higher
• PostgreSQL 12 or higher

Database Setup

1. Install PostgreSQL if not already installed
2. Create a database for the application:

CREATE DATABASE csv2json;

1. Configure database connection using environment variables (see .env.example)

The application will automatically create the required tables on startup.

Installation

1. Clone the repository:

git clone <repository-url>
cd csv2json-api

1. Install dependencies:

go mod download

1. Set up environment variables:

cp .env.example .env
# Edit .env with your PostgreSQL credentials

1. Run the application:

go run cmd/api/main.go

Environment Variables

API Endpoints

Upload CSV

POST /api/upload
Content-Type: multipart/form-data

Upload a CSV file and convert it to JSON. The data is automatically saved to PostgreSQL.

Example:

curl -X POST http://localhost:8080/api/upload \
  -F "file=@sample.csv"

Response:

[
  {
    "column1": "value1",
    "column2": "value2"
  }
]

Get All Data

GET /api/data

Retrieve all stored CSV data from the database.

Example:

curl http://localhost:8080/api/data

Response:

[
  {
    "id": 1,
    "filename": "sample.csv",
    "data": [...],
    "created_at": "2026-01-27T10:30:00Z"
  }
]

Get Data by ID

GET /api/data/id?id={id}

Retrieve a specific CSV data record by its ID.

Example:

curl http://localhost:8080/api/data/id?id=1

Response:

{
  "id": 1,
  "filename": "sample.csv",
  "data": [...],
  "created_at": "2026-01-27T10:30:00Z"
}

Health Check

GET /api/health

Check if the API is running.

Response:

{
  "status": "healthy"
}

Database Schema

The application creates the following table:

CREATE TABLE csv_data (
    id SERIAL PRIMARY KEY,
    filename VARCHAR(255),
    data JSONB NOT NULL,
    created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP
);

The data column stores the converted JSON data as JSONB, allowing for efficient querying and indexing.

Development

Run tests:

go test ./...

License

See LICENSE file for details.