gradient-ai/

Command cancel-model-evaluation-run cancels an in-progress model evaluation run via the GradientAI API.

Command create-model-eval-dataset-upload-presigned-urls creates presigned URLs that can be used to upload model evaluation dataset files via the GradientAI API.

Command create-model-evaluation-run creates a new model evaluation run via the GradientAI API.

Command delete-model-evaluation-preset deletes a saved model evaluation preset via the GradientAI API.

Command get-model-evaluation-preset retrieves a saved model evaluation preset via the GradientAI API.

Command get-model-evaluation-run retrieves a model evaluation run, including the run summary, aggregated result metrics, and a paginated list of per-prompt results, via the GradientAI API.

Command get-model-evaluation-run-results-download-url returns a presigned download URL for a model evaluation run's results (gzip-compressed JSON) via the GradientAI API.

Command list-evaluation-datasets lists evaluation datasets via the GradientAI API.

Command list-model-evaluation-metrics lists all available metrics that can be selected when creating a model evaluation run, via the GradientAI API.

Command list-model-evaluation-presets lists all saved model evaluation presets via the GradientAI API.

Command list-model-evaluation-runs lists model evaluation runs, optionally filtered by preset UUID, status (single or multiple), candidate model source types, and free-text search.