Retrieve a set of presigned S3 URLs that can be used for uploading data and which can be passed to the POST /uploads and POST /models/<model_id>/uploads. endpoints for creating an Uploads object in the platform. | Distil labs

curl https://https://api.distillabs.ai/staging-uploads-s3-urls \
     -H "Content-Type: application/json"

{
  "config_json": "https://staging-bucket.s3.amazonaws.com/uploads/config_20240601.json?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=abcdef1234567890abcdef1234567890abcdef1234567890abcdef1234567890",
  "config_yaml": "https://staging-bucket.s3.amazonaws.com/uploads/config_20240601.yaml?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=123456abcdef7890123456abcdef7890123456abcdef7890123456abcdef7890",
  "job_description_json": "https://staging-bucket.s3.amazonaws.com/uploads/job_description_20240601.json?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=7890abcdef1234567890abcdef1234567890abcdef1234567890abcdef123456",
  "test_data_csv": "https://staging-bucket.s3.amazonaws.com/uploads/test_data_20240601.csv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=abcdef7890123456abcdef7890123456abcdef7890123456abcdef7890123456",
  "test_data_jsonl": "https://staging-bucket.s3.amazonaws.com/uploads/test_data_20240601.jsonl?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=1234567890abcdef1234567890abcdef1234567890abcdef1234567890abcdef",
  "train_data_csv": "https://staging-bucket.s3.amazonaws.com/uploads/train_data_20240601.csv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=7890123456abcdef7890123456abcdef7890123456abcdef7890123456abcdef",
  "train_data_jsonl": "https://staging-bucket.s3.amazonaws.com/uploads/train_data_20240601.jsonl?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=abcdef1234567890abcdef1234567890abcdef1234567890abcdef1234567890",
  "unstructured_data_csv": "https://staging-bucket.s3.amazonaws.com/uploads/unstructured_data_20240601.csv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=123456abcdef7890123456abcdef7890123456abcdef7890123456abcdef7890",
  "unstructured_data_jsonl": "https://staging-bucket.s3.amazonaws.com/uploads/unstructured_data_20240601.jsonl?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIOSFODNN7EXAMPLE%2F20240601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240601T120000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=7890abcdef1234567890abcdef1234567890abcdef1234567890abcdef123456"
}

Response

Requested upload retrieved

config_jsonstringformat: "uri"1-2083 characters

config_yamlstringformat: "uri"1-2083 characters

job_description_jsonstringformat: "uri"1-2083 characters

test_data_csvstringformat: "uri"1-2083 characters

test_data_jsonlstringformat: "uri"1-2083 characters

train_data_csvstringformat: "uri"1-2083 characters

train_data_jsonlstringformat: "uri"1-2083 characters

unstructured_data_csvstringformat: "uri"1-2083 characters

unstructured_data_jsonlstringformat: "uri"1-2083 characters

Retrieve a set of presigned S3 URLs that can be used for uploading data and which can be passed to the `POST /uploads` and `POST /models/<model_id>/uploads`. endpoints for creating an `Uploads` object in the platform.

Response

Errors