Prompt
Why does this dataset API only return partial exports?
Latest observation
There are a few common reasons a dataset API returns only a partial export instead of the full dataset:
1. Pagination / result limits
Many APIs cap how many records you can get in one response, often returning only the first page unless you request more pages explicitly.
- Look for parameters like
limit,offset,page,cursor, ornext_token - Check the response for pagination metadata or “next page” links
2. Export job not finished
If the API is asynchronous, the first request may only create an export job, and the actual file is generated later. If you download too early, you may get an incomplete file.
- Look for a job status endpoint
- Make sure the export status is
completedbefore downloading
3. Permissions / access restrictions
Your API key or account may only have access to part of the dataset.
- Some records may be hidden by workspace, project, or role permissions
- The API may intentionally exclude restricted or private rows
4. Filters applied by default
The API might apply default filters you didn’t notice, such as:
- date ranges
- “active only” records
- sample mode
- environment-specific filters
5. Rate limits or timeouts
For large exports, the API may stop early due to:
- request timeouts
- server-side export size limits
- rate limiting during chunked retrieval
6. File format or export scope
Some APIs only export a subset of fields or records depending on the chosen format or endpoint.
- Example: one endpoint returns summary data, another returns raw rows
- CSV/JSON exports may exclude nested or binary fields
How to diagnose quickly
Check these in order:
- API docs for max page size and export limits
- Response headers/body for pagination tokens or continuation URLs
- Export status if it’s an async job
- Your filters/query params to make sure you’re not narrowing results
- Account permissions to confirm full access
If you want, paste:
- the API endpoint,
- a sample response,
- and how you’re calling it,
and I can help identify the exact reason it’s only returning partial exports.