API Data Fetcher

API Data Fetcher builds robust data collection scripts for REST and GraphQL APIs. It handles the complex realities of API integration: pagination, rate limiting, authentication, error recovery, and data normalization. The skill produces production-quality code with proper retry logic and checkpoint-based resumption.

How It Works

1. API analysis — Reads API documentation or example responses to understand endpoints, auth, and pagination patterns
2. Script generation — Produces Python or Node.js collection scripts with proper HTTP client configuration
3. Pagination handling — Implements cursor, offset, page-number, or link-header pagination automatically
4. Rate limiting — Adds configurable delays, respects Retry-After headers, and implements exponential backoff
5. Output normalization — Flattens nested responses, handles missing fields, and writes to CSV, JSON, or database

Best For

• Collecting data from third-party APIs for analysis or migration
• Building data feeds that run on a schedule with incremental updates
• Integrating multiple APIs into a unified dataset
• Prototyping data collection before committing to a full ETL pipeline

Reliability Features

Checkpoint files allow resuming interrupted collections. Exponential backoff with jitter prevents thundering herd. Dead letter queues capture failed requests for manual retry. All responses are logged with timestamps for audit trails.