arXiv API Rate Limits: Ingest Papers Without Getting Blocked
arXiv capped author submissions on Oct 1, 2026, and its API allows one request every three seconds. Here’s a compliant ingestion blueprint for RAG: incremental harvest, caching, backoff, bulk S3, WARC snapshots, and version tracking.