Breadth-first web crawler with retries
In your own IDE, write a crawler that walks a given website breadth-first from a start URL, normalizing URLs and retrying requests that fail. API docs are allowed; AI tools are not.
No answer yet. Write the first one; the best answer gets endorsed.
