Politeness and rate limiting #7

Open

Assignees

Labels

opened

on Jun 23, 2024

Respect the robots.txt rules.
Implement rate limiting to avoid overwhelming web servers.

Metadata

Assignees

devwraithe

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests