Worth the Pitch helps speakers discover calls for speakers, conference programs, and event announcements. Our crawler visits public pages that search results or event feeds point to, reads them once, and extracts the event details speakers need.
How it identifies itself
Every request sends this user agent:
SpeakerOpportunityBot/0.9 (+https://worththepitch.com/bot)
What it does
- Fetches individual public HTML or plain-text pages, one at a time, with timeouts and a size limit.
- Checks your
robots.txtbefore each fetch and skips anything it disallows. - Never logs in, submits forms, or requests private network addresses.
- Keeps a copy of the page text for a limited time to extract event details, then discards it.
How to control it
To block the crawler from your whole site, add this to robots.txt:
User-agent: speakeropportunitybot Disallow: /
To keep it out of one section only:
User-agent: speakeropportunitybot Disallow: /private-section/
Rules for User-agent: * apply as well whenever no group names our bot specifically.