remotejobs.co.za-bot
This is the crawler behind remotejobs.co.za, a job board for remote and hybrid roles open to people in South Africa. If you found this page from a User-Agent in your server logs, this is who we are.
What it fetches
Public job feeds only: the job board APIs and feeds that employers and job boards publish for this purpose. It does not log in, does not fill in forms, and does not fetch pages that need an account. It follows robots.txt and crawl delays, with one exception: the Remotive public API, which the Remotive API documentation invites developers to use although its robots.txt disallows the path.
How often
Each feed is fetched a few times a day at most, one request at a time. Feeds that ask for a slower pace get a slower pace.
What we do with it
We show the job title, company, location, a short excerpt and a link to the original posting, with credit to the source. Applications always happen at the source.
How to be removed
If you run a site or a job board that we fetch from and you want us to stop, write to bot@remotejobs.co.za with the domain. We switch that source off and take its listings down.
How to recognise it
The User-Agent is:
remotejobs.co.za-bot (+https://remotejobs.co.za/bot; bot@remotejobs.co.za)