The CoApply crawler

Requests with a user agent containing CoApply come from CoApply checking public careers pages that one of our users chose to watch for new vacancies.

  • It obeys robots.txt — use the user agent token CoApply to allow or disallow it.
  • It checks each page at most once an hour, usually once a day, and uses conditional requests so unchanged pages cost almost nothing.
  • It only reads publicly visible job listings. It does not submit forms on your site.