1 Dec
2018
1 Dec
'18
8:03 a.m.
Heya,
Does anyone know the useragent(s) for the crawlers?
We're using Mirrorbits internally but it's causing us to look like we're down on mirror-status.c.o so I was going to selectively proxy for just the crawlers
Theo