July 19, 2020
Use Varnish to block bad bots
Use Varnish to block bad bots:
sub vcl_recv { if (req.http.User-Agent ~ "AspiegelBot" || req.http.User-Agent ~ "AutoKeyboard" || req.http.User-Agent ~ "Virus-Schutz" || req.http.User-Agent ~ "Dataprovider" || req.http.User-Agent ~ "YandexMetrika" || req.http.User-Agent ~ "Clarabot" || req.http.User-Agent ~ "cotoba_bot" || req.http.User-Agent ~ "baiduboxapp" || req.http.User-Agent ~ "DuckDuckGo-Favicons-Bot" || req.http.User-Agent ~ "360Spider" || req.http.User-Agent ~ "404checker" || req.http.User-Agent ~ "404enemy" || req.http.User-Agent ~ "80legs" || req.http.User-Agent ~ "Abonti" || req.http.User-Agent ~ "Aboundex" || req.
Read more