sources/searchhut
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
searchhut/crawler
History
Umar Getagazov b3a5803c0c crawler: ignore 405 responses for HEAD requests 
It also skips header checks because they usually don't have headers we
need (for example, most omit the Content-Type header).

Fixes: https://todo.sr.ht/~sircmpwn/searchhut/41
2022-07-15 08:58:21 +02:00
..
crawler.go crawler: fix log message 2022-07-11 21:31:20 +02:00
index.go crawler: ignore 405 responses for HEAD requests 2022-07-15 08:58:21 +02:00