Drew DeVault
|
c15f968a28
|
crawler: re-schedule after HTTP 429
Fixes: https://todo.sr.ht/~sircmpwn/searchhut/5
|
2022-07-09 19:14:55 +02:00 |
|
Drew DeVault
|
6978b602f4
|
Handle canonical URLs
Fixes: https://todo.sr.ht/~sircmpwn/searchhut/11
|
2022-07-09 19:06:28 +02:00 |
|
Drew DeVault
|
baf82f9bb8
|
crawler: perform HEAD before GET
Implements: https://todo.sr.ht/~sircmpwn/searchhut/8
|
2022-07-09 18:59:23 +02:00 |
|
Drew DeVault
|
759ad758af
|
crawler: improve index settings
|
2022-07-09 18:57:39 +02:00 |
|
Drew DeVault
|
35a4faa05b
|
sh-index: fetch user agent from config
|
2022-07-09 18:14:06 +02:00 |
|
Drew DeVault
|
2ec534d63a
|
Add Makefile
|
2022-07-09 18:14:00 +02:00 |
|
Drew DeVault
|
3535309004
|
web: add link to index from search page
|
2022-07-09 18:07:46 +02:00 |
|
Drew DeVault
|
b41abd9376
|
main.css: change URL color in results
|
2022-07-09 17:51:05 +02:00 |
|
Drew DeVault
|
7140d0e2e5
|
web: add search results page
|
2022-07-09 17:48:52 +02:00 |
|
Drew DeVault
|
6e5deed8f4
|
web: add .index to html tag
|
2022-07-09 17:14:00 +02:00 |
|
Drew DeVault
|
738a9430cb
|
web: autofocus search box
|
2022-07-09 17:12:23 +02:00 |
|
Drew DeVault
|
ad9dd2701e
|
web: move infolinks to bottom of page
|
2022-07-09 17:02:58 +02:00 |
|
Drew DeVault
|
a1f6b8c8de
|
sh-web: initial commit
|
2022-07-09 16:56:25 +02:00 |
|
Drew DeVault
|
8cf92fa220
|
API: Implement search resolver
|
2022-07-09 15:48:03 +02:00 |
|
Drew DeVault
|
c1f917efb4
|
sh-api: expand top-level server riggings
|
2022-07-09 15:39:04 +02:00 |
|
Drew DeVault
|
0d32cf49d7
|
Implement configuration loader
Implements: https://todo.sr.ht/~sircmpwn/searchhut/18
|
2022-07-09 15:31:16 +02:00 |
|
Drew DeVault
|
09f762ca53
|
Add config.example.ini
References: https://todo.sr.ht/~sircmpwn/searchhut/18
|
2022-07-09 13:53:02 +02:00 |
|
Drew DeVault
|
b5656c9a1e
|
database: add middleware
|
2022-07-09 13:52:55 +02:00 |
|
Drew DeVault
|
208f766963
|
Initial GraphQL API riggings
|
2022-07-09 13:25:27 +02:00 |
|
Drew DeVault
|
a8069bb73b
|
Increase default delay to 5 seconds
|
2022-07-08 20:56:00 +02:00 |
|
Drew DeVault
|
92ca0ecf22
|
Add README.md
|
2022-07-08 20:55:55 +02:00 |
|
Drew DeVault
|
d6bc032d24
|
crawler: respect robots.txt
|
2022-07-08 20:30:09 +02:00 |
|
Drew DeVault
|
eb6769c904
|
crawler: follow links regardless of readability
|
2022-07-08 20:13:32 +02:00 |
|
Drew DeVault
|
fbd0492ef1
|
cmd/sh-search: initial commit
|
2022-07-08 20:04:37 +02:00 |
|
Drew DeVault
|
050694c4f2
|
Initial commit
|
2022-07-08 19:46:11 +02:00 |
|