sources/searchhut
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Commit graph

  • 24e6800e36 Update domain request URL master Drew DeVault 2022-07-15 09:25:19 +0200
  • 2b6407eacb cmd/sh-api: add metric for GraphQL query duration Simon Ser 2022-07-14 17:10:24 +0000
  • 541d829069 cmd/sh-api: register Prometheus DB stats collector Simon Ser 2022-07-14 17:10:18 +0000
  • a34b5f0331 cmd/sh-api: add /metrics handler for Prometheus Simon Ser 2022-07-14 17:10:14 +0000
  • b3a5803c0c crawler: ignore 405 responses for HEAD requests Umar Getagazov 2022-07-14 22:56:11 +0300
  • 8b11febce0 web: answer HEAD requests Umar Getagazov 2022-07-14 22:44:47 +0300
  • 62540cce61 web: responsive layout at /about Umar Getagazov 2022-07-14 22:37:43 +0300
  • 562fecf2f2 index: add announcement link Drew DeVault 2022-07-15 08:57:41 +0200
  • c2c75b565a Display search query time on results page Drew DeVault 2022-07-13 15:34:29 +0200
  • 3e62c61e8f main.css: ellipsize overflow in excerpt Drew DeVault 2022-07-13 15:17:53 +0200
  • c364bc316f import/xkcd: new importer Drew DeVault 2022-07-13 14:54:40 +0200
  • cc0c144528 Switch search to rum rankings (<=>) Drew DeVault 2022-07-13 14:23:08 +0200
  • 8941c46191 Use ts_rank_cd rather than <=> Drew DeVault 2022-07-13 11:25:48 +0200
  • 1c2252bc83 .gitignore: add sh-admin Drew DeVault 2022-07-13 11:16:06 +0200
  • 778b4c41c1 Use RUM operators for ranking Drew DeVault 2022-07-13 10:29:10 +0200
  • 731950a326 crawler: trim excerpt Drew DeVault 2022-07-13 10:26:22 +0200
  • 9473f3b49b import/*: fix page_size issues Drew DeVault 2022-07-13 10:24:26 +0200
  • 69a9e20a0a sh-admin: new command Drew DeVault 2022-07-13 10:20:35 +0200
  • 69cf99e367 schema: add default for domain tags Drew DeVault 2022-07-13 10:20:27 +0200
  • cbd3732deb Store page size in the database Umar Getagazov 2022-07-11 20:03:27 +0700
  • 7f555e21f5 web: match alert's dark theme colors with sr.ht Umar Getagazov 2022-07-11 23:04:34 +0300
  • 00a37d0b48 import/mediawiki: use namespace IDs for filtering Taavi Väänänen 2022-07-12 16:15:14 +0300
  • 82d73c6e31 schema: use rum index Drew DeVault 2022-07-13 10:13:54 +0200
  • ed9031a3a3 API: add index size to stats Drew DeVault 2022-07-11 21:38:29 +0200
  • 53eefd6787 crawler: fix log message Drew DeVault 2022-07-11 21:31:20 +0200
  • 19a9a3a3b5 sh-index: add -u flag to add URLs to schedule Drew DeVault 2022-07-11 20:55:39 +0200
  • 009b2b31d4 web: add total pages indexed to home page Drew DeVault 2022-07-11 20:40:53 +0200
  • 13d5f95eab import/mediawiki: drop File: pages Drew DeVault 2022-07-11 20:22:35 +0200
  • 74b26cecfa import/mediawiki: more improvements Drew DeVault 2022-07-11 19:30:57 +0200
  • 5689b79e13 import/cve.org: truncate content for excerpt Haelwenn (lanodan) Monnier 2022-07-11 18:41:50 +0200
  • 062e63437a import/cve.org: New importer Haelwenn (lanodan) Monnier 2022-07-11 17:00:06 +0200
  • fde8b75efd Drop crawl schedule-related fields Umar Getagazov 2022-07-11 18:47:38 +0700
  • a7e6fba60f Rank authoritative websites and index pages higher Umar Getagazov 2022-07-11 19:59:35 +0700
  • 72649f0f0e Truncate page titles and URLs in search results Umar Getagazov 2022-07-11 19:55:51 +0700
  • 2971603710 Put domain labels minus eTLD into the text index Umar Getagazov 2022-07-11 19:58:34 +0700
  • c6777e21a7 schema.sql: set default exclusion list to {} Drew DeVault 2022-07-11 17:48:15 +0200
  • 5848adfea0 mediawiki: don't parse until we know we want it Drew DeVault 2022-07-11 14:35:22 +0200
  • 4567044626 import/mediawiki: delete elements when done Drew DeVault 2022-07-11 14:27:21 +0200
  • 5471687556 Add per-domain page exclusion mechanism Umar Getagazov 2022-07-10 10:29:12 +0700
  • ef32533b75 Fix searchut typo in the config file path Umar Getagazov 2022-07-10 10:35:53 +0700
  • 3b056cc0b4 Dark theme Umar Getagazov 2022-07-10 11:01:24 +0700
  • 50fd2562f5 Highlight result title in bold Drew DeVault 2022-07-11 13:16:47 +0200
  • dda780c694 UI fixups for f449fe8 Umar Getagazov 2022-07-10 08:36:35 +0700
  • 67c60ef5c1 Use the real crawler UA at /about Umar Getagazov 2022-07-10 10:34:54 +0700
  • 3bc5cd9689 Responsive UI Umar Getagazov 2022-07-10 08:35:28 +0700
  • f449fe8a32 Semantic/a11y markup improvements Rohan Kumar 2022-07-09 12:29:54 -0700
  • 76bc26d639 Adding missing /about bits Drew DeVault 2022-07-10 15:02:55 +0200
  • 7a67438e9c Add favicon Umar Getagazov 2022-07-10 07:40:20 +0700
  • c367bbddd3 Add about page Drew DeVault 2022-07-10 13:07:00 +0200
  • c8762965ac import/mediawiki: initial commit Drew DeVault 2022-07-10 11:11:18 +0200
  • e44770b9b7 schema: add "source" column to page Drew DeVault 2022-07-10 10:13:11 +0200
  • d30cdbf52e crawler: fix interval input Drew DeVault 2022-07-10 09:55:30 +0200
  • 01b2b1349b crawler: compute checksum and make unique Drew DeVault 2022-07-10 09:36:07 +0200
  • 9790813a55 Track pages with JavaScript and total crawl time Drew DeVault 2022-07-10 09:07:37 +0200
  • e15dffd86b Handle Retry-After as timestamp Drew DeVault 2022-07-09 19:16:48 +0200
  • c15f968a28 crawler: re-schedule after HTTP 429 Drew DeVault 2022-07-09 19:13:46 +0200
  • 6978b602f4 Handle canonical URLs Drew DeVault 2022-07-09 19:06:28 +0200
  • baf82f9bb8 crawler: perform HEAD before GET Drew DeVault 2022-07-09 18:59:23 +0200
  • 759ad758af crawler: improve index settings Drew DeVault 2022-07-09 18:57:39 +0200
  • 35a4faa05b sh-index: fetch user agent from config Drew DeVault 2022-07-09 18:14:06 +0200
  • 2ec534d63a Add Makefile Drew DeVault 2022-07-09 18:14:00 +0200
  • 3535309004 web: add link to index from search page Drew DeVault 2022-07-09 18:07:46 +0200
  • b41abd9376 main.css: change URL color in results Drew DeVault 2022-07-09 17:51:05 +0200
  • 7140d0e2e5 web: add search results page Drew DeVault 2022-07-09 17:48:52 +0200
  • 6e5deed8f4 web: add .index to html tag Drew DeVault 2022-07-09 17:14:00 +0200
  • 738a9430cb web: autofocus search box Drew DeVault 2022-07-09 17:11:04 +0200
  • ad9dd2701e web: move infolinks to bottom of page Drew DeVault 2022-07-09 17:02:58 +0200
  • a1f6b8c8de sh-web: initial commit Drew DeVault 2022-07-09 16:55:40 +0200
  • 8cf92fa220 API: Implement search resolver Drew DeVault 2022-07-09 15:48:03 +0200
  • c1f917efb4 sh-api: expand top-level server riggings Drew DeVault 2022-07-09 15:39:04 +0200
  • 0d32cf49d7 Implement configuration loader Drew DeVault 2022-07-09 15:31:16 +0200
  • 09f762ca53 Add config.example.ini Drew DeVault 2022-07-09 13:53:02 +0200
  • b5656c9a1e database: add middleware Drew DeVault 2022-07-09 13:52:55 +0200
  • 208f766963 Initial GraphQL API riggings Drew DeVault 2022-07-09 13:25:27 +0200
  • a8069bb73b Increase default delay to 5 seconds Drew DeVault 2022-07-08 20:56:00 +0200
  • 92ca0ecf22 Add README.md Drew DeVault 2022-07-08 20:55:55 +0200
  • d6bc032d24 crawler: respect robots.txt Drew DeVault 2022-07-08 20:30:09 +0200
  • eb6769c904 crawler: follow links regardless of readability Drew DeVault 2022-07-08 20:13:32 +0200
  • fbd0492ef1 cmd/sh-search: initial commit Drew DeVault 2022-07-08 20:04:37 +0200
  • 050694c4f2 Initial commit Drew DeVault 2022-07-08 19:46:11 +0200