{{template "head.html" .}}

searchhut

About searchhut

SearchHut is a curated free software search engine developed and operated by SourceHut.

About the search engine

The search engine itself is pretty basic at the moment. In the future, it will be expanded to support narrowing down your search terms by applicable tags (e.g. #docs #python), filtering for sites with and without JavaScript, searching specific sites (e.g. @wikipedia.org), and other features. The service does not (and will never) have advertising and is directly subsidized by SourceHut.

About the index

SearchHut indexes from a curated set of domains. The quality of results is higher as a result, but the index covers a small subset of the web. The index prioritizes authoritative, high-quality, and informative sources. Any websites engaging in SEO spam are rejected from the index. This instance is maintained by free software developers and biases towards indexing websites that serve their needs and interests. If you would like a website added to the index, fill out the indexing request form.

About the crawler

The SearchHut crawler is very simple. It crawls websites by queuing first-party links only, and stores data in a simple Postgres full-text-search index. The crawler respects robots.txt Allow, Deny, and Crawl-Delay directives. For the full details on how the crawler works, and for information for web admins of indexed sites, see the documentation. {{if .CrawlerUA}}

The crawler's User-Agent is:

{{.CrawlerUA}}
{{end}}

About the API

The search engine provides a public GraphQL API for anonymous use, allowing users to conduct web searches programmatically. For information about the API, see the documentation.

About the software

SearchHut is an AGPL 3.0-licensed free software project hosted on SourceHut, which provides git repositories, a bug tracker, and mailing lists for development & discussion. Patches are welcome, and users are encouraged to set up their own search engines crawling whatever subset of the web they like. It could be easily repurposed to create an academic-focused search engine, for instance. For information about deploying your own instance, see the documentation.

{{template "footer.html" .}}