YaCy, free software for your own search engine:

• https://yacy.net/

• https://github.com/yacy/yacy_search_server

• Build your own search engine with YaCy: https://www.techradar.com/how-to/build-your-own-search-engine-with-yacy

• Personal internet search engine with YaCy: https://www.kvakil.me/posts/2022-07-03-yacy-private-search-engine.html

• Personal search engine with YaCy: https://orchid.pink/yacy/ (has some useful scripts and tips)

• YACY for Beginners: https://www.seleads.com/yacy-for-beginners/

• [[memos/J4d9jhQ59f5guqQKWUXfjM]]

A tip when crawling is to always disable "Accept URLs with query-part ('?')" for any website, except when totally necessary (eg. phpBB forums, which write the topic id in the query part), otherwise effectively duplicate pages will be enlisted for the majority of sites, degrading the search.

There's also the Searchlab portal which I don't exactly understand:

• https://searchlab.eu

• Searchlab Web Demo: https://searchlab.eu/en/app/websearch_yaml4/