This is a feature request: Main structure and feature requests
My initial idea would be to cooperatively gather a list of urls that the search engine, hosted on awesystems.info for example, would periodically crawl.
Related, if you have files on your own computer that you want to search: [Wiki] Wiki Creation and Editing Guide - #41 by Windy_Skies
This topic is on deciding on if this is something we want to try, and what software to use for the search engine. I don’t think Google search is giving me good results anymore and I don’t know of other search engines, so I’m interested in exploring this a bit.
Maybe it can also be the basis for an rss feed.
Some first random results:
https://www.reddit.com/r/selfhosted/comments/1365035/wiby_build_your_own_search_engine_of/
https://www.reddit.com/r/devops/comments/stlp21/has_anyone_tried_to_develop_a_search_engine_i/
https://www.reddit.com/r/YouShouldKnow/comments/1gu6e3v/ysk_google_allows_you_to_make_a_custom_google/
Or first results on building a web crawler:
Web Crawler - How to Build a Custom Crawler
https://www.reddit.com/r/webscraping/comments/l449dz/does_anyone_know_good_resources_to_build_a_web/
https://www.reddit.com/r/webscraping/comments/qdttnz/wanting_to_build_a_web_scraper_with_no_prior/