Reply To https://jamesg.blog/2022/01/10/scaling-indieweb-search/
IndieWeb Search, a search engine that indexes sites owned by IndieWeb community members and other related sites, has saved over 421,000 web documents. I maintain IndieWeb Search as a passion project. I wanted a place to search content from IndieWeb sites so that I could find articles and guides that were applicable to the community. Using the search engine, I'm able to get direct answers to niche, community-relevant queries such as how to set up webmentions with a static site or understanding what IRC is.
Check out https://searchmysite.net/. It's another independent search engine, though focused on independent websites in general, not just IndieWeb sites. Parts of it are in python and the developer has been looking for other contributors. Maybe your two projects could collaborate or they've picked up some ideas that you could use.