Anyone know why open source search engines haven't been made yet?
The problem I think of is storing all the web pages. You could scan, index, and discard and the indexed data wouldn't be big at all imo, but then to make a change to the algorithm you have to scan again...
Or you could scan and store, then index. But storing the internet, that seems huge..
hmm thx my brain hurts after reading the YaCy thing... i like it
i was thinking there could be "osse.com" with a public github and people contribute their own algorithms, and you can choose algorithm like "Ex_Redditor" if you like how the results come out
problem though is all the data..
maybe in 10 years you could get a 100 terabyte VPS for $5 (and like host your own osse)... but by then the internet is probably going to be like, illegal
(post is archived)