Kagi uses Google as one of its sources for search results so should be able to return the same reddit results as Google.

Doesn't seem like it. Can you get it to return a reddit result from the last 6 weeks?

Try this:

https://kagi.com/search?q=remarkable+pro+site%3Areddit.com

It includes Reddit results from less than 24 hours ago.

Ah hmm. Maybe they are doing something special with "site:reddit.com" queries.

If I search for that exact Reddit post using the lens it isn't there. https://kagi.com/search?q=ReMarkable+Paper+Pro+hands-on+revi...

Well, there never was any law that required robots.txt to be honored. Big players like Google do, but I am not aware of any consequences if they wouldnt (of course UNTIL it is then regulated).

Curiously this link seems to show the "Academic" lens. Switching to the "Forums" lens pulls it right up for me.

The lens ID in the URL doesn't look to be globally unique. It's just l=<number>, and the number seems to be order in the lens list under your account.

For me it doesn’t show up in your link with the full article title but with this one it’s the 3rd result or so: https://kagi.com/search?q=remarkable+pro+hands+on+review

I don't think there's anything special; I very often get new-reddit results with no 'site:' qualifier. I can't think of a specific query offhand, but it happens multiple times daily for me.

I'm able to search a post I made a couple weeks ago: https://kagi.com/search?q=%22union_of%22+site%3Areddit.com

I really think it's crazy how a big site like that can get away with locking out everybody else but the search giant with a monopoly.

Yeah, it seems blatantly anti-competitive to me and I'm surprised we haven't seen the EU say anything about it yet.

Old Reddit (and other website) content might actually be more valuable given the higher likelihood of newer posts being spam/AI bot posts.

That disregards the fact that facts change over time.

If you google “best DSLR camera reddit” it’s much less valuable if the results are 5 years old, even if they’re LLM free - the cameras on the market may very well have changed in that timeframe.

What? Old reddit isn't using old facts.

I skimmed down and if this was about Kagu indexing being out of date then sorry I just realized that

Not "Old reddit" as in https://old.reddit.com. "Old Reddit" as in "Older stuff on reddit before they gave access only to Google".