Readit News logoReadit News
Posted by u/7moritz7 2 years ago
Ask HN: How to do literal web searches after Google destroyed the “ ” feature?
I used this quite frequently but since Google """"improved"""" it last year (there was a popular HN post complaining about this) it doesn't work anymore. Search for a domain name with quotation marks for example just recombines the contents of the domain and returns a bunch of unrelated content completely cluttering what I am looking for. Until last year it used to return no search results if there weren't any exact matches, which is the whole point.

Does someone have a work around for this phenomenal Google decision?

TradingPlaces · 2 years ago
Kagi. Never have I been so happy to send someone $10 every month. When you become the customer, not the product, it’s amazing what can happen.
netsroht · 2 years ago
Being logged in while making search queries in search engines poses significant privacy risks. The searches can paint a comprehensive profile of the user, and these data often remain stored for extended periods. There's a chance this information might be shared with third parties. Coupled with other user data, these logged-in searches can pave the way for targeted advertising, sophisticated predictive analysis, and potential exploitation by governments or malicious entities. In the event of data breaches, the user's logged-in search histories can be exposed. Furthermore, users typically don't have clear insight into how their data is utilized when logged in.

I hope Kagi introduces an anonymous access feature. For instance, it could incorporate zero-knowledge proofs (ZKPs). These are cryptographic techniques where one party (the prover) can confirm to another (the verifier) that a claim is accurate without disclosing any additional information. This is especially beneficial for authentication scenarios where it's essential to avoid sharing extra details.

To implement zero-knowledge authentication for quota API access:

1. Token Creation:

- Each month, users receive a token tied to their identity and quota.

- The token can be split for use on multiple devices using cryptographic methods.

2. API Access:

- Clients present a zero-knowledge proof (ZKP) to confirm they have a valid token and haven't used up their quota. The server verifies this without seeing the exact details.

3. Client Synchronization:

- Each client tracks its quota usage.

- Synchronization can be peer-to-peer or through a centralized, encrypted server to prevent double spending of the quota.

4. Quota Renewal:

- Monthly, old tokens expire, and new tokens are issued.

Challenges:

- ZKPs can be resource-intensive.

- Token security is crucial; there should be a way to handle lost or compromised tokens.

- The system should prevent quota "double-spending" across devices.

- If a centralized server is used for synchronization, it should operate with encrypted data.

This way Kagi would only know who their customers are but not what kind of searches they make.

freediver · 2 years ago
Kagi already provides a way to search anonymously via a random email address (we do not really verify it or need it for anything) and Bitcoin/Lightning payment [1].

Since you are interested in cryptography, there is a discussion on Kagi feedback site along the same lines as your idea, about possible ways to achieve this without the need for cryptocurrency. [2]

[1] https://blog.kagi.com/accepting-paypal-bitcoin

[2] https://kagifeedback.org/d/653-completely-anonymous-searches...

boredpudding · 2 years ago
Any system that can check balance, can link searches to a user. There's no way around it. In your case, Kagi would need to trust the client with the balance, which would be insecure.

There's only one solution, and that is that you need to put a bit of trust in Kagi. Compared to the major one, Google, you can chose between one that promises to not store data, and one that promises it does (and does a lot).

It's always a bit sad that here on HN, when companies try to do better than bigger players, there's always people who think it isn't enough. It has to be absolutely impossibly perfect.

EA-3167 · 2 years ago
I'm not searching for anything terrifyingly illegal, and for the rest Google and MS already scrape and compile every byte of data I've ever generated. Why would it suddenly be a problem when a more reliable and less vicious company is doing a fraction of that?

You have to understand that most of us aren't fighting some battle for "perfect privacy," I just want a search engine that works for me, rather than advertisers, at the level of the search results themselves.

andrewinardeer · 2 years ago
> Being logged in while making search queries in search engines poses significant privacy risks. The searches can paint a comprehensive profile of the user, and these data often remain stored for extended periods. There's a chance this information might be shared with third parties. Coupled with other user data, these logged-in searches can pave the way for targeted advertising, sophisticated predictive analysis, and potential exploitation by governments or malicious entities. In the event of data breaches, the user's logged-in search histories can be exposed. Furthermore, users typically don't have clear insight into how their data is utilized when logged in.

This reads and smells like ChatGPT / AI.

SkyPuncher · 2 years ago
I’ve gotten tired of these boogey man arguments.

There are sooooo many other ways to fingerprint than an account.

Oh look, this MacBook with X by Y resolution from this IP address has had 100 searches for the past 2 hours. Oh no! He switched to incognito.

snide · 2 years ago
100% agree on Kagi. Happy customer. Thought it would be just another one of my attempts to use Duck Duck Go that dies after two weeks of !g usage. Turned out Kagi just works. The biggest improvement / gains is on mobile, where you suddenly don't need to scroll through 5 screens of ad results to get to the content.
giancarlostoro · 2 years ago
I wonder if part of why its better is due to other users providing feedback about results, but also you can pin results from specific domains to the top. Like I can pin any results from StackOverflow, instead of the garbage StackOverflow rip off sites Google keeps giving me, its pretty obvious its ripping off SO because I just read the same thing word for word on StackOverflow three links ago. Thanks Google.
baja_blast · 2 years ago
Yeah, me personally I am more upset with how irrelevant and bad Google search results have become than I am worried about privacy. I know and have accepted that Google invades my privacy, but the trade off used to be I could find whatever I am searching for, but now I can't find anything on Google and it has made my job so much harder.

The Google search algorithm from 5 years ago was amazing, why they decided to change it for the worse is something I will never understand! And no I do not blame SEO entirely since that existed 5 years ago, what I am often looking for but can no longer find is information that has nothing to do with any products. It's not ads that I need to page through, but unrelated and bad results that are limited. I do not want to see the same results from page 1 on page 3.

lghh · 2 years ago
Weird question that I have that I'd love anyone who makes a Kagi account to trial after reading the parent comment to answer:

When you make your account, you're given the option to customize. When you do, you can pick things like color theme and how URLs are displayed. On the right hand side of the page there is a preview of what your Kagi searches will look like.

In my example, the demo Kagi search is Magic The Gathering. I play a lot of Magic The Gathering. I spend most of my time online searching for things related to MtG or brewing decks, second only to things related to software development.

I imagine it's coincidence. MtG is a pretty nerdy hobby and Kagi seems like a pretty nerdy product. However, it made me uncomfortable enough to ask:

Is that what it shows for everyone? Or is there some tracking going on already that is being demoed? It's almost certainly the former given the positioning of Kagi in the search market, but I'd like to be sure.

freediver · 2 years ago
Vlad here, Kagi founder. Also an avid MTG player. I came up with the idea for that preview.
joshmlewis · 2 years ago
Yes it's what showed for me as well and I've never played or searched it. Just a coincidence.
jamal-kumar · 2 years ago
I'm kind of blown away by how popular that game has gotten over the past few years in North America. I think the pandemic really accelerated the popularity of that and D&D, people are still doing these things after all of that. Even saw someone playing over the phone the other day. I don't seem to remember it being so popular but now it's more than ever and hardly a surprise tbh
anymouse123456 · 2 years ago
This.

Kagi is incredible and worth every penny simply for being able to remove the SEO scam and tire fire that is Pinterest from all image search results.

yieldcrv · 2 years ago
I’ve replaced most of my google searches with LLM discussions and some bullshit checking

I usually only need to understand a concept, not understand if the personnel and company names it made up actually exist

everything else I use google for are just addresses

so I’m wondering if a paid search engine would shift my behavior back to search engines, or if that ship has just sailed

freediver · 2 years ago
LLMs can not yet replace good web search. There are whole categories of queries whera a LLM is more or less helpless with. Think navigational queries, shopping /reviews, location aware, 'grep the web' style queries just to name the few.

For example:

nyt crossword

cheap iem reddit

starbucks near me

M7FFALP

Likely, a good search product in the future will be a combnation of both.

vdqtp3 · 2 years ago
> I usually only need to understand a concept

You should know by now that LLMs will and do lie in subtle ways that are not apparent to non-experts. Using them to understand complicated concepts is a great way to "learn" incorrect information. To be fair, the same can be said for humans, but humans are worse at bullshitting.

zeroonetwothree · 2 years ago
I tried it a little but honestly thinking about having a limit of searches made me anxious every time I thought about searching like “is this really necessary” and so I went back to google.
yzydserd · 2 years ago
Kagi searches are soon to be unlimited (fair use policy?) for the $10 plan. If I understand correctly, this may happen around October 2 when other new features are released.

I use search a lot in my workflow and my usage is showing 2k/month. I expected it would have been 3-4k.

JohnFen · 2 years ago
Why not just ignore that the limit exists? If you hit it, you can always fall back to another search engine, after all, so it shouldn't be cause of anxiety.
alwaysbeconsing · 2 years ago
I can offer that I am constantly online and using Kagi across my devices for all searches and so far have not come close to using up my quota.
dominick-cc · 2 years ago
I would love to see some of these privacy-focused providers like Kagi and Tutanota/Protonmail align themselves into a "bundle"-type offering (think video game humble bundles) where for like $35/month you got access to a bunch of useful tools like this. It would really expose a lot of people to services they aren't super familiar with already, so even if it was at a slight discount to the provider, they would acquire a lot of new users I bet.
effingwewt · 2 years ago
Indeed. I'm tired of data brokers masquerading as other things (search, email, whatever).

Signed up for Kagi today and have been looking for a permanent gmail solution.

Had this bundle been available today I'd have jumped on it.

delboni · 2 years ago
Does anyone knows how Kagi performs on country specific search or even search in another languages?
jaktet · 2 years ago
One personal anecdote. It did not do that great for Norway/Norwegian, I ended up switching back to google when trying to find some stuff in stores.

For recipes and stuff it was fine.

benhurmarcel · 2 years ago
It works fine in French for me. I really like that I can have international search by default, and specify a country when needed using a bang like !fr.
janaagaard · 2 years ago
Working fine for me with Danish as my primary language. But I think that I mostly search for English content, so unsure how your experience will be.

But could you not just pay for a month and try it? I don’t think their plans bind you for a longer than a month.

jamal-kumar · 2 years ago
You sold me.

Fuck google, I have work to do. Thanks for the tip! Nice realizing that they've basically been wasting my time for a while now and that there's a decent alternative available.

hospadar · 2 years ago
Can’t second this emotion hard enough, love it, have never looked back, almost never bail out to !g - still use g maps for most location stuff, but all my web search is very comfortably living on kagi
kup0 · 2 years ago
Another happy customer here as well. I use at work and home and plan to start using on mobile browsers also.

The ability to essentially "weight" particular domains (pin, block, or anywhere in between) has saved me so much time. There are certain searches I do (music-related in particular) where I always want particular sites (metal-archives, bandcamp, etc) to be the first results, and having that as an option is great. It means that searches that I perform often have a result within the first 1-5 results that is exactly what I want.

No ads, way less SEO spam, and the ability to completely remove domains from results if I think I need to tweak it further. For most of my searches I previously used Google for- Kagi makes Google's results look laughably bad.

I've also been using it at work for tech searches (linux, redhat, etc) and it has saved me time there too.

I use a "family" account- and have one work account and one home account that way I can have different settings for different environments (would be neat if this could be built into non-family accounts though... like "personas" or "profiles" or something...) because I'm overpaying a bit to have the two account setup and don't reach the search cap. I think I'm okay with that though, because having the cap so high means I've removed the "running out of searches" anxiety from my usage of the service.

lofaszvanitt · 2 years ago
Kagi copied the same lame-ass google search experience.

Search engines should be able to support even those who are not SEO experts and not the first ones to arrive and sit on specific keywords. What I mean under that, if you have multiple good, exhaustive answers for a query, why not offer varying/random good results, so every link would have a chance? Let people break out of their bubbles.

Same power pyramid scheme. Yukk.

m3kw9 · 2 years ago
“ Our data includes anonymized API calls to traditional search indexes like Google, Mojeek and Yandex”. They pay google to do this?
jjice · 2 years ago
I believe DuckDuckGo does (or at least they did) this with Bing. Starting a new scraper at a scale that users would need to be useful for what they're used to is such a huge jump. I'm sure if Kagi continue to grow they'd prioritize their own scraping too, but that's just not feasible at first.
jerrre · 2 years ago
that's what that means yeah, but not necessarily present it in the same way
dcminter · 2 years ago
I'm just trying Kagi out now, having done about 2 searches of my initial free 100. So far one was better than google and the other no worse. The "no worse" one was for something where I already suspect there aren't any good results to find.

Fingers crossed, but I have a good feeling about it. If it goes well the pricing seems fair.

metadaemon · 2 years ago
Happy customer here! Been paying for a year with no complaints. Amazing search engine -- kind of like how Google used to be years ago before they started injecting more ads into search.
bloopernova · 2 years ago
Do you ever go past the 1,000 search "limit"?

I'm considering signing up; it would be one fewer service I'm relying on google for.

boredpudding · 2 years ago
I was quite afraid of this, but apparently I'm around 700-800 searches a month and I search quite a lot during my work.

Kagi is also working on removing the 1000 limit on the 10$ subscription and offering unlimited searches.

Switching from the 5 $ plan to 10 $ was super smooth by the way, so if you want to try for less $, the 5 $ for a month is enough so you can get used to the product and know if you like it or not (and that's besides the 100 free you get while signing up for a trial).

TradingPlaces · 2 years ago
I do 500-600 a month pretty regularly. They provide stats.
AndrewKemendo · 2 years ago
What happens if GOOG acquires Kagi?
MichaelZuo · 2 years ago
I'm sure many folks, including me, would be willing to help Vlad organize a private acquisition if he suddenly had some pressing need to sell.

Deleted Comment

replwoacause · 2 years ago
This is the answer. I’ll never use Google search again.
notemaker · 2 years ago
How does it fare for bilingual users?
hrbrmstr · 2 years ago
100% ^^this^^
sneak · 2 years ago
You have to use a special "verbatim" search product from Google, it isn't the main search box anymore. Look under Advanced or something.
crazygringo · 2 years ago
First of all, wow. It's there (under Tools, you don't even need to go to Advanced), it works, and yet I've never once seen anybody talk about that feature's existence on HN until now. And people have been complaining about not being able to do verbatim searches for years and years here on HN.

Second, I just looked up when this feature was introduced (assuming it was fairly new), and it was in... November 2011. It's been there for the past twelve years. See:

https://www.wired.com/2011/11/google-verbatim-search-back/

https://searchengineland.com/responding-to-complaints-google...

https://www.searchenginewatch.com/2011/11/18/google-introduc...

Thanks for letting us know! It's been right under our noses the whole time -- and it's not like the Tools menu is even particularly hidden, at least on desktop.

marcosdumay · 2 years ago
> I've never once seen anybody talk about that feature's existence on HN until now

Every time I tried it, it didn't work.

It certainly changed a lot on those years, but the reason nobody acknowledges it is probably because it's a coin-toss if Google wants "verbatim" to mean verbatim today.

Quotes actually stopped working (they became a hint, instead of filtering the results) a long time ago, and many people insisted for years that the verbatim search worked. Probably because those tried it on the days when Google decided to use a standard dictionary. Nowadays even those people gave-up.

gniv · 2 years ago
There's been lots of talk about it over the years: https://www.google.com/search?q=google+%22verbatim%22+site%3...

I think I also mentioned it a couple of times when the same complaint came up.

The problem I think is that "verbatim" is not a word that one thinks of, so nobody searches for that. Plus it's hidden in a generic "Tools" menu. Sometime you get a link to search for the exact phrase at the bottom of results, but that too is subtle.

Izkata · 2 years ago
On the search results page, there's a "Tools" button in the upper-right that expands two dropdowns. Change "All results" to "Verbatim".
robertlagrant · 2 years ago
Wow, that's a good tip.
tda · 2 years ago
Great tip! Seems like this adds the query param "&tbs=li%3A1", so this might be something you can configure as an extra search engine in firefox. But then I am a happy kagi customer, and I was just thinking that I can't recall the last time I had to do a !g to find something. For me, google search si pretty much dead. I only use it now when on someone else's pc
chankstein38 · 2 years ago
Sounds like a good case for an extension even! "Auto add this when I go to google"
tivert · 2 years ago
> You have to use a special "verbatim" search product from Google, it isn't the main search box anymore. Look under Advanced or something.

I actually use that, but it has its faults. You get more spam results and iffy sites (e.g. Wikipedia clones). It's also missing some of Google's convenient features (like doing unit conversions and arithmetic).

IIRC, Verbatim mode is closer to the raw results of Google's underlying search engine, before some of the massaging they do. Some of that massaging is bad, but some of it's all right.

jamal-kumar · 2 years ago
Why would they make their very expected functionality something you have to dig around to find now? That just seems like really bad decision making that should have been spotted by someone on top and screams that the people on top are now disconnected from reality.

I swear that it used to work for certain strings I'm trying to find now which I was able to find information on and now it isn't even returning, with "verbatim" set, something that is in a very well-known program's documentation. Bing finds like three results. Google has dropped the ball so hard it's embarrassing

kuchenbecker · 2 years ago
My guess (complete speculation, but I worked with the Search Quality folks about a decade ago):

1 - By interpreting your search, it leads to better "search quality" by having one model say "i think this is what they want" and another execute the search. P90 accuracy is increased at the cost of P99 accuracy.

2 - If you search for a literal string you know exists, you expect to find it. By interpreting, fewer search inputs with literal strings make it to the search function.

3 - Since Google is interpreting more searches, this gives ad-placement a route in to favorably interpret "they want to buy something" even when this isn't the case. This makes Google money.

4 - People that used to use literal searches either stop, learn how, or switch search engines.

5 - After a couple years, business metrics show that literal searches represent 0.1% of queries and make less money, is it really worth investing in? When it was a P99 issue it fell off the radar and now the P999 is lost.

So a series or rational decisions by rational actors leads to a decline of a used feature because of business incentives and chasing P90s at the cost of P99s.

jplona · 2 years ago
It's also possible they they're correct, and the average user of today has much less need for verbatim searches than the average user when the search engine was first designed.
chankstein38 · 2 years ago
Yeah, it's Google. I feel like, at this point, Google is basically synonymous with "bad decision"
zulban · 2 years ago
I thought this was a joke.
helboi4 · 2 years ago
What it is like anti-user design. Why take away a decades long precedent to hide it in a menu?
mannykannot · 2 years ago
For now, this seems to work: https://www.google.com/advanced_search but, given the pace at which Google "improves" things, I don't have much hope that it will last.
gniv · 2 years ago
That page has been there forever. Here's the version from Dec 2000: https://web.archive.org/web/20001202041000/https://www.googl...
fergie · 2 years ago
I agree that as a programmer who frequently needs to search for long literal strings verbatim, Google has become notably less useful than it used to be.

I wonder if there is now a gap in the market for some kind of "literal" search engine that makes no attempt to infer meaning on your search terms and simply gives you the closest results? In other words Google ca 2012.

btown · 2 years ago
https://publicwww.com/ is a great tool for this, though the size of its index leaves a lot to be desired. Still, for enumerating well-SEO'd homepages that use a certain tech stack, it's quite useful!
xtracto · 2 years ago
For technical stuff I've long replaced Google search with phind.com even just pasting so.e generic error spit from the console works.
minikomi · 2 years ago
Have you tried grep.app ?
dannysullivan · 2 years ago
I was on vacation when this came up, so playing some catch up. I work for Google Search. I've been very involved with the concerns raised about quoted searches last year, especially because they never stopped working. They do work.

We did make an update last year to better reflect where quoted content appears on a page in the snippets we show. We did this because sometimes it's hard to find the quoted material on the page itself, leading to the "quotes don't work" issues.

This post explains more about this: https://blog.google/products/search/how-were-improving-searc...

The post also explains things like how with punctuation, we'll ignore that -- which leads to the "example.com" type of issue you might be having. If you're quoting a domain name, we're likely seeing that as "name com" rather than a request to just search within the domain. If you want to just search within the domain, that's what site: is for such as [site:example.com whatever you want to search for]

cwoolfe · 2 years ago
When this happened to me, I found better results on https://duckduckgo.com/
mkl · 2 years ago
Duck Duck Go has similar problems for me. It's also recently started sometimes ignoring the "-" when you try to exclude a word.
yegg · 2 years ago
We put out a partial fix for that recently and a more complete fix is forthcoming.
Qwertious · 2 years ago
I think the "-" is case-sensitive sometimes. So if you write "-honey" it'll still return "Honey" results, so you have to write "-honey -Honey".
sen · 2 years ago
I’ve used DDG exclusively for a couple years now and at least with my usecases have found it better than Google in every single way other than images (which I still use it for, but need to do !g to proxy Google maybe 1 in 5 times).
notRobot · 2 years ago
FYI: !gi on DDG for direct Google Images search.
cassianoleal · 2 years ago
I find better results on it in general.

I use Google as a fallback but these days it happens perhaps once every couple months, and mostly I don't get anything out of it.

Turing_Machine · 2 years ago
Yes. IMO DDG has been better for general questions for a long time.

Google remained better for programming questions for significantly longer (I speculate this may be because Google's own programmers used it, and complained when the results sucked :-)), but now it's not. Not really.

Like you, I still use Google as a long shot, but that's become quite rare.

I sometimes use Bing for Microsoft-specific questions, if DDG doesn't give me what I want. I have the sense that Bing covers Microsoft a little better than the others do. I have no real solid evidence for this, but it seems plausible on the surface.

inductive_magic · 2 years ago
It depends on the usecase. If you're querying for something local like a restaurant or a store, google wins by orders of magnitude. If you're researching, duckduckgo is fine. Duckduckgo doesn't really compare to Kagi though.
ComputerGuru · 2 years ago
DDG has started injecting completely untreated recent news stories to the results of a search with few hits. Like searching for a programming error with specific class names will give you several articles about the woes of the Democratic Party in recent days!!
felurx · 2 years ago
Same for me, but with location-related stuff. I often see random Wikipedia articles or tourism websites for stuff near the city my IP address is from... Worst of all, sometimes there's a block of filler results between actual results, so I sometimes give up and don't see some of the results that might've been what I was looking for.
DoItToMe81 · 2 years ago
Are you sure this isn't from SEO on the part of the news sites? I have not seen this at all.
johnwayne666 · 2 years ago
Have you tried using "Tools -> Verbatim"?
rbinv · 2 years ago
+1, this is the only way to get old-school(ish) results, even without explicit quoting. Unfortunately, it can't be enforced just by adding parameters to the URL and has to be selected manually every time. (edit: actually it can, see below)

Verbatim really highlights how almost useless the default mode has become.

ChoGGi · 2 years ago
You can add it with parameters: tbs=li:1

    https://www.google.com/search?tbs=li:1&num=30&safe=off&q=test

isaacfung · 2 years ago
Like ChoGGi said, you can use tbs=li:1 You can test the other parameters here.

https://serpapi.com/playground?q=The+most+popular+fruit+in+t...

Other useful parameters, you can use nfpr to force it to not correct your search terms

https://serpapi.com/blog/filtering-google-search-and-google-...

userbinator · 2 years ago
I see that the quotes in your title are not regular ASCII quotes. I agree that Google's search result quality has been quite horrible, but could the fact that your system is somehow not emitting "real" quotes also be the cause? I've seen plenty of problems caused by those horrid "smart" quotes in the past.
naillo · 2 years ago
Just give up on trying to make google work. Google has definitely not improved. Recently I tried searching "hugginface madebyollin" (with a slight type to hugginface instead of huggingface) and it literally didn't show the obvious result. https://www.google.com/search?q=hugginface+madebyollin. I've switched to duckduckgo and couldn't be happier.