Readit NewsDeleted Comment
tkp-415 commented on Show HN: A MitM proxy to see what your LLM tools are sending github.com/jmuncor/sherlo... · Posted by u/jmuncor
Gemini CLI is open source. Don't need to intercept at the network when you can just add inspectGeminiApiRequest() in the source. (I suggest it because I've been maintaining a personal branch with exactly that :)
Ahh, that seems much simpler. Dump the request / response directly. Now I'm wondering if I can use Gemini to patch Gemini.
tkp-415 commented on Show HN: A MitM proxy to see what your LLM tools are sending github.com/jmuncor/sherlo... · Posted by u/jmuncor
> So is it just a wrapper around MitM Proxy?
Yes.
I created something similar months ago [*] but using Envoy Proxy [1], mkcert [2], my own Go (golang) server, and Little Snitch [3]. It works quite well. I was the first person to notice that Codex CLI now sends telemetry to ab.chatgpt.com and other curiosities like that, but I never bothered to open-source my implementation because I know that anyone genuinely interested could easily replicate it in an afternoon with their favourite Agent CLI.
[1] https://www.envoyproxy.io/
[2] https://github.com/FiloSottile/mkcert
[3] https://www.obdev.at/products/littlesnitch/
[*] In reality, I created this something like 6 years ago, before LLMs were popular, originally as a way to inspect all outgoing HTTP(s) traffic from all the apps installed in my macOS system. Then, a few months ago, when I started using Codex CLI, I made some modifications to inspect Agent CLI calls too.
Curious to see how you can get Gemini fully intercepted.
I've been intercepting its HTTP requests by running it inside a docker container with:
-e HTTP_PROXY=http://127.0.0.1:8080 -e HTTPS_PROXY=http://host.docker.internal:8080 -e NO_PROXY=localhost,127.0.0.1
It was working with mitmproxy for a very brief period, then the TLS handshake started failing and it kept requesting for re-authentication when proxied.
You can get the whole auth flow and initial conversation starters using Burp Suite and its certificate, but the Gemini chat responses fail in the CLI, which I understand is due to how Burp handles HTTP2 (you can see the valid responses inside Burp Suite).
tkp-415 commented on Show HN: Finding similarities in New Yorker covers shoplurker.com/labs/newyo... · Posted by u/tkp-415
Hey! Cool! Does your code use some of the public libs available (pHash, hmsearch,…) or did you start coding from scratch based on research papers? Can one fork a git repo?
Anyway, KUTGW
Hashes generated using https://pypi.org/project/ImageHash/, then a hamming distance is calculated with SQL.
Unfortunately I don't currently have a repo that can be forked.
tkp-415 commented on Show HN: Finding similarities in New Yorker covers shoplurker.com/labs/newyo... · Posted by u/tkp-415
I dont understand the UI at all. When I click All or something withij brackets, what am I supposed to see? Covers similar to what I clicked? But the covers I see don't seem similar to me at all no matter what I click. What am I missing? Or may be I am expecting a different kind of similarity.
The confusion is understandable as the comparison is basic and uses image hashes (https://pypi.org/project/ImageHash/), which are pretty surface level and don't always provide reliable "this image is obviously very similar to that one" results.
You are correct that when you click something in the brackets, the results returned are covers similar to what you clicked.
Still have a lot of room for improvement as I go further down this image matching rabbit hole, but the comparison's current state does provide some useful results every so often.
Deleted Comment