How do you guys pay for this? I guess the potential for abuse is huge.
OpenAI-compatible endpoint: https://ch.at/v1/chat/completions (supports streamed responses)
Also accessible via HTTP/SSH/DNS for quick tests: curl ch.at/?q=… , ssh ch.at Privacy note: we don’t log anything, but upstream LLM providers might...
Also, I wonder if this could be adapted to use Apple's Hypervisor.framework. That one also doesn't require root and ought to be able to spin up and down very quickly.
It has not been expensive to operate so far. If it ever changes we can think about rate limiting it.
We used GPT4o because it seemed like a decent general default model. Considering adding an openrouter interface to a smorgasbord of additional LLMS.
One day, on a plane with WiFi before paying, I noticed that DNS queries were still allowed and thought it would be nice to chat with an LLM over it.
We are not logging anything but OpenAI must be...
However, we don't parse markdown on the server and convert to HTML. Rather, we just prompt the model to emit HTML directly.
It has not been expensive to operate so far. If it ever changes we can think about rate limiting it.
We used GPT4o because it seemed like a decent general default model. Considering adding an openrouter interface to a smorgasbord of additional LLMS.
One day, on a plane with WiFi before paying, I noticed that DNS queries were still allowed and thought it would be nice to chat with an LLM over it.
We are not logging anything but OpenAI must be...
Here’s a reseller with a variety: https://1-single-letter-domains.com/
These guys run a bunch of services on x.xx domains: https://o.ee/services/ like c.im, r.nf, p.lu.