Shackles (u/Shackles)

Shackles commented on Show HN: SlickGPT slickgpt.vercel.app/... · Posted by u/Shackles

thrwy_918 · 2 years ago

It's very slow when typing characters in the input field. It feels like a react application that's doing a bunch of component re-rendering on every keypress.

Shackles · 2 years ago

Got it, it's a bug and happens because of the token calculation. We'll fix it. Thanks for reporting.

Shackles commented on Show HN: SlickGPT slickgpt.vercel.app/... · Posted by u/Shackles

detrites · 2 years ago

> SlickGPT allows you to run your own local ChatGPT instance

No, it doesn't. If it did, it would be a 700GB+ download and not need OpenAI API keys. Wish folks would stop saying it.

Shackles · 2 years ago

You're right. Fixed wording in our README on Github, can't edit HN post. Thanks

Shackles commented on Show HN: SlickGPT slickgpt.vercel.app/... · Posted by u/Shackles

solumunus · 2 years ago

This. There is very noticeable latency when typing. This is on a very powerful desktop PC using Chrome. If you hold down a character on your keyboard it shows the issue more clearly, the input will sporadically appear every few seconds.

Shackles · 2 years ago

Okay, this shouldn't happen. Please create a GitHub issue, I'll investigate.

Shackles commented on Show HN: SlickGPT slickgpt.vercel.app/... · Posted by u/Shackles

manojlds · 2 years ago

Yeah I don't even understand the point of this SlickGPT.

Shackles · 2 years ago

It's a userfriendly web client for the latest OpenAI chatCompletion API with additional features compared to the official chat.openai.com client (mainly: "Share chats" & better param customization), it's Open Source and can be run locally or self-hosted easily. It's built in one of the most popular frontend tech stacks of the last years. Not more and not less than that.

Shackles commented on Show HN: SlickGPT slickgpt.vercel.app/... · Posted by u/Shackles

jasonjmcghee · 2 years ago

For it to be good, it should also have a specific system prompt and chat history, which is fed to the model. With langchain this isn’t too difficult to build, but it’s not just a web ui.

This one doesn’t appear to use a custom prompt, so I’m guessing it doesn’t perform as well as ChatGPT, but it does look like it passes message history.

Shackles · 2 years ago

SlickGPT passes message history including a "context" or "system" message which it clearly explains to the user at the start of every chat. This is probably the most important thing the official chat.openai.com client fails to explain or expose to users directly.

Shackles commented on Show HN: SlickGPT slickgpt.vercel.app/... · Posted by u/Shackles

zb3 · 2 years ago

Typing is very slow, that needs to be fixed.

Shackles · 2 years ago

Do you mean if you type something or if you retrieve the answer/completion from ChatGPT? Which model are you using?

Shackles commented on Show HN: SlickGPT slickgpt.vercel.app/... · Posted by u/Shackles

filenox · 2 years ago

As with other OpenAI based applications, I don't feel comfortable sharing my private API key with an application I don't know. Especially when the webpage isn't telling me what this app is about. I suggest adding a small demo video or at least adding some bullets on what this app is trying to solve.

Shackles · 2 years ago

I get that fear and it's fair. SlickGPT is OS, self-hostable and just runs locally, so you can check the code and run your own instance if you don't trust that ours running on Vercel is on-par with the one in the repo. You can also put a soft and hard cap on your API quota on the OpenAI page and monitor it to verify that only you are using it.

The key is passed (see https://github.com/ShipBit/slickgpt/blob/main/src/lib/ChatIn...) to a Vercel edge function (see https://github.com/ShipBit/slickgpt/blob/main/src/routes/api...) that does the actual call to the OpenAI API. This function is stateless and doesn't store anything. I also put it in your localStorage using a store (see https://github.com/ShipBit/slickgpt/blob/main/src/misc/store...) so that you don't have to enter it over and over again.

As for the "what is this trying to solve" - read our documentation in the GitHub repo over at https://github.com/ShipBit/slickgpt.