I come here for the convos. But I also commute in a car, and I exercise with headphones.
I want like a radio show made of segments. Each segment is a post with the best conversations between users. Use a generative Ai voice service (like Coqui), and have it speak the comments aloud.
Then I can listen to interesting chatter through my headphones.
You have to add articles yourself and it does not have any special logic for HN threads yet.
More detailed instructions in the script but the general idea is: 1. When a channel publishes a new video IFTT puts a text file with youtube link in Dropbox 2. Script downloads audio from youtube 3. Justcast.com free tier to turn a Dropbox folder into a podcast feed
The SSE endpoint is required for use cases like chat so the end user doesn't have to wait until the whole reply has been generated.
I started implementing a simple SSE client on top of C#/.Net's HttpClient but it's harder than I first assumed.
The problem is that there is no way to validate the feedback on scale. I.e., we can't receive statistics about the feedback from the API.
In contrast, for our own Entity Recognition models we can (and do) calculate probabilities that explain why a certain entity is shown.
Hence, I think for API users of GPT3, OpenAI should return additional statistics why a certain result is returned the way it is to make it really useful and more importantly compliant.
If that’s not helpful, were you getting at having the model return some rich data about the attention weights that went into generating some token?
https://www.biorxiv.org/content/10.1101/2022.07.13.499906v1