The Right Way to Embed an LLM in a Group Chat

The Right Way to Embed an LLM in a Group Chat blog.tripjam.app/the-righ...

femto · 2 months ago

I find the first two responses "Perfect!..." and "Based on..." intensely annoying. They add nothing to the discussion and act as noise. This article crystalises a problem with AI: words are cheap to generate and expensive to read (just like spam). The AI should just do as it's asked and succinctly generate the poll. If asked "Why did you make these suggestions", it should explain why it chose those restaurants.

Edit: I'd also add that done "right" the AI should be clearly labelled as such. Its chat handle should include something like "AI", so the other chat users know exactly what they are dealing with, without having to know what "TripJam" or "TJ" is.

selfhoster11 · 2 months ago

Unless it's a reasoning model with access to its own reasoning trace, any questions of "why did you choose X" will result in a rationalization, not an explanation. The model simply doesn't know why it made the suggestion otherwise.

MongooseStudios · 2 months ago

If my friends start adding LLMs to our group chats I'm gonna be in the market for some new friends.

kenforthewin · 2 months ago

I'm with you, which is why I started the post by stating that most group chats don't need LLM assistants. But I do wonder if your friends have ever posted an AI generated image in the gc, or text you suspect was generated by LLMs? I would be very surprised if not.

phyzome · 2 months ago

I'm fairly sure no, unless you count the early days of DALL-E availability, when people were first exploring this stuff.

Most people I know are turned off by generative AI.

MongooseStudios · 2 months ago

Apples and oranges. But if they start sending me slop the outcome will be the same.

cryptozeus · 2 months ago

yeh I type in Paris, now I get a paragraph to read with random suggestions with no context to verify if these are good for me or not. If User has to figure out and make choices and tell AI to plan the trip then what is the point. It is easy for me to see nice UI with reviews, image grid and make choice based on this type of data. Why is the purpose of back and forth discussion with AI ?

quickitsaj · 2 months ago

I think a nice thing about a group chat is that the context and preferences are from users talking amongst each other instead of a long back and forth with AI

dovys · 2 months ago

I can't imagine trusting any LLM for private messaging that doesn't come as part of OS

renewiltord · 2 months ago

Having an assistant everyone can co-drive is actually kind of useful, but I don’t want it in my conversational flow.

In a temporary thread about something yeah.

bearjaws · 2 months ago

The only thing I can imagine being funny is image generation, but its usually too slow to be relevant as your conversations change.

I have a sports betting group chat "Degen Bets" that I made a funny image for the thumbnail based on our fantasy football teams.

mmoustafa · 2 months ago

nice write up! covers every consideration I had to go through while building group chat myself for https://olly.bot

leakycap · 2 months ago

... is to not embed an LLM in Group Chat.

kenforthewin · 2 months ago

I can tell you actually read the post and put a lot of thought into this response - thanks!

leakycap · 2 months ago

Just because you do not appreciate or agree with this opinion does not make it less widespread.

Deleted Comment