Here it’s being used for web application firewall rules.
Another place I’ve thought about using this is feature flag configuration. Feature flags can be checked dozens of times per request and often need the kind of queries (user is a member of group A and has an IP located in country B) which could be well served by a local SQLite - and feature flags have a tolerance for updates taking a few seconds (or longer) to roll out.
That being said, robocalls are bs in general. What I'm saying is not an excuse for robocalls.
I actually thought this is where the next big AI company would come from. A gaming company that created a game that also had a business use case. They would use the data from that game to train ML models that were capable of doing work. If someone were able crowd source some AI robot training through gaming, they would be paid by consumers and by businesses. Kind of like how captcha digitized books in the backend.
User speaks and speech to text starts streaming text while the user is still speaking. That text stream is piped into a LLM, which also streams its output text. That output text is streamed to text-to-speech, which also generates audio in a streaming manner.