Readit Newspkress2 commented on Large Language Models for Mortals: A Practical Guide for Analysts with Python crimede-coder.com/blogpos... · Posted by u/apwheele
I’m always curious why local models aren’t being pushed more for certain types of data the person is handling. Data leakage to a 3rd party LLM is top on my list of concerns.
Worth noting that AWS Bedrock makes it easy to have zero retention with premier claude models. Not quite local, but it feels local-adjacent for security while getting affordable access to top-performing models... GCP appears to be a bit harder to set this up.