Has this happened to anyone else?
Readit Newsmveertu commented on CoreWeave deactivated account with no notice-Only wants to work with large users · Posted by u/mveertu
We have a cloud offering at https://trypromptly.com. We do offer enterprises the ability to host their own vector database to maintain control of their data. We also support interacting with open source LLMs from the platform. Enterprises can bring up https://github.com/go-skynet/LocalAI, run Llama or others and connect to them from their Promptly LLM apps.
We also provide support and some premium processors for enterprise on-prem deployments.
Enterprises can bring up https://github.com/go-skynet/LocalAI, run Llama or others and connect to them from their Promptly LLM apps - So spin up GPU instances and host whatever model in their VPC and it connects to your SaaS stack? What are they paying you for in this scenario?
Explicitly calling out that they are not going to train on enterprise's data and SOC2 compliance is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes.
From our discussions with enterprises (trying to sell our LLM apps platform), we quickly learned how sensitive enterprises are when it comes to sharing their data. In many of these organizations, employees are already pasting a lot of sensitive data into ChatGPT unless access to ChatGPT itself is restricted. We know a few companies that ended up deploying chatbot-ui with Azure's OpenAI offering since Azure claims to not use user's data (https://learn.microsoft.com/en-us/legal/cognitive-services/o...).
We ended up adding support for Azure's OpenAI offering to our platform as well as open-source our engine to support on-prem deployments (LLMStack - https://github.com/trypromptly/LLMStack) to deal with the privacy concerns these enterprises have.
So, how do you plan to commercialize your product? I have noticed tons of chatbot cloud-based app providers built on top of ChatGPT API, Azure API (ask users to provide their API key). Enterprises will still be very wary of putting their data on these multi-tenant platforms. I feel that even if there is encryption that's not going to be enough. This screams for virtual private LLM stacks for enterprises (the only way to fully isolate).
mveertu commented on New scripting framework for automating macOS UI actions github.com/veertuinc/anka... · Posted by u/mveertu
We built a new framework to automate UI actions on macOS This framework enables you to write automation for UI actions in more behavior-driven steps and not worry about UI system inconsistencies like retries, timeouts, etc. Right now, this framework is exposed to work in Anka macOS VMs. We plan to expose this framework to work on non-virtualized macOS systems.
mveertu commented on Scanning downloads on macOS in realtime for security vulnerabilities veertu.com/real-time-cont... · Posted by u/mveertu
mveertu commented on Scanning downloads on macOS in realtime for security vulnerabilities veertu.com/real-time-cont... · Posted by u/mveertu
Does it support Nix packages?
I just tried downloading it from https://nixos.org/download.html#nix-install-macos and it looks like the scan doesn't detect it. I am asking our developer how quickly we can add it to the mac scan tool.
mveertu commented on Scanning downloads on macOS in realtime for security vulnerabilities veertu.com/real-time-cont... · Posted by u/mveertu
Detect known security vulnerabilities in real-time in packages, libraries, and all sorts of downloads on your macOS. If you are a developer using a mac machine, you end up downloading all kinds of frameworks and libraries. Mac Scan detects known security vulnerabilities in real-time on all these downloads.