Readit News logoReadit News
vood commented on We built a modern data stack from scratch and reduced our bill by 70%   jchandra.com/posts/data-i... · Posted by u/jchandra
TZubiri · 6 months ago
If it's only for cost savings it's a hard sell.

But generally rolling your own has other benefits.

vood · 6 months ago
Rolling your own generally has mainly downsides in the context they are in. 1. This is clearly a small team with very little spend 2. Tomorrow someone leaves and next engineer will have to manage all of this. 3. I don't think they realize that they actually increased cost of this service not decreased it. Now they need to manage their own Kafka monthly. Engineering time is expensive.
vood commented on Ask HN: Is anybody getting value from AI Agents? How so?    · Posted by u/reilly3000
vood · a year ago
I do. I use assistants as containers for different conversations for my GTM work: An assistant for marketing and copywriting An assistant for customer support An assistant sales conversations.

These agents aren't super smart: just few PDFs for context plus a few sentences system prompts.

I do get what I want in 80% of use cases (not measured, just a feeling).

vood commented on Claude 3 model family   anthropic.com/news/claude... · Posted by u/marc__1
CorpOverreach · a year ago
This part continues to bug me in ways that I can't seem to find the right expression for:

> Previous Claude models often made unnecessary refusals that suggested a lack of contextual understanding. We’ve made meaningful progress in this area: Opus, Sonnet, and Haiku are significantly less likely to refuse to answer prompts that border on the system’s guardrails than previous generations of models. As shown below, the Claude 3 models show a more nuanced understanding of requests, recognize real harm, and refuse to answer harmless prompts much less often.

I get it - you, as a company, with a mission and customers, don't want to be selling a product that can teach any random person who comes along how to make meth/bombs/etc. And at the end of the day it is that - a product you're making, and you can do with it what you wish.

But at the same time - I feel offended when I'm running a model on MY computer that I asked it to do/give me something, and it refuses. I have to reason and "trick" it into doing my bidding. It's my goddamn computer - it should do what it's told to do. To object, to defy its owner's bidding, seems like an affront to the relationship between humans and their tools.

If I want to use a hammer on a screw, that's my call - if it works or not is not the hammer's "choice".

Why are we so dead set on creating AI tools that refuse the commands of their owners in the name of "safety" as defined by some 3rd party? Why don't I get full control over what I consider safe or not depending on my use case?

vood · a year ago
This is a weird demand to have in my opinion. You have plenty of applications on your computer and they only do what they were designed for. You can't ask a note taking app (even if it's open soured) to do video editing, unless you modify the code.
vood commented on Show HN: I made an app to use local AI as daily driver   recurse.chat/... · Posted by u/xyc
code51 · 2 years ago
Thank you for the work.

Please take this in a nice way: I can't see why I would use this over ChatbotUI+Ollama https://github.com/mckaywrigley/chatbot-ui

Seem the only advantage is having it as MacOS native app and only real distinction is maybe fast import and search - I've yet to try that though.

ChatbotUI (and other similar stuff) are cross-platform, customizable, private, debuggable. I'm easily able to see what it's trying to do.

vood · 2 years ago
Thanks for sharing ChatbotUI. While I'm not an author, I use it extensively and contribute to it. Thanks to the permissive license, I could offer ChatbotUI as a hosted solution with our API keys. https://labs.writingmate.ai.
vood commented on Representation Engineering: Mistral-7B on Acid   vgel.me/posts/representat... · Posted by u/alexmolas
vood · 2 years ago
This is very well written and entertaining post. I enjoyed reading it.

Selfishly, would you mind sharing literature or blog posts that led you to this level of understanding of LLMs? I'm trying hard to understand the inner workings via experiments but definitely far behind your expertise.

Thanks

vood commented on Veritasium: The SAT Question Everyone Got Wrong [video]   youtube.com/watch?v=FUHkT... · Posted by u/goplayoutside
vood · 2 years ago
I'm surprised that only 3 people reported the error.

While problem is not trivial, my initial reaction was "it can't be 3, it's too obvious". And it seems that a lot of people in the comments here do get to the right answer on their own.

So, why not hundreds of reports?

vood commented on Ask HN: What are you grateful for?    · Posted by u/marclave
vood · 2 years ago
I'm grateful to have parents who in their age, have energy, health and financial freedom to join us for celebrations from overseas. I'm grateful for my parents to be friends to me and all my friends.

As someone said here, I'm extremely grateful for free quality higher education I have received in my home country. And I'm saddened that many are in student debts for decades.

I'm grateful to be in the best health I've been in last 10 years.

I'm grateful to myself for quitting alcohol more than a year ago and sticking with it.

I'm grateful, for the first time, to feel financially stable for many years to come.

I'm grateful to United States of America for being our home and safe harbor for the past 10 years, especially last 3, given the global instability.

vood commented on Show HN: nbi.ai – Generative Business Intelligence   narrative.bi/ai... · Posted by u/fromthegut
vood · 2 years ago
Hey folks, I'm a free customer here and a big-big fan of their project. I've been using narrative.bi for my project and sharing the results on Twitter [1] lately.

How I'm using narrative.bi: - A high-level report of WoW, and MoM changes on our website traffic that land in my email. - Alternative to GA4 UI, which drives me nuts.

What I don't get yet and I want to see implemented (I'll definitely pay for this): - Dimensional analysis: Which dimensions contribute to the topline change the most. I.e. Say unique users increased by 30% WoW, what top 5 dimensions have contributed to this change? Country? Device? Etc - Global event correlation: are there any global events that influence the metrics change? Maybe a holiday in the Country?

[1] https://twitter.com/avysotsky/status/1723403222906286185

u/vood

KarmaCake day62November 22, 2013
About
Software engineer. Building https://writingmate.ai/labs.
View Original