It doesn't work well at all. (Also alpaca.cpp uses 8GB of RAM for a 4GB model, possibly because they don't know how mmap works.)
alpaca lora is quite capable actually and is suddenly gaining a hell of a lot of traction in the corporate world
Readit Newsdachryn commented on Transformer architecture optimized for Apple Silicon github.com/apple/ml-ane-t... · Posted by u/behnamoh
dachryn commented on Transformer architecture optimized for Apple Silicon github.com/apple/ml-ane-t... · Posted by u/behnamoh
yes, there are billions of parameters necessary. but large language models only came out about 5 years ago. I'm confident 5 years from now the parameters necessary to get gpt-4 performance will be decreased orders of magnitude.
at the very least, even if that's not the case, inference will be drastically less gpu heavy by then I suspect.
dont underestimate how many of those parameters are actually necessary to support multiple languages.
If you focus on english only, this can easily reduce the paramters 5fold
Of course it is for PR, it would be really dumb to not publicize it.
It would absolutely work in a sense. Of course the CEO will not get a real experience and of course no one will bring any real grievances to him. But the CEO will still get some exposure to day to day. It is still somewhat better than not doing it at all. It’s a good precedent to set and one can only hope more CEOs would follow
you are underestimating the impact of programs like this.
The CEO will quickly spot broken processes and inefficiencies. Ass kissing can't make up for business problems. Beyond that, by working in a different store, gets a feel on how generic the approach can be, and where they need local optimizations.
The only think you are taking out of the consideration is toxic lower management and asshole colleagues, but that's not something I'd expect the CEO to fix directly himself. If anything he is just bored of the ass kissers and good news shows, and wants to regain a feel of reality
dachryn commented on Swiss Are on the Hook for $13,500 Each on Credit Suisse Bailout bloomberg.com/news/articl... · Posted by u/paulpauper
Stuff like this will lead to the rise of socialism again tbh.
It's like Tucker Carlson said - it's no wonder that the young people support socialism, when they can't afford a house and face massive economic uncertainty even in professional fields, etc.
Everyone knows that the super-rich executives will benefit massively from this (or have already taken huge bonuses and dividends in prior years), and they basically run the government and will face no consequences.
They get rewarded for failure, meanwhile normal working people face mass lay-offs, high interest rates and high inflation.
the execs definitely miss out on a lot of money because bonus programs are typically multi year.
There are always -short term (how did we do this year, the classic everyone gets) -long term (bonus defined today, paid out over a few years if you meet the strategic goals, typically director and exec level, we are easily talking 100k+/year here in bonus money)
bonusses. So, yeah, still a financial letdown for them. But they still got paid quite a lot of money of course. The average swiss person had no stakes or no culpability at all (except maybe choosing them, clients could have walkd away)
dachryn commented on The new Bing runs on OpenAI’s GPT-4 blogs.bing.com/search/mar... · Posted by u/vitorgrs
Do they? Doesn't Microsoft continue supporting products for way longer than is reasonable?
on paper, in practice they don't kill products, they just die because of mismanagement.
Google is the other hand, they kill products outright even when there is still life in it.
With microsoft you can pay for extended support, but its pretty basic. They don't fix bugs, its only 'security issues'
dachryn commented on The new Bing runs on OpenAI’s GPT-4 blogs.bing.com/search/mar... · Posted by u/vitorgrs
My god, just release it already!, I don't want to be stuck in some kind of waitlist, giving data for a product I am not sure if I'm going to use!
I tried phind.com, and I got burned quickly when I asked it about serving caddy releted and it answered with a non existing parameter.
the openAI playbook
They are brilliant at marketing (look at DALL-E). But then stable diffusion comes along etc and they need to prove their worth against competition. I am afraid Microsoft is not handling this well
dachryn commented on Serverless maps at 1/700 the cost of Google Maps API protomaps.com/blog/server... · Posted by u/dcre
Google Map 10X their price on a single price change.
Never trust Google Cloud or run any production servers with them. They have zero empathy for you.
Just today, we got screwed by Google Cloud (as a 4 yrs customer) when they abruptly shutdown our production servers just because we didn't fill up a form on-time.
My story: https://twitter.com/Ryan_Liao/status/1634103410525077504 (happens today) [Link Updated]
a 400 month customer is really a tiny fish, don't expect special treatment without support packages. Do you even have an enterprise contract with them? The bronze contract can be had from 0 spend, and gives the option to pay through invoicing and have support. Or are you just going through credit card which is intended for hobby use?
I am not defending them, but this is totally on you. What was the missing information? Lack of identity verification or credit card verification? Again that's on you. You should have also received a warning in the cloud console and if you hvae the cloud app on your phone, there as well.
dachryn commented on Towards quantum computers that are robust to errors nature.com/articles/d4158... · Posted by u/bookofjoe
dachryn commented on Databricks counts being laid off as “red flag” teamblind.com/post/Databr... · Posted by u/flurly
Not only is Databricks a deplorable company when it comes to HR, but their product is terrible. I really don't get what it's all about. Much rather spin up my choice of a python notebook, have my own underlying data storage, etc.
I really don't understand how they got so big so quickly? Was it all hype? VCs helping close deals?
it's simple: Many companies are on Azure for some reason. (mainly because of preexisting microsoft contracts, and because its so tightly coupled with office that if you want office at the enterprise level, you always need a little of Azure)
Now, those companies need data infrastructure. Azure ML studio is horrible. Azure data factory is somewhat okay'ish, but far from ideal. Azure Synapse is a steaming pile of junk that doesn't seem to improve. Azure data lake is kinda functional as a data lake, but lacks any decent ways to analyze that data.
Spinning up jupyter notebooks is not something most IT teams understand, they want a managed service.
As far as I know, Databricks is then the only solution offered by Microsoft. That's why they get such a high adoption rate. Not because of merit, but because they are the only somewhat acceptable solution on Azure. Good enough to just work. Not good enough to gain a competitive data advantage.
I hate what the world has come to, but sadly IT procurement has too much influence and CTO's dont understand the modern world enough. They just care about the big Microsoft contract, because it makes them look good (look at all these savings!)
If Microsoft would showcase Teradata or Dataiku or a bit of Snowflake, all of those run through the azure marketplace anyway,... we would be better off. But consultants and premium partners naturally only care about Databricks