It looks like a variant of "beam search" (using top-k instead of top-1), but it's not mentioned anywhere. What am I not getting ?
I was thinking the exact same thing. If someone could explain why it's not just beam search, I would be grateful!
Readit Newsklintcho commented on DeepConf: Scaling LLM reasoning with confidence, not just compute arxiviq.substack.com/p/de... · Posted by u/che_shr_cat
klintcho commented on Hacking Diffusion into Qwen3 for the Arc Challenge matthewnewton.com/blog/ar... · Posted by u/mattnewton
Regarding the typewriter approach, I've wondered for a while if anyone has explored simple backtracking with LLMs? Like, have the LLM be able to generate a backspace/delete token that lets it "undo" previously generated tokens in an append-only fashion. Not sure how this would work with teacher forcing but seems feasible with RL.
How would it be different from regular beam search?
> The faster we build the future, the better.
Why? Getting to "the future" isn't a goal in and of itself. It's just a different state with a different set of problems, some of which we've proven that we're not prepared to anticipate or respond to before they cause serious harm.
Maybe not. Although I think future here implies progress and productivity gains. Increasing GDP has a very well established cause - effect relationship on making life on earth better. Less poverty, less crime, more happiness longer life expectancy etc, the list goes on.
Now sure, all externalities are not always accounted for (especially climate and environmental factors), but I think even accounting for these, the future of humanity is a better one where technology progresses faster.
klintcho commented on Is tipping getting out of control? Many consumers say yes apnews.com/article/tippin... · Posted by u/subliminalpanda
I've just opened a coffee shop in Los Angeles last month, and we don't take tips. We only use self-ordering iPads (I've custom coded an iOS app w/ Stripe Terminal for it), and we don't accept cash either.
We've had a few customers baffled by the no-tipping policy, and still insisting that they leave a tip. Some even left cash on the counter or on the table. We had to chase a few of them down to return their money. Also, some customers seem to think that the screen froze at the very end because it didn't ask for a tip.
While it has been strange to see some customer's determination to leave a tip, I think overall it was well received by the great majority of people that just didn't say anything about it and made a mental note that the prices they see on the menu is what they'll actually end up paying.
We will probably need to highlight that we pay a higher wage for baristas & cooks to account for the lack of tips, and give customers an option to donate to a charity if they still wish to part with additional money.
I do believe that the incentive tips provide for employees to "act" friendly to customers can be transferred over into a review/feedback program, which is what we will be testing out. If customers rate their order and interaction with the barista to be satisfactory, a bonus payment will be made to the baristas on shift. Once we introduce this, I'll share the results.
That is awesome! When you say: what the price on the menu is that is what the customer pays; does it include sales tax as well? If so, def a very happy development and pretty much revolutionary for being in the US.
If not, is it something you could consider doing? I think it would be the next natural step :)
Disclaimer: I’m Swedish, all prices in Sweden everywhere is always including everything, you’ll never pay more than what you see.
klintcho commented on Meta Earning Results Q3 2022 [pdf] s21.q4cdn.com/399680738/f... · Posted by u/mfiguiere
^^^ have to emphasize.
60-80% of the cost base in many F500s is bullshit (exceptions exist. FMCG, any industry where physical products make up their balance sheet. Not salaries). Any excuse to avoid returning money to shareholders.
Everyone quietly acknowledges. If say, Visa, really tried, they could cut the cost base by 50% and achieve the same output.
Carl Icahn style shareholder activists have a point.
Forget tech companies. Most public companies are a conspiracy by VPs/C-suite/board.
The difference with tech companies is Google feather-beds its EMPLOYEES with free food.
From a pure capitalist standpoint. You could run Facebook's business on 20 billion USD in costs. Their cost base is enormous because Z has ZERO interest in cutting costs.
He's in it for the ego/vanity. Same as every other F500 CEO/Chairman.
Ego is the driver, not the balance sheet.
I don't necessarily disagree with this. However wouldn't this imply a couple of world changing things:
- We should go for something akin to universal basic income? Given we could produce a bunch of output with very few people (I guess at that point it's more and ideological question of if these few people that get to stay + shareholders are going to get all that value rather than someone else) - People that are talking about "productivity growth" has declined the past 20 - 40 years, are probably wrong and we have seen productivity growth, we've just filled it up with useless stuff and made up jobs? - It also sort of implies that some of the projects that Google and Meta has taken on even though not financially sound right now haven't produced any value for humanity (and I fully understand that in a capitalist society; profits are the way we value things). I think they have and a lot do (like long tail stuff like producing knowledge, producing open source tech, driving tech that while not mature now, will explode in the future, VR + self driving comes to mind)
Another thing that comes to mind when it comes to founder driven companies doing whatever they want is all the Elon Musk companies. He has also made a bunch of crazy bets that "value"-companies would def not have made.
klintcho commented on Rolls Royce Ends Boom Supersonic Partnership airwaysmag.com/rolls-royc... · Posted by u/theparanoid
Eh, I figured I would get this response but writing software e.g. your IBM, Yahoo, and Microsoft example is much easier and faster to do than building a cutting edge, physical, supersonic commercial jet. To build Google, all you needed was a computer, and a new approach/algorithm to solving web search. Software companies are much easier to disrupt than physical product companies.
As others have pointed out the Tesla isn't a great example either because building a car is still 100x easier to do than building aircraft, let alone supersonic planes.
"Unexpected Insights" and "A new research breakthrough from some other field" seems to be handy wavy. A supersonic jet breakthrough is not something that can be discovered in a dorm room. It requires millions in research and expensive materials to build and test against.
I did include SpaceX as well, and I'm not sure one can find a better example than that, but there are others as well:
- Cruise + other self driving car companies (obv also a bunch of software, maybe even software focused, but looking at Waymo, they developed all their own hardware, LIDAR tech etc.)
- Commonwealth Fusion + a bunch of other fusion startups (obv they haven't really gotten to a product yet one could argue, but a bunch of breakthroughs in high powered electro-magnets has been made)
- Heart aerospace - electric planes
- Canvas construction - robotic plastering and painting for construction.
While supersonic flight has been proven, albeit not economically viable, it's still something that has been done, and done like 40+ years ago. It's not really on the "fusion power"-levels of difficult. But sure, I guess on could argue both sides equally well :)
In regards to research breakthrough, sure they were handwavy at least as it relates to jet engines capable to support supersonic flights. I don't have any sources but I have little doubt that jet engine / material breakthroughs has been made since the 80:s.
klintcho commented on Rolls Royce Ends Boom Supersonic Partnership airwaysmag.com/rolls-royc... · Posted by u/theparanoid
Agreed. I know nothing about aerospace engineering or aircraft design, but the hype around Boom always puzzled me. If this start up can all of a sudden make an economical supersonic jet, then surely the existing plane manufacturers could do it quicker and cheaper. Boeing, Lockheed, Airbus, etc... already have existing designs from decades past that they could at least use as a base. They have experts in material science, airplane design, and actual resources/contracts to actually build one. If it made sense.
This argument could be made about any big SV company the past 30 years.
- Anyone of IBM, Microsoft or Yahoo could build a better (quicker and cheaper) search engine than what a bunch of new grads from Stanford can (Google)
- Anyone of the car manufacturer can build a better (quicker and cheaper) electric car than a software millionaire (Tesla)
I don't agree with the statement, I think there are numerous reason people embark on ambitious project that incumbents "could" do, but are not doing;
- An unexpected insights,
- A new research breakthrough from some other field
- Collecting a bunch of the most bright people coming up at the same time in the field (Mueller for SpaceX comes to mind for instance) etc.
But most of the time it's just that it's not really in their business to do a 100 million dollar - 1 billion bet on something that risky, they are in the business of returning like 7 - 10% a year to their shareholder, not producing 5x returns (like the VC/startup business).
klintcho commented on Welcome Home, Garry Tan ycombinator.com/blog/welc... · Posted by u/todsacerdoti
I'm seeing many people say you've blocked them without ever having interacted with you. Many have jumped to the conclusion that you simply block people who disagree with your politics. I don't tweet about SF politics, but after I tweeted this, you replied tell me it's funny but wrong, and then blocked me: https://twitter.com/sandofsky/status/1491167231467999236
Which is fine. I block plenty of people. I also mute people, because a block carries a message. And if I found myself in role that gets considerable scrutiny, I'd probably reevaluate my entire approach to social media.
There are a bunch of block-tools which are of the kind "block everyone that liked this tweet", "block everyone that follows this person" etc. Casting that wide of a net probably also carries some "false negatives" (which could explain the "I'm blocked but never interacted with the person).
Bay Area getting server errors as well, some kind of attack?
klintcho commented on Bots behind the game console shortage theverge.com/2022/5/25/23... · Posted by u/danso
iPhones are a hot commodity, I wonder why I never have to play "beat the scalper" when I want to buy one? I don't wonder at all, of course, because when I order a iPhone that is in short supply I simply get placed in a queue. It might be three months before I get a phone, but at least I know I don't have to spend my days refreshing a web page. I order, I'm done with that task until it shows up.
But, yeah, blame the players and not those that could shut down the game any time they like.
A simple "pre-ordering"-queue seems it would decrease scalper interest as well (?) as it would be much more risky to order a bunch, hope you get early in the queue and sell to people who might get their machine just little time later.
Let people put up a small deposit as well for getting a place in the queue, and it'll be deducted whenever you buy the machine. Keep the deposit if you cancel your place in line. Would incentivize less manipulation as well.
I've been trying to get a PS5 for 2 years now, and I refuse to pay some scalper 200USD more than market price, out of principle. (But I guess that is also why I still don't have one :) )