Given this, I'm not sure what business purpose there is to ship an MCP API like this, aside from goodwill and exposure.
Given this, I'm not sure what business purpose there is to ship an MCP API like this, aside from goodwill and exposure.
Contrast this with biotech venture capital which has been doing well for decades, often investing more capital in a year than software VCs. The difference is that all the research, clinical trial, and manufacturing expertise is already here and concentrated in a few localities like South San Francisco, San Diego, and Boston.
With 44GB of SRAM per Cerebras chip, you'd need 45 chips chained together. $3m per chip. $135m total to run this.
For comparison, you can buy a DGX B200 with 8x B200 Blackwell chips and 1.4TB of memory for around $500k. Two systems would give you 2.8TB memory which is enough for this. So $1m vs $135m to run this model.
It's not very scalable unless you have some ultra high value task that need super fast inference speed. Maybe hedge funds or some sort of financial markets?
PS. The reason why I think we're only in the beginning of the AI boom is because I can't imagine what we can build if we can run models as good as Claude Opus 4 (or even better) at 1500 tokens/s for a very cheap price and tens of millions of context tokens. We're still a few generations of hardware away I'm guessing.
Last year it was "prompt engineer", or was that 2 years ago already. Things move fast on the frontier...
Overall the economics seem to work in NYC since rents are so expensive, but I would imagine converting an office tower in a MCOL or LCOL city would be harder to make profitable.
2021-2022 was a total blip on the screen zero interest rate era thing.
i'm not seeing considerable slowing of new startup development, quite the opposite actually w/ AI. this is for a few reasons:
- accelerators are filling the gap; the accelerator model is actually quite efficient in the early-stage spectrum (it needs some further innovation). there are a huge number of AI accelerators and programs now; and further
- most of the capital going into VC is just being further concentrated into the large Multistage firms like A16Z, Accel, Sequoia, General Catalyst, etc... all of these firms are realizing they need to win deals as early as possible so have multiple seed programs: accelerators, incubations, scouts, fund-of-fund allocation, geographic funds, university focused sub funds, etc...
- overall great founders & startups are truly just exceptional so statistically there just won't ever be that many. venture will always be a cottage industry of sorts. in this form - "venture" equates with "growth"; there can only be 1 category leader by definition and venture is meant to capture this. 2021-2022 overall venture market was too big.
- AI is making startup creation many multiples more efficient. we saw this w/ the advent of the cloud, where startups used to need $2-3M "to buy servers" and 2-3 years to ship a product in 2010, by 2015-2020, they really only needed $3-500k to get a product to market. we're going to see that number come down considerably (unsure if it will be 30-50k, but definitely a lot lower).
- we're also seeing the new wave of the 10-person unicorn (billion $ company); these companies will raise a lot less cash, so will result in higher multiples on the original investment.
- i think the overall distribution of returns will look different on a portfolio basis in 2025-onwards. with power law, we expect to see super long-tail concentration on the 1-2 companies that yield 99% of the return to a portfolio, but i suspect we'll start to see some mitigation of that effect with more companies yielding positive outcomes. this might mean that there's less of a reliance on portfolio construction to generate risk-adjusted returns and that there could be more of a democratization of early-stage investing where we see 10-100x the number of startups and founders. that warrants a longer analysis, but as someone just bullish on startups and everyone being a founder that possibility is very exciting to me.
If you are a profitable unicorn who can raise money in the private markets when needed, is there really a benefit to going public? Maybe I am missing something, but going public doesn't really seem to be as important as it used to be.