We have a large postgres server running on a dedicated server that handles millions of users, billions of record updates and inserts per day, and when I want to run an analysis I just open up psql. I wrote some dashboards and alerting in python that took a few hours to spin up. If we ever ran into load issues, we'd just set up some basic replication. It's all very simple and can easily scale further.
My team of 3 data scientists are able to support a culture of experimentation, data-informed decision making accross the entire org.
And we do all that 30k annual spend on databricks. That's less than 1/5 the cost of 1 software engineer. Excellent value for money if you ask me.
I really struggle to imagine being able to that any cheaper. How else we can engineer a data hub for all of our data and manage appropriate access & permissions, run complex calculations in seconds (yes we have replaced overnight complex calculation done by engineering teams), join data from so many disparate sources, at a total cost (tool + labor) <80k/yr. I double dare you to suggest or find me a cheaper option for our use case.
My team of 3 data scientists are able to support a culture of experimentation, data-informed decision making accross the entire org.
And we do all that 30k annual spend on databricks. That's less than 1/5 the cost of 1 software engineer. Excellent value for money if you ask me.
I really struggle to imagine being able to that any cheaper. How else we can engineer a hub for all of our data and manage appropriate access, run complex calculations in seconds, join data from so many disparate sources, at a total cost (tool + labor) <80k/yr. I double dare you to suggest or find me a cheaper option for our use case.
My team of 3 data scientists are able to support a a culture of experimentation, data-informed decision making and support the entire org, and we are still growing 15% YoY.
And we do all that 30k annual spend on databricks. That's less than 1/5 the cost of 1 software engineer. Excellent value for money if you ask me.
i struggle to imagine how else we can engineer a hub for all of our data and manage permissions appropriately at less tooling and engineering cost
If you buy a house for $400k, and suddenly it is worth $300k, you don't need to be "bailed out" for your purchase decision. You should have been certain that the house was worth $400k to you at the time of purchase. Otherwise you're a speculator, and we shouldn't be bailing out speculators.
It's called buyer's remorse. We accept it when it's a car or a TV, but suddenly when it's a house we're supposed to give massive government support to correct the buyer's mistake?
Miss often than not, I see it framed as an economic problem needing more economic solutions. This article hit the nail on the head. It is also a socio-cultural problem. And social cultural solutions work far better than purely economic solutions.
Then there are the semi-elective things like healthcare, education, home security. These kinda dont work for the whole society. The rich are thus paying for their own out of pocket. But they are also paying for the semi-working system for everyone else.
I think introducing a wealth tax just to balance the books without rethinking who and how accesses public funds, will just end with the rich leaving. Some may say good riddance, but the UK budget is now beyond creaking and heading for collapse.
Oh and when I say "the rich", that probably covers many people here. IIRC earning 90k per year puts you in the top 1%. A 10-15 year experience NHS doctor is in that bracket.
This is a lie. In US, most food our rules, legal system, government agencies (that are not direct transfers like doc security & Medicare) exist to protect properties and interest of the rich.
That higher income people are not seeing much of direct transfers does not mean they are not getting more benefits from the government. Even our bloated military and foreign policy is primarily still protecting US business interests globally. It’s not minimum wage peon that benefits from that. It’s owners of large capital
But now, crickets!!