Readit NewsThat way they were able to live-test infected SolarWinds distro in their own controlled environment and develop all possible mitigations and techniques - the sheer amount of these evading techniques suggests they were built up over time, and not instantly.
Being Solar Winds customer and receiving infected updated versions every time gave them opportunity to perfect their techniques and hide for so long
At least that what I would do if I were a hacker and wanted to persist and be very careful about not getting detected
For my money, its the best distributed ML system out there, so I'd be interested to know what new hotness I'm missing.
Distributed ML is tough to train because of very little control over train loop. I personally prefer using single server trainkng even on large datasets, or switch to online learning algos that do train/inference/retrain at the same time.
as for snowflake, I havent heard of people using snowflake to train ML, but sbnowflake is a killer in managed distribited DWH that you dont have to tinker and tune
If you want to build anything mildly interesting, you need to have a solid background on software engineering (building data pipelines in Spark, Flink, etc. goes way beyond knowing SQL), you need to really understand your runtime (e.g. the JVM, and how to tune it when working with massive amounts of data), you need a bit of knowledge about infrastructure, because some of the most specialized and powerful tools do not have yet an established "way of doing things", and the statefulness nature of them make them different from your typical web app deployment.
Maybe if you want to become a data analyst you only need SQL, and I would still doubt it. But data engineering is a bit different.
spark has dataframe API which is similar to pandas api and can be learned in one day, especially if you know python.
same for Airflow and other frameworks, it just a fancy scheduler that anyone can pick up in a couple days.
THis process is not required for your average company where IT is a cost center and CRUD-type apps generator.
as trendy as tsmc might be these days - apple might end up going for abb, siemens, toshiba engines
Frankly, I despise what the American government did to Assange and Manning. However, you can't even remotely compare their fate to what is happening every day to hundreds and thousands of people in different parts of China like Tibet. You have no chance of escaping, no chance of trial not to mention any appeal, your life can be destroyed in an instant. Several people in Tibet each year prefer to self-immolate than live under the terrible conditions imposed by the Chinese government.
https://www.businessinsider.com/china-harvesting-organs-of-u...
Wouldn't Google, Apple etc do background checks that discovered fake identities? Or is it not so easy with background checks?
Maybe SolarWinds would be less careful though?