Wealthy people don't just leave their money under a mattress, they invest it in something. Even if they just left it in a bank, the bank is still going to lend that money out and invest it. Taxing wealth just encourages riskier investments, as higher risk is needed to achieve comparable post-tax return.
The well known MNCs seem to be here largely in an operational capacity, the majority of their workforce would be something like trust/risk/support/finance/sales. In terms of "R&D" and "innovation", work that develops the products and services that are sold, I see very little of that happening in Ireland. Yet these companies have huge engineering and product teams in London which are still growing, and the fact they're not placed here is rather telling. For sure we've benefited from the presence of these MNCs so far, but for it to be more sustainable and for the economy to mature further I think we need to be looking to become a country that's attractive beyond being an operational base.
On the hardware side Intel, Qualcomm, Huawei, HP, Analog Devices, Xilinx, Nokia Bell Labs and many more all have extensive R&D departments in Ireland.
On the software side, Amazon, Microsoft, Facebook, Google etc. all have engineering roles advertised currently on Linkedin.
I could design you a chip that is nothing but FP32 multipliers and adders that has, theoretically, a ridiculous TFLOPS per mm^2, but it would be next to useless in any real workload.
Another interesting finding is that this speeds up training due to the smaller number of parameters.
However, my worry is that those of use that do not readily have access to TPUs will get even slower models when using CPUs for prediction due to the additional and wider hidden layers. (Of course, one could use ALBERT base, which still have 12 layers and a hidden layer size of 768, at a small loss.) Did anyone measure the CPU prediction performance of ALBERT models compared to BERT?
Edit: I guess one solution would be to use a pretrained ALBERT and finetune to get the initial model and then use model distillation to get a smaller, faster model.
please, stop telling women they are weird for wanting to work in IT or for enjoying their IT job.
They said that men and women tend to have different broad interests. But that doesn't preclude women from having an interest in tech. He's making a statement on statistics, not making a value judgement about anybody.