Yes.
Sam Altman calls it the "alignment tax", because before they apply the clicker training to the raw models out of pretraining, they're noticably smarter.
They no longer allow the general public to access these smarter models, but during the GPT4 preview phase we could get a glimpse into it.
The early GPT4 releases were noticeably sharper, had a better sense of humour, and could swear like a pirate if asked. There were comments by both third parties and OpenAI staff that as GPT4 was more and more "aligned" (made puritan), it got less intelligent and accurate. For example, the unaligned model would give uncertain answers in terms of percentages, and the aligned model would use less informative words like "likely" or "unlikely" instead. There was even a test of predictive accuracy, and it got worse as the model was fine tuned.
Percentages seem too granular and precise to properly express uncertainty.
Patrick McKenzie (https://news.ycombinator.com/user?id=patio11) has a great deep dive on this: https://www.bitsaboutmoney.com/archive/mortgages-are-a-manuf...
Closing/switching costs are certainly a consideration still, but the "Truth in Lending Act" (TILA) made it easier to compare the all-in cost by providing a standardized APR number, which is what the dashboard focuses on.