all I want to figure out
is how to "manually" (semi-manually) tweak the LLMs parameters so we can alter what it 'knows for sure'
is this doable yet??? or is this one of those questions whose answer is best kept behind NDAs and other such practices?
Correct—they don’t “know” in the epistemic sense, but they do encode a latent world model that shows up as useful priors.
Put differently: GPT-4 isn’t a knowledge base, it’s a *Bayesian autocomplete* over dense vectors. That’s why it can draft Python faster than many juniors, yet fail a trivial chain-of-thought step if the token path diverges.
The trick in production is to sandwich it: retrieval (facts) LLM (fluency) rule checker (logic). Without that third guardrail, you’re betting on probability mass, not truth.
If we don’t actively archive, incentivize, or reimagine those spaces, AI-generated content may become a sterile echo chamber of what’s “most likely,” not what’s most interesting. The risk isn’t that knowledge disappears — it’s that flavor, context, and dissent do.