Since you are on Frankfurtian bullshit, why don't you consider Late G.A. Cohen's take on intellectual bullshit (bullshit perpetuated in the academia), as the latter's notion of bullshit is linked to knowledge, unlike the bullshit we hear from salesmen, showmen, etc.
We've discussed Cohen's work in our book _Calling Bullshit_, but the type of bullshit the Cohen focuses on — unclarifiable unclarity, particularly in academic writing — is not what LLMs produce so it strikes us as far less relevant to this course than Frankfurt's notion.
The mysterious part involves whatever patterns might naturally exist within bazillions of human documents, and what partial/compressed patterns might exist within the weights the LLM generates (on training) and then later uses.
Analogy: We built a probe that travels to an alien planet, mines out crystal deposits, and projects light through those fragments to show unexpected pictures of the planet's past. We know exactly how our part of the machine works, and we know the chemical composition of the crystals, but...