A statistical model strings a sentence together with a great big web of statistical weights, settling onto the next most probable word, one by one. People write with the intent to share a meaning. It is not the same.
That statistical (or “predictive”, if we’re gussying it up) model has no understanding in it - no more than any other programme. It’s a physical chain reaction, a calculation that runs until the sums even out to a state of rest. Wipe the web of statistical weights clean, and re-weigh them so the sums spit out the colour of pixels in a JPEG rather than the content of a .txt document.
Hell, weigh the web at random and have it spit out nonsense numbers. It’ll do that for as long as keep the programme up. It will never ask you why you took the meaning out of its task. The machine makes no distinction between the sort of calculation you run it – people are what project meaning onto the blinking lights.
Can you? One is editing a table of variables, the other is altering a brain by some magic hypothetical. Even if you could, the person you do it to is gonna be cross with you – the programme, meanwhile, is still just a programme. People who’ve had damage to Wernicke’s area are still attempting to communicate meaningful thoughts, just because the signal is scrambled doesn’t mean the intent isn’t still there.