

If you strip out the encoder, then you’re getting closer.
That’s flat-out not true. BERTs, for example, are LLMs and are encoder-only, just like GPTs are decoder-only. Whisper is trained on a large corpus of text and does NLP tasks. That’s all it is to be an LLM.
A transformer model being encoder-only, encoder-decoder, or decoder-only has fuck-all to do with whether it’s an LLM. In fact, it being a transformer model at all isn’t required for it to be an LLM.




Pictured: Lauren Boebert’s office.