134 followers
Softmax is a crucial enabler for LLM output layers. Models like GPT4 would be difficult if not impossible without it. As it was invented in 1989 by British Intelligence (Royal Signals) it could be assumed GCHQ has had GPT/BERT capability for some time.