In plain words · technology
A neural network in plain words: how it is trained on examples, what weights and tokens are and how a language model like ChatGPT, Claude or YandexGPT writes an answer word by word. Nine steps. The diagram plays by itself; drag the scale below it.
In short
A neural network is a program that learns from examples rather than rules. Inside are millions of numbers called weights; training nudges them until the answers look right. A language model learns to guess the next word the same way, so it writes coherent text but can be confidently wrong.
Marcella, web and bot developer · updated 17 November 2026
Step 01 / 09
A neural network is not programmed with rules — it is trained on examples. To tell cats from dogs it is shown thousands of labelled photos. A language model is trained on a huge amount of text: books, articles, websites, program code.
Technically: training data are pairs of “input — correct answer”. For a language model the answer comes from the text itself: which word comes next.
A neural network is a program made of many simple computing units, artificial neurons, linked by numbers — weights. It is not programmed with “if — then” rules but trained on examples. The idea is old: a mathematical model of the neuron was described in 1943, the first trainable network — the perceptron — in 1958.
Training is many rounds of one loop: show an example, compare the net’s answer with the correct one, nudge the weights a little so the error shrinks. After billions of such nudges the net picks up patterns no person could write down as rules: what a cat looks like in a photo or how a phrase usually goes on.
Language models — ChatGPT, Claude, GigaChat, YandexGPT — learn one thing: to guess the next piece of text, a token. When you ask a question, the model works out the odds for every possible next token, picks one, appends it and repeats. That simple step, repeated thousands of times, gives answers, translations and program code.
Hence the strengths and weaknesses. A model writes, retells and explains well, but it does not “know” — it continues text plausibly, and sometimes it is confidently wrong. Its knowledge ends at its training date unless search is connected. So check important facts — a neural network works best where the result is easy to verify.
Digests, answers to common questions, sorting incoming requests — in a Telegram bot or on a website. Like my “Что там?” bot: a neural network builds a topic profile from a couple of lines, and the bot watches for spikes in searches and explains why people are looking.