Home›Concepts
Concepts
Concepts
How AI works, in plain language: from the artificial neuron to the Transformer, pre-training and reasoning models.
Total 93
Supervised learningSupervised learning trains a model to map inputs to outputs using paired labelled examples, so that it can predict answers for new, unseen data. Its central measure of success is how well the model generalises beyond the training set.Unsupervised learningUnsupervised learning trains algorithms on data that carry no labels, letting them find structure such as clusters, low-dimensional representations or generative models. It underlies clustering tools and neural generative models from the Hopfield network and Boltzmann machine to the variational autoencoder.Loss functionA loss function turns the cost of a prediction into a single number, and training a model means making that number as small as possible. Its choice decides which mistakes a model is punished for.OverfittingOverfitting is when a model fits its training data so closely that it performs poorly on new data. It is one half of the bias–variance trade-off and is usually spotted by comparing training and validation performance.RegularizationRegularization is the practice of making a problem's answer simpler, usually by adding a penalty term to the objective, so that ill-posed problems become solvable and models avoid overfitting.Decision tree learningDecision tree learning builds a classification or regression tree from data by repeatedly splitting it into more homogeneous groups. It is a widely used supervised method whose rules can be read directly, and whose main weaknesses are instability and a tendency to overfit.Feature engineeringFeature engineering is the preprocessing step that turns raw data into more useful inputs for machine learning and statistical models, shaping, cleaning and trimming the attributes a model learns from.Activation functionA function applied to each node's weighted sum, giving neural networks their non-linearity. Sigmoid, tanh and ReLU shaped early deep learning; GELU now dominates transformers.AutoencoderAn autoencoder is an unsupervised neural network that compresses its input into a low-dimensional code and reconstructs it back, learning a latent representation useful for dimensionality reduction, denoising and anomaly detection.AI agentAn AI agent is a system that perceives its environment and acts autonomously toward goals. The term covers everything from a thermostat to LLM-driven software that directs its own tool use.Multi-agent systemA multi-agent system is a computing system made of several interacting intelligent agents that coordinate to solve problems too hard for a single agent. Recent frameworks built on large language models let such agents talk to each other.World modelA world model is a machine learning system that learns an internal representation of an environment and predicts how it changes in response to actions, letting agents plan inside a learned simulator instead of by trial and error.Context windowA context window is the full span of text a model can refer to while producing a response, measured in tokens and including the response itself. Its size, and how evenly a model uses it, shape what the model can do.Long contextLong context is a model's capacity to take in and work over very large inputs — documents, images, recordings — in a single request. Systems now reach millions of tokens, though finding information inside that window is a separate skill.QuantizationQuantization stores a language model's weights and activations at lower numerical precision, cutting the memory and bandwidth that inference requires. Methods such as LLM.int8() and GPTQ made very large models runnable on far smaller hardware.KV cacheA KV cache keeps the key and value vectors a model has already computed for earlier tokens, so each new token reuses them instead of recomputing. Its memory footprint is what makes high-throughput serving hard to scale.Prompt engineeringPrompt engineering is the practice of designing the text input that steers a generative AI system toward a desired output. Shared vocabulary and techniques such as chain-of-thought prompting make results easier to describe, compare and reproduce.Synthetic dataSynthetic data is training material written by a model rather than collected from people or the web. In the phi-1 experiments a small code model trained partly on model-generated "textbooks" reached competitive benchmark scores, suggesting data quality itself shapes capability.Multimodal modelsA multimodal model handles more than one kind of input or output, such as images together with text, inside a single model. Work on CLIP and Flamingo showed how such models are trained and how they can be steered toward new tasks.Tool callingTool calling lets a language model hand a sub-task, such as arithmetic or search, to an external program and use the result in its answer. Toolformer showed in 2023 that a model could learn when and how to call tools on its own.