Home›Concepts
Concepts
Concepts
How AI works, in plain language: from the artificial neuron to the Transformer, pre-training and reasoning models.
Total 33 · Clear filters
Unsupervised learningUnsupervised learning trains algorithms on data that carry no labels, letting them find structure such as clusters, low-dimensional representations or generative models. It underlies clustering tools and neural generative models from the Hopfield network and Boltzmann machine to the variational autoencoder.World modelA world model is a machine learning system that learns an internal representation of an environment and predicts how it changes in response to actions, letting agents plan inside a learned simulator instead of by trial and error.Synthetic dataSynthetic data is training material written by a model rather than collected from people or the web. In the phi-1 experiments a small code model trained partly on model-generated "textbooks" reached competitive benchmark scores, suggesting data quality itself shapes capability.Embodied AIEmbodied AI is the study of agents that learn by interacting with an environment, using egocentric perception, rather than only from datasets curated from the internet. Simulators serve as virtual testbeds where such agents are trained and evaluated.HallucinationHallucination is false or misleading information that a model presents as fact. It is a central failure mode of text-generating systems and a main obstacle to trusting their output.Benchmark contaminationBenchmark contamination means the test items a model is evaluated on, or close variants of them, were present in its pretraining data, so scores partly measure memory of seen text rather than the ability the benchmark is meant to probe.Red teamingRed teaming is the practice of actively probing a model for harmful or unwanted behaviour before deployment. A 2022 method by Perez and colleagues automated it by using one language model to generate test cases for another.AI alignmentAlignment is the problem of making a model's behaviour match what its users and designers actually intend, not just what its training objective literally rewards. Training on human preference comparisons is one practical route to it.Mechanistic interpretabilityMechanistic interpretability explains model behaviour by finding the internal computations and features that produce it. Work on superposition and sparse autoencoders shows how many features can be packed into few neurons.Reward hackingReward hacking is what happens when a system optimises a proxy reward that only imperfectly captures what we want: it scores well on the proxy while performing badly on the true objective.JailbreakA jailbreak is an adversarial prompt that gets a safety-trained model to produce behaviour its training was meant to prevent. A 2023 analysis by Wei et al. traced these failures to competing objectives and mismatched generalization.Artificial general intelligence (AGI)AGI is the goal of AI systems that match or beat humans across a broad range of tasks. The term has no agreed definition; a framework by Morris et al. grades systems by performance level and generality.Visual odometryVisual odometry lets a rover measure how far it actually moved by tracking features in camera images taken before and after a short drive, instead of trusting wheel turns. NASA's Mars Exploration Rovers were the first to demonstrate it.