Home›Concepts
Concepts
Concepts
How AI works, in plain language: from the artificial neuron to the Transformer, pre-training and reasoning models.
Total 17 · Clear filters
Autonomous drivingAutonomous driving is the operation of a road vehicle by a computer system instead of a person. Its six automation levels, its two main technical traditions and its long line of research vehicles define how the field is discussed today.Imitation learningImitation learning trains an agent by supervised learning on expert demonstrations rather than by trial and error. Its simplest form is behaviour cloning, and its best-known weakness is distribution shift.Retrieval-augmented generationRetrieval-augmented generation (RAG) lets a language model fetch relevant documents from an external store and put them into its prompt before answering, so it can use knowledge beyond its training data and cite where an answer came from.Instruction tuningInstruction tuning is a supervised fine-tuning stage that trains a large language model to follow user instructions; the FLAN paper showed it substantially improves zero-shot performance on unseen tasks.Prompt injectionPrompt injection is an attack in which text inside a model's input overrides its original instructions, letting an adversary hijack a language-model application — including, as researchers showed in 2023, through content the application retrieves on its own.Computer useComputer use is an Anthropic capability, released in public beta in October 2024, that lets an AI model operate a computer the way a person does — reading the screen, moving a cursor, clicking and typing — so it can drive ordinary software built for humans.Vision-Language-Action model (VLA)A vision-language-action model (VLA) is a robot policy that takes in camera images and a language instruction and outputs actions directly, usually by adapting a pretrained vision-language model to control.Sim-to-real transferSim-to-real transfer is the practice of training robot policies in simulation and then adapting them to physical robots, using synthetic data to supplement costly real-world demonstrations.Reinforcement learningReinforcement learning is the branch of machine learning and optimal control in which an agent learns, by trial and error, which actions in a dynamic environment maximise a reward signal.AI agentAn AI agent is a system that perceives its environment and acts autonomously toward goals. The term covers everything from a thermostat to LLM-driven software that directs its own tool use.Multi-agent systemA multi-agent system is a computing system made of several interacting intelligent agents that coordinate to solve problems too hard for a single agent. Recent frameworks built on large language models let such agents talk to each other.World modelA world model is a machine learning system that learns an internal representation of an environment and predicts how it changes in response to actions, letting agents plan inside a learned simulator instead of by trial and error.Tool callingTool calling lets a language model hand a sub-task, such as arithmetic or search, to an external program and use the result in its answer. Toolformer showed in 2023 that a model could learn when and how to call tools on its own.Planning in AI agentsPlanning in AI agents is the process of breaking a goal into intermediate steps, choosing actions, and revising the plan as results arrive, rather than producing an answer in one pass.[^1][^2]Agent memoryAgent memory is the part of an agent system that stores information beyond the current context window so it can be recalled later. MemGPT (2023) framed the limited context window as the core constraint such designs must work around.Embodied AIEmbodied AI is the study of agents that learn by interacting with an environment, using egocentric perception, rather than only from datasets curated from the internet. Simulators serve as virtual testbeds where such agents are trained and evaluated.Visual odometryVisual odometry lets a rover measure how far it actually moved by tracking features in camera images taken before and after a short drive, instead of trusting wheel turns. NASA's Mars Exploration Rovers were the first to demonstrate it.