Home›Concepts
Concepts
Concepts
How AI works, in plain language: from the artificial neuron to the Transformer, pre-training and reasoning models.
Total 15 · Clear filters
Autonomous drivingAutonomous driving is the operation of a road vehicle by a computer system instead of a person. Its six automation levels, its two main technical traditions and its long line of research vehicles define how the field is discussed today.Deep learning on GPUsGraphics processing units (GPUs) run many arithmetic operations in parallel, which suits neural-network training. Their use from 2010 onward made deep learning practical at much larger scales.Mixture of experts (MoE)A mixture of experts model contains many sub-networks but routes each token to only a few of them. This lets total model size grow while the compute spent on each token stays much smaller than the total.Tensor CoresTensor Cores are specialised units inside NVIDIA GPUs that perform a small matrix multiply-and-add in one step, making the matrix arithmetic behind neural-network training and inference dramatically faster.Model parallelismModel parallelism splits one model's parameters and computation across multiple accelerators, so networks too large for a single device can still be trained. NVIDIA's 2019 Megatron-LM paper showed an intra-layer version built in native PyTorch.Scaling lawsScaling laws are empirical trends showing that a language model's test loss falls smoothly, as a power law, when parameters, data and training compute grow. They help plan large training runs and explain the race for compute.Speculative decodingSpeculative decoding speeds up text generation from large autoregressive models: a smaller model proposes several tokens and the large model checks them in parallel, producing identical output faster.Test-time computeTest-time compute is the computation a model spends while answering a prompt, beyond what training already fixed into its weights. A 2024 study by Snell et al. showed how to spend it adaptively, and how it can stand in for a bigger model.Sim-to-real transferSim-to-real transfer is the practice of training robot policies in simulation and then adapting them to physical robots, using synthetic data to supplement costly real-world demonstrations.Multi-agent systemA multi-agent system is a computing system made of several interacting intelligent agents that coordinate to solve problems too hard for a single agent. Recent frameworks built on large language models let such agents talk to each other.World modelA world model is a machine learning system that learns an internal representation of an environment and predicts how it changes in response to actions, letting agents plan inside a learned simulator instead of by trial and error.QuantizationQuantization stores a language model's weights and activations at lower numerical precision, cutting the memory and bandwidth that inference requires. Methods such as LLM.int8() and GPTQ made very large models runnable on far smaller hardware.KV cacheA KV cache keeps the key and value vectors a model has already computed for earlier tokens, so each new token reuses them instead of recomputing. Its memory footprint is what makes high-throughput serving hard to scale.Embodied AIEmbodied AI is the study of agents that learn by interacting with an environment, using egocentric perception, rather than only from datasets curated from the internet. Simulators serve as virtual testbeds where such agents are trained and evaluated.Visual odometryVisual odometry lets a rover measure how far it actually moved by tracking features in camera images taken before and after a short drive, instead of trusting wheel turns. NASA's Mars Exploration Rovers were the first to demonstrate it.