Home›Concepts
Concepts
Concepts
How AI works, in plain language: from the artificial neuron to the Transformer, pre-training and reasoning models.
Total 46 · Clear filters
Text watermarkingText watermarking embeds a hidden statistical signal in generated text so that a short span of tokens can later be identified as machine output, while the text still reads normally to people.Prompt injectionPrompt injection is an attack in which text inside a model's input overrides its original instructions, letting an adversary hijack a language-model application — including, as researchers showed in 2023, through content the application retrieves on its own.Llama Community LicenseThe Meta Llama 3 Community License is the custom agreement Meta attaches to its Llama 3 models: free to use and modify, but with use restrictions, attribution duties and a user-scale threshold that keep it from being open source in the usual sense.Test-time computeTest-time compute is the computation a model spends while answering a prompt, beyond what training already fixed into its weights. A 2024 study by Snell et al. showed how to spend it adaptively, and how it can stand in for a bigger model.Open Source AI Definition (OSAID)The Open Source AI Definition is a 1.0 standard, released by the Open Source Initiative in October 2024, that a model must meet to be called open source: reproducible design, disclosed training data, and freedom to use, modify and build on it.Sim-to-real transferSim-to-real transfer is the practice of training robot policies in simulation and then adapting them to physical robots, using synthetic data to supplement costly real-world demonstrations.AI agentAn AI agent is a system that perceives its environment and acts autonomously toward goals. The term covers everything from a thermostat to LLM-driven software that directs its own tool use.Multi-agent systemA multi-agent system is a computing system made of several interacting intelligent agents that coordinate to solve problems too hard for a single agent. Recent frameworks built on large language models let such agents talk to each other.World modelA world model is a machine learning system that learns an internal representation of an environment and predicts how it changes in response to actions, letting agents plan inside a learned simulator instead of by trial and error.Context windowA context window is the full span of text a model can refer to while producing a response, measured in tokens and including the response itself. Its size, and how evenly a model uses it, shape what the model can do.Long contextLong context is a model's capacity to take in and work over very large inputs — documents, images, recordings — in a single request. Systems now reach millions of tokens, though finding information inside that window is a separate skill.QuantizationQuantization stores a language model's weights and activations at lower numerical precision, cutting the memory and bandwidth that inference requires. Methods such as LLM.int8() and GPTQ made very large models runnable on far smaller hardware.KV cacheA KV cache keeps the key and value vectors a model has already computed for earlier tokens, so each new token reuses them instead of recomputing. Its memory footprint is what makes high-throughput serving hard to scale.Prompt engineeringPrompt engineering is the practice of designing the text input that steers a generative AI system toward a desired output. Shared vocabulary and techniques such as chain-of-thought prompting make results easier to describe, compare and reproduce.Synthetic dataSynthetic data is training material written by a model rather than collected from people or the web. In the phi-1 experiments a small code model trained partly on model-generated "textbooks" reached competitive benchmark scores, suggesting data quality itself shapes capability.Tool callingTool calling lets a language model hand a sub-task, such as arithmetic or search, to an external program and use the result in its answer. Toolformer showed in 2023 that a model could learn when and how to call tools on its own.Planning in AI agentsPlanning in AI agents is the process of breaking a goal into intermediate steps, choosing actions, and revising the plan as results arrive, rather than producing an answer in one pass.[^1][^2]Agent memoryAgent memory is the part of an agent system that stores information beyond the current context window so it can be recalled later. MemGPT (2023) framed the limited context window as the core constraint such designs must work around.Embodied AIEmbodied AI is the study of agents that learn by interacting with an environment, using egocentric perception, rather than only from datasets curated from the internet. Simulators serve as virtual testbeds where such agents are trained and evaluated.HallucinationHallucination is false or misleading information that a model presents as fact. It is a central failure mode of text-generating systems and a main obstacle to trusting their output.