Artificial Intelligence

Markov Model

A stochastic model that assumes the Markov property. This assumption enables reasoning and computation with the model that would otherwise be intractable.

Rationalism

Descartes was a strong advocate of the power of reasoning in understanding the world, a philosophy now called _________, and one that counts Aristotle and Leibnitz as members.

HLAI

Human-Level Artificial Intelligence

Satisficing

A decision-making strategy that attempts to meet an acceptability threshold. This is contrasted with optimal decision-making, an approach that specifically attempts to find the best option available.

Connectionist

A set of approaches in the fields of artificial intelligence, cognitive psychology, cognitive science, neuroscience and philosophy of mind, that models mental or behavioral phenomena as the emergent processes of interconnected networks of simple units.

Hidden Markov Models

A statistical Markov model in which the system being modeled is assumed to be a Markov process with unobserved states. Can be considered as the simplest dynamic Bayesian network.

Cognitive Psychology

A subdiscipline of psychology exploring internal mental processes. It is the study of how people perceive, remember, think, speak, and solve problems.[1]

Probability

Besides logic and computation, the third great contribution of mathematics to AI is the theory of _________. The Italian Gerolamo Cardano (1501-1576) first framed the idea, describing it in terms of the possible outcomes of gambling events.

Situated Approach

A "bottom-up" approach towards agent design with a narrow focus on behaving usefully in an environment and on the the basic perceptual and motor skills required to survive. Gives a much lower priority to abstract reasoning or problem-solving skills of other agent design approaches.

Stochastic Calculus

A branch of mathematics that operates on stochastic processes. It allows a consistent theory of integration to be defined for integrals of stochastic processes with respect to stochastic processes. It is used to model systems that behave randomly.

Analogy

A cognitive process of transferring information or meaning from a particular subject (the source) to another particular subject (the target).

Decision Theory

A combination of probability theory with utility theory which provides a formal and complete framework for decisions (economic or otherwise) made under uncertainty.

Back-Propagation

A common method of training artificial neural networks so as to minimize the objective function.

Bayesian Inference

A method in statistics of inference used to update the probability estimate for a hypothesis as additional evidence is learned.

AI winter

A period of reduced funding and interest in artificial intelligence research. The field has experienced several cycles of hype, followed by disappointment and criticism, followed by funding cuts, followed by renewed interest years or decades later. There were two major instances in 1974-80 and 1987-93.

Logical Positivism

A philosophy that combines empiricism—the idea that observational evidence is indispensable for knowledge—with a version of rationalism incorporating mathematical and logico-linguistic constructs and deductions of epistemology.

Algorithm

A step-by-step procedure for calculations.

Bounded Rationality

The idea that in decision-making, rationality of individuals is only based on the information they have, the cognitive quality of their minds, and the finite amount of time they have to make a decision.

Machine Evolution

The illusion of unlimited computational power was not confined to problem-solving programs. Early experiments in ____________ (now called genetic algorithms) (Friedberg, 1958; Friedberg et al., 1959) were based on the undoubtedly correct belief that by making an appropriate series of small mutations to a machine-code program, one can generate a program with good performance for any particular task.

Artificial intelligence

The intelligence of machines and the branch of computer science that aims to create it.

Turing Test

This was designed to provide a satisfactory operational definition of intelligence.

Homeostatic Devices

Ashby's Design for a Brain (1948, 1952) elaborated on his idea that intelligence could be created by the use of _____________ containing appropriate feedback loops to achieve stable adaptive behavior.

Neuroscience

The study of the nervous system, particularly the brain.

Expert Systems

A computer system that emulates the decision-making ability of a human expert and are designed to solve complex problems by reasoning about knowledge, like specialist, and not by following the procedure of a developer as is the case in conventional programming.

Hebb

The man who demonstrated a simple updating rule for modifying the connection strengths between neurons.

Rational Agent

An agent that acts so as to achieve the best outcome or, when there is uncertainty, the best expected outcome.

Materialism

An alternative to dualism, which holds that the brain's operation according to the laws of physics constitutes the mind.

Physical Symbol System

Takes physical patterns (symbols), combining them into structures (expressions) and manipulating them (using processes) to produce new expressions.

Graphical Model

A probabilistic model which represents the conditional independence structure between random variables. They are commonly used in probability theory, statistics—particularly Bayesian statistics—and machine learning.

Adaline (Adaptive Linear Neuron)

A single layer neural network. Consists of a weight, a bias and a summation function.

Evolutionary Computation

A subfield of artificial intelligence (more particularly computational intelligence) that involves combinatorial optimization problems.

Evolutionary Algorithm

A subset of evolutionary computation, a generic population-based metaheuristic optimization algorithm. An EA uses some mechanisms inspired by biological evolution: reproduction, mutation, recombination, and selection.

Lisp

A family of computer programming languages with a long history and a distinctive, fully parenthesized Polish prefix notation. Has been the dominant AI programming language for the last 30 years.

Friendly AI

An artificial intelligence (AI) that has a positive rather than negative effect on humanity.

Empiricism

Characterized by a dictum of John Locke: "Nothing is in the understanding, which was not first in the senses."

Operations Research

Coming from efforts in Britain to optimize radar installations, it is a discipline that deals with the application of analytical methods to help make better decisions. It later found civilian applications in complex management decisions.

Embodied Cognition

Directly simulating the functions we associate with the body (such as perception and motion) without using logic or any similar representation.

Nouvelle (Nouvelle AI)

During the late 1980s, this AI approach which was pioneered at the MIT Artificial Intelligence Laboratory by Rodney Brooks. It is different from classical artificial intelligence in that it tries not to reach for human-level performance, but rather tries to create systems with intelligence at the level of insects. This approach had a large impact in Europe.

Incompleteness Theorem

Gödel's idea on the inherent limitations of all but the most trivial axiomatic systems capable of doing arithmetic.

NP-Complete (NP-C)

In computational complexity theory, a class of decision problems where any given solution to the decision problem can be _verified_ in polynomial time. But, there is no known efficient way to _locate_ the solutions.

Logicism

One of the schools of thought in the philosophy of mathematics, putting forth the theory that mathematics is an extension of logic and therefore some or all mathematics is reducible to logic.

Intractability

Problems that can be solved in theory (e.g., given infinite time), but which in practice take too long for their solutions to be useful.

Markov Property

Refers to the memoryless property of a stochastic process.

Behaviorism

Rejected any theory involving mental processes on the grounds that introspection could not provide reliable evidence.

Human-Level AI

That which strives for "machines that think, that learn and that create." First at Minsky's symposium in 2004.

Induction

The Principle of ________ says: that general rules are acquired by exposure to repeated associations between their elements.

Frames

This concept, proposed by Marvin Minsky, "is an artificial intelligence data structure used to divide knowledge into substructures by representing "stereotyped situations." They are connected together to form a complete idea.

Observation Sentences

This doctrine holds that all knowledge can be characterized by logical theories connected, ultimately, to ___________ that correspond to sensory inputs.

Perceptron Convergence Theorem

This theorem says that the learning algorithm can adjust the connection strengths of a perceptron to match any input data, provided such a match exists.

Knowledge Representation (KR)

Translation of information into symbols to facilitate inferencing from those information elements, and the creation of new elements of information.

Cybernetics

Wiener's book ___________(1948) became a bestseller and awoke the public to the possibility of artificially intelligent machines.

Rational Agent

Within artificial intelligence, a __________ is one that maximizes its expected utility, given its current knowledge.

Neuroevolution

A form of machine learning that uses evolutionary algorithms to train artificial neural networks. It is useful for applications such as games and robot motor control, where it is easy to measure a network's performance at a task but difficult or impossible to create a syllabus of correct input-output pairs for use with a supervised learning algorithm.

Bayesian Network

A probabilistic graphical model (a type of statistical model) that represents a set of random variables and their conditional dependencies via a directed acyclic graph (DAG).

Natural Language Processing

A field of computer science and linguistics concerned with the interactions between computers and human languages.

Computer Vision

A field that includes methods for acquiring, processing, analysing, and understanding images and, in general, high-dimensional data from the real world in order to produce numerical or symbolic information.

Inductive Reasoning

A kind of reasoning that constructs or evaluates propositions that are abstractions of observations of individual instances of members of the same class. Contrasts with reasoning where a general conclusion is arrived at by specific examples.

Data Mining

A process that results in the discovery of new patterns in large data sets. Utilizes methods at the intersection of artificial intelligence, machine learning, statistics, and database systems.

Game

A scenario in which the actions of one player can significantly affect the utility of another (either positively or negatively).

Machine Learning

A scientific discipline concerned with the design and development of algorithms that allow computers to evolve behaviors based on empirical data, such as from sensor data or databases.

Hebbian Theory

A scientific theory in biological neuroscience which explains the adaptation of neurons in the brain during the learning process.

Genetic Algorithms

A search heuristic that mimics the process of natural evolution. This heuristic is routinely used to generate useful solutions to optimization and search problems.

Perceptron

An algorithm for supervised classification of an input into one of two possible outputs. It is a type of linear classifier, i.e. a classification algorithm that makes its predictions based on a linear predictor function combining a set of weights with the feature vector describing a given input.

Automated Reasoning

An area of computer science and mathematical logic dedicated to understand different aspects of thinking.

Intelligent Agent

An autonomous entity which observes through sensors and acts upon an environment using actuators and directs its activity towards achieving goals.

Neuron

An electrically excitable cell that processes and transmits information by electrical and chemical signaling

Control Theory

An interdisciplinary branch of engineering and mathematics that deals with the behavior of dynamical systems. The external input of a system is called the reference. When one or more output variables of a system need to follow a certain reference over time, a controller manipulates the inputs to a system to obtain the desired effect on the output of the system.

Computational Linguistics

An interdisciplinary field dealing with the statistical or rule-based modeling of natural language from a computational perspective.

Weak Methods

Approaches which do not scale up to large or difficult problem instances.

Strong AI

Artificial intelligence that matches or exceeds human intelligence — the intelligence of a machine that can successfully perform any intellectual task that a human being can. Also referred to as "artificial general intelligence" or as the ability to perform "general intelligent action.

Confirmation Theory

Attempted to analyze the acquisition of knowledge from experience.

Dualism

In addition to rationalism, Descartes was also a proponent of __________. He held that there is a part of the human mind (or soul or spirit) that is outside of nature, exempt from physical laws.

Knowledge Representation (KR)

Involves analysis of how to reason accurately and effectively and how best to use a set of symbols to represent a set of facts within a knowledge domain.

Certainty Factors

MYCIN incorporated a calculus of uncertainty called __________, which seemed (at the time) to fit well with how doctors assessed the impact of evidence on the diagnosis.

Microworlds

Minsky supervised a series of students who chose limited problems that appeared to require intelligence to solve. These limited domains became known as _________.

Objective Function

Modern control theory, especially the branch known as stochastic optimal control, has as its goal the design of systems that maximize an ___________over time.

Markov Decision Processes (MDPs)

Provides a mathematical framework for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision maker.

Syllogisms

Provides patterns for argument structures that always yielded correct conclusions when given correct premises—for example, "Socrates is a man; all men are mortal; therefore, Socrates is mortal.",

Computability

The ability to solve a problem in an effective manner. Closely linked to the existence of an algorithm to solve the problem..

Inference

The act or process of deriving logical conclusions from premises known or assumed to be true. The conclusion drawn is also called an idiomatic.

Epistemology

The branch of philosophy concerned with the nature and scope (limitations) of knowledge.

Robotics

The branch of technology that deals with the design, construction, operation, structural disposition, manufacture and application of autonomous machines and computer systems for their control, sensory feedback, and information processing

Technological Singularity

The hypothetical future emergence of greater-than-human intelligence through technological means. Since the capabilities of such intelligence would be difficult for an unaided human mind to comprehend, the occurrence of a technological singularity is seen as an intellectual event horizon, beyond which events cannot be predicted or understood.

Cognitive Science

The interdisciplinary field of cognitive science brings together computer models from AI and experimental techniques from psychology to construct precise and testable theories of the human mind.

Cognitive Science

The interdisciplinary scientific study of the mind and its processes. It examines what cognition is, what it does and how it works.

Utility

The mathematical treatment of "preferred outcomes" which was first formalized by Walras and was improved by Ramsey and later by von Neumann in his book The Theory of Games and Economic Behavior (1944).

Logic

The philosophical study of valid reasoning and examines general forms that arguments may take, which forms are valid, and which are fallacies.

Deductive Reasoning

The process of reasoning from one or more general statements regarding what is known to reach a logically certain conclusion. Involves using given true premises to reach a conclusion that is also true.

Artificial General Intelligence

The search for a universal algorithm for learning and acting in any environment. Also known as Strong AI.

Optimization

The selection of a best element from some set of available alternatives.

Game Theory

The study of strategic decision making. Or "the study of mathematical models of conflict and cooperation between intelligent rational decision-makers." Unlike decision theory, it does not offer an unambiguous prescription for selecting actions.

Agent

These are expected to: operate autonomously, perceive their environment, persist over a prolonged time period, adapt to change, and create and pursue goals.