Skip to content
derpx06Notes on systems, models & learning
0. Intro & Setup · lesson 3 of 68 · 2 min · January 5, 2024

Evolution of AI Agents

A brief history of AI agents from 1950s rule-based systems to today's autonomous agents.

From early rule-based systems to today's autonomous AI models, here's a look at the key breakthroughs that shaped AI agents as we know them.

Turing Test

Alan Turing proposes the 'Imitation Game' to measure if a machine can exhibit indistinguishable intelligent behavior.

1950
AI Born

The Dartmouth Workshop officially coins 'Artificial Intelligence', establishing it as an academic discipline.

1956
ELIZA

Joseph Weizenbaum creates the first chatbot. Simulating a psychotherapist, it shows the potential of pattern matching.

1966
PARRY

Kenneth Colby develops PARRY, a chatbot simulating paranoid schizophrenia, displaying advanced conversation states.

1972
Society of Mind

Marvin Minsky proposes that intelligence emerges from the interaction of many simple, mindless 'agents'.

1986
Jabberwacky

Rollo Carpenter creates Jabberwacky to simulate entertaining conversation, designed to learn from users.

1988
Agent Defined

Brustoloni characterizes autonomous agents as systems capable of purposeful action. Maes (1995) adds 'inhabiting complex environments'.

1991
ALICE

Richard Wallace develops ALICE using AIML, a sophisticated extension of pattern matching.

1995
Deep Blue

IBM's Deep Blue defeats chess champion Garry Kasparov, proving computers could master complex strategy.

1997
Multi-Agent Sys

The 'Autonomous Agents and Multi-Agent Systems' journal is created, sparking interest in cooperative agent systems.

1998
WinFS

Microsoft envisions 'Information Agents' for Windows Longhorn/WinFS to autonomously route data.

2001
SmarterChild

ActiveBuddy launches SmarterChild on AIM. It could answer trivia and check weather.

2001
Palantir

Palantir applies semantic pipelines and dynamic ontologies to process complex data graphs.

2003
Siri

Apple releases Siri. It marks a major leap in voice recognition and mass-market assistants.

2010
IFTTT

Platforms like IFTTT and Zapier popularize 'Integration Agents'—simple rules connecting apps via APIs.

2011
Watson Wins

IBM Watson defeats human champions on Jeopardy!, showcasing advanced NLP.

2011
RPA

Robotic Process Automation (UiPath) brings 'Task Agents' that mimic user clicks to automate legacy software.

2015
Google Assistant

Google launches its AI-powered assistant, integrating context into the Android ecosystem.

2016
GPT-3

OpenAI releases GPT-3 (175B parameters), demonstrating few-shot learning and human-like generation.

2020
ChatGPT

OpenAI launches ChatGPT. Its ability to hold detailed conversations captivates the world.

2022
Agentic AI

Autonomous agents like Devin emerge. They don't just chat; they plan, execute, and code independently.

2024

The Story of the Agent

The journey to autonomous agents wasn't a straight line. It was a winding path filled with dreams, illusions, and practical precursors.

It started with Alan Turing's question: "Can machines think?" While chatbots like ELIZA (1966) and PARRY (1972) dazzled users, they were fragile illusions based on pattern matching—smoke and mirrors without true understanding.

ELIZA simulated a conversation between a human and a Rogerian psychotherapist. She mirrored the user’s statements by turning them into questions, making it feel like a real conversation — but without truly understanding anything.

Sample Conversation:

ELIZA Conversation
User: I feel sad today.
ELIZA: Why do you feel sad today?
User: Because my work is stressful.
ELIZA: Tell me more about your work.

Key Principles of ELIZA’s Functioning:

  • Pattern Matching: ELIZA didn’t understand language; it simply looked for specific word patterns in user input.
  • Keyword Substitution: It replaced certain words in responses to make it seem like it understood the conversation.
  • Predefined Scripts (DOCTOR Script): A set of rules guided ELIZA’s responses to sound empathetic and reflective.
  • No Real Intelligence: There was no deep learning or AI involved — just smart string manipulation.

This illusion inspired the need for true language understanding, realizing that key-matching wasn't enough for real intelligence.

Python Implementation (Simplified):

ELIZA Logic

In the 80s, Marvin Minsky shifted the paradigm. He proposed that intelligence isn't a single magic algorithm but a "Society of Mind"—a collection of simple, mindless agents working together to create complex behavior. This laid the foundation: complex intelligence emerges from simple interactions.

By the 90s, researchers like Brustoloni and Pattie Maes formally defined "Autonomous Agents" as systems that inhabit environments and act purposefully. This era also saw the rise of Multi-Agent Systems, exploring how independent agents could cooperate like a digital society.

Before LLMs, agents appeared in our software infrastructure:

  • WinFS (2001): Microsoft envisioned "Information Agents" in Windows to automatically route tasks (like checking a calendar against a client call). Though cancelled, it was a visionary step.
  • Palantir & Semantics: Systems like Palantir used semantic pipelines to map real-world objects, acting as powerful data agents.
  • Integration Agents: In the 2010s, tools like IFTTT and Zapier let users build simple "If This Then That" agents.
  • RPA: Robotic Process Automation gave us "Task Agents" that could click buttons and copy text, effectively "driving" legacy software.

Today, these threads converge. The Transformer architecture and LLMs (GPT-4) provided the "Brain", while the history of integration provided the "Hands". Modern agents like Devin combine Minsky's society of parts with semantic understanding to plan, code, and execute tasks autonomously.