Artificial Intelligence with PHP
  • Getting Started
    • Introduction
    • Audience
    • How to Read This Book
    • Glossary
    • Contributors
    • Resources
    • Changelog
  • Artificial Intelligence
    • Introduction
    • Overview of AI
      • History of AI
      • How Does AI Work?
      • Structure of AI
      • Will AI Take Over the World?
      • Types of AI
        • Limited Memory AI
        • Reactive AI
        • Theory of Mind AI
        • Self-Aware AI
    • AI Capabilities in PHP
      • Introduction to LLM Agents PHP SDK
      • Overview of AI Libraries in PHP
    • AI Agents
      • Introduction to AI Agents
      • Structure of AI Agent
      • Components of AI Agents
      • Types of AI Agents
      • AI Agent Architecture
      • AI Agent Environment
      • Application of Agents in AI
      • Challenges in AI Agent Development
      • Future of AI Agents
      • Turing Test in AI
      • LLM AI Agents
        • Introduction to LLM AI Agents
        • Implementation in PHP
          • Sales Analyst Agent
          • Site Status Checker Agent
    • Theoretical Foundations of AI
      • Introduction to Theoretical Foundations of AI
      • Problem Solving in AI
        • Introduction
        • Types of Search Algorithms
          • Comparison of Search Algorithms
          • Informed (Heuristic) Search
            • Global Search
              • Beam Search
              • Greedy Search
              • Iterative Deepening A* Search
              • A* Search
                • A* Graph Search
                • A* Graph vs A* Tree Search
                • A* Tree Search
            • Local Search
              • Hill Climbing Algorithm
                • Introduction
                • Best Practices and Optimization
                • Practical Applications
                • Implementation in PHP
              • Simulated Annealing Search
              • Local Beam Search
              • Genetic Algorithms
              • Tabu Search
          • Uninformed (Blind) Search
            • Global Search
              • Bidirectional Search (BDS)
              • Breadth-First Search (BFS)
              • Depth-First Search (DFS)
              • Iterative Deepening Depth-First Search (IDDFS)
              • Uniform Cost Search (UCS)
            • Local Search
              • Depth-Limited Search (DLS)
              • Random Walk Search (RWS)
          • Adversarial Search
          • Means-Ends Analysis
      • Knowledge & Uncertainty in AI
        • Knowledge-Based Agents
        • Knowledge Representation
          • Introduction
          • Approaches to KR in AI
          • The KR Cycle in AI
          • Types of Knowledge in AI
          • KR Techniques
            • Logical Representation
            • Semantic Network Representation
            • Frame Representation
            • Production Rules
        • Reasoning in AI
        • Uncertain Knowledge Representation
        • The Wumpus World
        • Applications and Challenges
      • Cybernetics and AI
      • Philosophical and Ethical Foundations of AI
    • Mathematics for AI
      • Computational Theory in AI
      • Logic and Reasoning
        • Classification of Logics
        • Formal Logic
          • Propositional Logic
            • Basics of Propositional Logic
            • Implementation in PHP
          • Predicate Logic
            • Basics of Predicate Logic
            • Implementation in PHP
          • Second-order and Higher-order Logic
          • Modal Logic
          • Temporal Logic
        • Informal Logic
        • Semi-formal Logic
      • Set Theory and Discrete Mathematics
      • Decision Making in AI
    • Key Application of AI
      • AI in Astronomy
      • AI in Agriculture
      • AI in Automotive Industry
      • AI in Data Security
      • AI in Dating
      • AI in E-commerce
      • AI in Education
      • AI in Entertainment
      • AI in Finance
      • AI in Gaming
      • AI in Healthcare
      • AI in Robotics
      • AI in Social Media
      • AI in Software Development
      • AI in Adult Entertainment
      • AI in Criminal Justice
      • AI in Criminal World
      • AI in Military Domain
      • AI in Terrorist Activities
      • AI in Transforming Our World
      • AI in Travel and Transport
    • Practice
  • Machine Learning
    • Introduction
    • Overview of ML
      • History of ML
        • Origins and Early Concepts
        • 19th Century
        • 20th Century
        • 21st Century
        • Coming Years
      • Key Terms and Principles
      • Machine Learning Life Cycle
      • Problems and Challenges
    • ML Capabilities in PHP
      • Overview of ML Libraries in PHP
      • Configuring an Environment for PHP
        • Direct Installation
        • Using Docker
        • Additional Notes
      • Introduction to PHP-ML
      • Introduction to Rubix ML
    • Mathematics for ML
      • Linear Algebra
        • Scalars
          • Definition and Operations
          • Scalars with PHP
        • Vectors
          • Definition and Operations
          • Vectors in Machine Learning
          • Vectors with PHP
        • Matrices
          • Definition and Types
          • Matrix Operations
          • Determinant of a Matrix
          • Inverse Matrices
          • Cofactor Matrices
          • Adjugate Matrices
          • Matrices in Machine Learning
          • Matrices with PHP
        • Tensors
          • Definition of Tensors
          • Tensor Properties
            • Tensor Types
            • Tensor Dimension
            • Tensor Rank
            • Tensor Shape
          • Tensor Operations
          • Practical Applications
          • Tensors in Machine Learning
          • Tensors with PHP
        • Linear Transformations
          • Introduction
          • LT with PHP
          • LT Role in Neural Networks
        • Eigenvalues and Eigenvectors
        • Norms and Distances
        • Linear Algebra in Optimization
      • Calculus
      • Probability and Statistics
      • Information Theory
      • Optimization Techniques
      • Graph Theory and Networks
      • Discrete Mathematics and Combinatorics
      • Advanced Topics
    • Data Fundamentals
      • Data Types and Formats
        • Data Types
        • Structured Data Formats
        • Unstructured Data Formats
        • Implementation with PHP
      • General Data Processing
        • Introduction
        • Storage and Management
          • Data Security and Privacy
          • Data Serialization and Deserialization in PHP
          • Data Versioning and Management
          • Database Systems for AI
          • Efficient Data Storage Techniques
          • Optimizing Data Retrieval for AI Algorithms
          • Big Data Considerations
            • Introduction
            • Big Data Techniques in PHP
      • ML Data Processing
        • Introduction
        • Types of Data in ML
        • Stages of Data Processing
          • Data Acquisition
            • Data Collection
            • Ethical Considerations in Data Preparation
          • Data Cleaning
            • Data Cleaning Examples
            • Data Cleaning Types
            • Implementation with PHP
          • Data Transformation
            • Data Transformation Examples
            • Data Transformation Types
            • Implementation with PHP ?..
          • Data Integration
          • Data Reduction
          • Data Validation and Testing
            • Data Splitting and Sampling
          • Data Representation
            • Data Structures in PHP
            • Data Visualization Techniques
          • Typical Problems with Data
    • ML Algorithms
      • Classification of ML Algorithms
        • By Methods Used
        • By Learning Types
        • By Tasks Resolved
        • By Feature Types
        • By Model Depth
      • Supervised Learning
        • Regression
          • Linear Regression
            • Types of Linear Regression
            • Finding Best Fit Line
            • Gradient Descent
            • Assumptions of Linear Regression
            • Evaluation Metrics for Linear Regression
            • How It Works by Math
            • Implementation in PHP
              • Multiple Linear Regression
              • Simple Linear Regression
          • Polynomial Regression
            • Introduction
            • Implementation in PHP
          • Support Vector Regression
        • Classification
        • Recommendation Systems
          • Matrix Factorization
          • User-Based Collaborative Filtering
      • Unsupervised Learning
        • Clustering
        • Dimension Reduction
        • Search and Optimization
        • Recommendation Systems
          • Item-Based Collaborative Filtering
          • Popularity-Based Recommendations
      • Semi-Supervised Learning
        • Regression
        • Classification
        • Clustering
      • Reinforcement Learning
      • Distributed Learning
    • Integrating ML into Web
      • Open-Source Projects
      • Introduction to EasyAI-PHP
    • Key Applications of ML
    • Practice
  • Neural Networks
    • Introduction
    • Overview of NN
      • History of NN
      • Basic Components of NN
        • Activation Functions
        • Connections and Weights
        • Inputs
        • Layers
        • Neurons
      • Problems and Challenges
      • How NN Works
    • NN Capabilities in PHP
    • Mathematics for NN
    • Types of NN
      • Classification of NN Types
      • Linear vs Non-Linear Problems in NN
      • Basic NN
        • Simple Perceptron
        • Implementation in PHP
          • Simple Perceptron with Libraries
          • Simple Perceptron with Pure PHP
      • NN with Hidden Layers
      • Deep Learning
      • Bayesian Neural Networks
      • Convolutional Neural Networks (CNN)
      • Recurrent Neural Networks (RNN)
    • Integrating NN into Web
    • Key Applications of NN
    • Practice
  • Natural Language Processing
    • Introduction
    • Overview of NLP
      • History of NLP
        • Ancient Times
        • Medieval Period
        • 15th-16th Century
        • 17th-18th Century
        • 19th Century
        • 20th Century
        • 21st Century
        • Coming Years
      • Key Concepts in NLP
      • Common Challenges in NLP
      • Machine Learning Role in NLP
    • NLP Capabilities in PHP
      • Overview of NLP Libraries in PHP
      • Challenges in NLP with PHP
    • Mathematics for NLP
    • NLP Techniques
      • Basic Text Processing with PHP
      • NLP Workflow
      • Popular Tools and Frameworks for NLP
      • Techniques and Algorithms in NLP
        • Basic NLP Techniques
        • Advanced NLP Techniques
      • Advanced NLP Topics
    • Integrating NLP into Web
    • Key Applications of NLP
    • Practice
  • Computer Vision
    • Introduction
  • Overview of CV
    • History of CV
    • Common Use Cases
  • CV Capabilities in PHP
  • Mathematics for CV
  • CV Techniques
  • Integrating CV into Web
  • Key Applications of CV
  • Practice
  • Robotics
    • Introduction
  • Overview of Robotics
    • History and Evolution of Robotics
    • Core Components
      • Sensors (Perception)
      • Actuators (Action)
      • Controllers (Processing and Logic)
    • The Role of AI in Robotics
      • Object Detection and Recognition
      • Path Planning and Navigation
      • Decision Making and Learning
  • Robotics Capabilities in PHP
  • Mathematics for Robotics
  • Building Robotics
  • Integration Robotics into Web
  • Key Applications of Robotics
  • Practice
  • Expert Systems
    • Introduction
    • Overview of ES
      • History of ES
        • Origins and Early ES
        • Milestones in the Evolution of ES
        • Expert Systems in Modern AI
      • Core Components and Architecture
      • Challenges and Limitations
      • Future Trends
    • ES Capabilities in PHP
    • Mathematics for ES
    • Building ES
      • Knowledge Representation Approaches
      • Inference Mechanisms
      • Best Practices for Knowledge Base Design and Inference
    • Integration ES into Web
    • Key Applications of ES
    • Practice
  • Cognitive Computing
    • Introduction
    • Overview of CC
      • History of CC
      • Differences Between CC and AI
    • CC Compatibilities in PHP
    • Mathematics for CC
    • Building CC
      • Practical Implementation
    • Integration CC into Web
    • Key Applications of CC
    • Practice
  • AI Ethics and Safety
    • Introduction
    • Overview of AI Ethics
      • Core Principles of AI Ethics
      • Responsible AI Development
      • Looking Ahead: Ethical AI Governance
    • Building Ethics & Safety AI
      • Fairness, Bias, and Transparency
        • Bias in AI Models
        • Model Transparency and Explainability
        • Auditing, Testing, and Continuous Monitoring
      • Privacy and Security in AI
        • Data Privacy and Consent
        • Safety Mechanisms in AI Integration
        • Preventing and Handling AI Misuse
      • Ensuring AI Accountability
        • Ethical AI in Decision Making
        • Regulations & Compliance
        • AI Risk Assessment
    • Key Applications of AI Ethics
    • Practice
  • Epilog
    • Summing-up
Powered by GitBook
On this page
  • Origins and Early ES
  • Historical Context
  • Key Contributors and Early Innovations
  • Notable Early Expert Systems
  • Technological Approaches and Innovations
  • Global Contributions
  • Impact and Challenges
  • Legacy and Influence
  1. Expert Systems
  2. Overview of ES
  3. History of ES

Origins and Early ES

PreviousHistory of ESNextMilestones in the Evolution of ES

Last updated 1 month ago

Origins and Early ES

ES are an important type of artificial intelligence (AI). Their goal is to copy human experts' thinking and decision-making skills in specific areas. They use knowledge, rules, and logical thinking to solve difficult problems that usually need human experts.

Historical Context

The idea of ES started to become popular in the 1960s and 1970s. During this period, AI researchers wanted to create practical applications that showed clear value. They aimed to put human expert knowledge into computers, allowing computers to imitate human problem-solving and decision-making abilities.

Key Contributors and Early Innovations

Early contributors to ES developed methods to copy human expertise in computers. They created ways for computers to reason and make decisions similar to human experts. Their work laid the foundation for systems using logical rules and structured knowledge to solve complex problems.

1. Edward Feigenbaum

Edward Feigenbaum is one of the main early figures in Expert Systems. He is often called the "father of expert systems." In 1965, he worked with Joshua Lederberg, Bruce Buchanan, and Carl Djerassi at Stanford University.

2. Joshua Lederberg

Joshua Lederberg was an American molecular biologist known for his work in microbial genetics, artificial intelligence, and the United States space program. He was 33 years old when he won the 1958 Nobel Prize in Physiology or Medicine for discovering that bacteria can mate and exchange genes

3. Bruce Buchanan

University Professor of Computer Science Emeritus, University of Pittsburgh, he received a B.A. degree in Mathematics from Ohio Wesleyan University (1961), and his M.S. and Ph.D. degrees in Philosophy from Michigan State University (1966). He was on the faculty at Stanford University and the University of Pittsburgh, with appointments in computer science, philosophy, medicine, and intelligent systems. He is known for his work in artificial intelligence, the development of the Stanford Artificial Intelligence Laboratory and the artificial intelligence (AI) community.

4. Carl Djerassi

Carl Djerassi was an Austrian-American chemist famous for helping develop the first oral contraceptive pill. He made significant contributions to chemistry and later became known as an author and playwright. Djerassi also played an important role in early research on expert systems, collaborating on pioneering AI projects.

They worked together to create a system that could think like expert chemists. Their project laid important foundations by structuring specialized knowledge using logical rules and reasoning.

Notable Early Expert Systems

DENDRAL (1965)

Developed in 1965 at Stanford University, DENDRAL was among the first expert systems designed to assist chemists in identifying chemical compounds. It used a rule-based inference engine and domain-specific heuristics to analyze mass spectrometry data and generate hypotheses about molecular structures. DENDRAL’s success established Expert Systems' practical value and demonstrated their potential to support scientific discovery.

MYCIN (1972–1976)

In development from 1972 to 1976, MYCIN was created to diagnose bacterial infections and suggest antibiotic treatments. Also originating from Stanford University, MYCIN utilized a knowledge base of over 450 rules and an inference engine using backward chaining to derive diagnoses. It introduced the use of certainty factors to manage uncertainty in medical reasoning — an innovation ahead of its time. Despite never being used clinically due to legal and ethical concerns, MYCIN became a landmark project in AI.

PROSPECTOR (1978)

Developed starting in 1978 by SRI International, PROSPECTOR was an Expert System designed for geological exploration. It employed probabilistic reasoning to evaluate mineral data and became famous in the early 1980s after successfully identifying a valuable molybdenum deposit in Washington State. It combined rules with Bayesian updating, a technical approach that made it suitable for handling uncertain geological data.

XCON (1979)

XCON, originally known as R1, was developed in 1979 by John P. McDermott at Digital Equipment Corporation (DEC). It automated the configuration of VAX computer systems, reducing errors and saving DEC millions of dollars. XCON utilized a forward-chaining rule engine and had a knowledge base of thousands of rules at its peak. It was among the first large-scale industrial Expert Systems to be deployed in a commercial environment.

Technological Approaches and Innovations

Early Expert Systems relied primarily on rule-based systems, structured around clearly defined inference rules and knowledge bases. These rules were written in the form of IF-THEN statements. The systems typically included:

  • Knowledge Base: Stores facts and heuristics.

  • Inference Engine: Applies logical rules to the knowledge base to derive conclusions. Engines used techniques like:

    • Forward chaining (data-driven reasoning): starts with known facts and applies rules to extract more data until a goal is reached.

    • Backward chaining (goal-driven reasoning): starts with a goal and works backward to determine what data supports that goal.

  • Explanation Facility: Explains the system's reasoning process.

Global Contributions

Although much early pioneering work emerged from the United States, global contributions were significant. In the UK, the University of Edinburgh and Imperial College London produced important theoretical work on knowledge representation and AI reasoning. Japan's Ministry of International Trade and Industry launched the Fifth Generation Computer Systems project in 1982, aiming to advance AI and logic programming, including Expert Systems development using Prolog-based platforms. These initiatives inspired further research across Europe and Asia.

Impact and Challenges

Despite initial successes, early Expert Systems faced numerous limitations. They required extensive manual input of domain knowledge, which was resource-intensive. Maintenance and updates posed significant challenges, as knowledge bases quickly became outdated. Systems also lacked learning capabilities, making them rigid in adapting to new knowledge. Nevertheless, these early limitations stimulated further research, driving the development of more flexible and adaptive AI technologies, including machine learning and neural networks.

Legacy and Influence

Early Expert Systems significantly shaped future AI research directions. They established foundational principles in knowledge representation, inference engines, and decision support that are still used in modern AI. The architecture and design of these systems influenced the development of intelligent agents, diagnostic systems, and modern applications in fields such as healthcare, engineering, and finance. The legacy of DENDRAL, MYCIN, PROSPECTOR and XCON lives on as milestones in the evolution of applied artificial intelligence.

Edward Feigenbaum
Joshua Lederberg
Bruce Buchanan
Carl Djerassi