Naturally Intelligent Systems Book

Acknowledgments
Part I
Natural Intelligence
Neural Networks in a Nutshell
Characteristics of Neural Networks
Comparing a Neural Network to a Digital Computer
Building Blocks of Neural Networks
The Anatomy of a Neurode
The Network in Action
Implementation: The Artificial Retina
Neural Networks and Other System
Neural Networks and Artificial Intelligence
Neural Networks and Parallel Computers
Do Neurodes Have Internal Memory?
Relationship to Analog Computers
Part II
Associative Memories
Features of Associative Memories
Classes of Neural Network Associative Memories
Using an Associative Memory
Neural Network Models
Crossbar Associative Memories
Energy Surface Representation
Matrix Representation of Crossbar Networks
Feedback Competition Representation
An Illustrative Example
The Problems with Crossbar Networks
Then Why Study the Crossbar?
Adaptive Filter Associative Memories
Introducing the Adaline
Geometry of the Delta Rule
Choosing the Learning Constant
What Can the Adaline Do?
Limitations of the Adaline
Training the Madaline
Higher-Order Networks
The Polynomial Adaline
Application: The Vectorcardiograph
Competitive Filter Associative Memories
A Self-Organizing Architecture
Lateral Inhibition
The Network in Operation
The Geometry of the Network
The Crust Thickens
Training Techniques
The Topology-Preserving Map
Application: The Voice Typewriter
Part III
Learning
Types of Learning
Memory
Learning and Memory in Neural Networks
Training a Neural Network
Hebbian Learning
Neohebbian Learning
Differential Hebbian Learning
Classical,Conditioning
Classical or Pavlovian Conditioning
The Instar and Outstar
Outstar Learning
Outstar Inconsistencies
Drive-Reinforcement Theory
Learning Sequences of Patterns
The Music Box Associative Memory
Single-Neurode Systems
The Outstar Avalanche
Recognizing Sequences of Patterns
Autonomous Learning
Characteristics of Autonomous Learning Systems
Recall by Association
Seek and Ye Shall Find
Dealing with Reality
The Importance of Being Significant
On with the New, On with the Old
Categorically Speaking
The Memory Shell Game
Elementary, My Dear Watson
An Ocean of Experience
Autonomous Learning Redux
A Classic System: The Perceptron
Part IV
Hierarchical Systems
Linear Separability
Kolmogorov's Theorem
What Kolmogorov Didn't Say
Application: The Neocognitron
Backpropagation Networks
Features of Backpropagation Systems
Building a Backpropagation System
The Backpropagation Process
Limitations of Backpropagation Networks
Variations of the Generalized Delta Rule
Scaling Problems
Biological Arguments against Backpropagation
Applications of Backpropagation Systems
Application: NETtalk
Hybrid Networks
The Counterpropagation Network
Training Techniques and Problems
The Size of the Middle Layer
Using the Counterpropagation Network
Adaptive Resonance Networks
The Principle of Adaptive Resonance
Operation of the ART 1 Network
The Reset Subsystem
The Gain Control Subsystem and the 2/3 Rule
Troubles with ART 1
Art 2
Grandmother Nodes and ART
The Limitations of ART Networks in General
Part V
Neural Network Implementations
Software Simulations
Neurocomputers
Networks in Hardware
Optical Neural Networks
Neural Network
An Expert Mortgage Insurance Underwriter
A Process Controller That the Freeway
A Robotic Arm
Sonar Signal Processing
A Look Ahead
Implementations Development
Weird Science
Neural Network Theory
Applications
A Final Word
Glossary
Index