Artificial Neural Networks

This talk is based on

  1. Introduction
    1. The Human Brain
    2. Neural Network Representation
  2. When to Use Neural Networks
    1. ALVINN
  3. Perceptrons
    1. Representational Power of Perceptrons*
    2. Perceptron Training
    3. Perceptron Training Rule Convergence
    4. Gradient Descent
      1. Gradient Descent Landscape
      2. Calculating the Gradient Descent
      3. Gradient Descent Algorithm
    5. Perceptron Learning Summary, so far
    6. Incremental (Stochastic) Gradient Descent
      1. Stochastic versus Batch Gradient Descent
  4. Multilayer Networks
    1. Sigmoid Unit
    2. Error Gradient for Sigmoid Unit
    3. Backpropagation
      1. Backpropagation Details
      2. Hidden Layer Representation*
      3. 8-3-8 Plots
      4. Backpropagation Convergence
    4. Representational Power of ANNs
    5. Overfitting ANNs
  5. Face Recognition Example
  6. Alternative Error Functions
  7. Recurrent Networks
  8. Dynamically Modifying Network Structure
  9. Summary
All in one page
Index on left