Ortho-ordent initialization of feedforward artificial neural networks (FFANNs) to improve their generalization ability

Dilip Sarkar

doi:10.1117/12.205191

6 April 1995 Ortho-ordent initialization of feedforward artificial neural networks (FFANNs) to improve their generalization ability

Dilip Sarkar

Author Affiliations +

Proceedings Volume 2492, Applications and Science of Artificial Neural Networks; (1995) https://doi.org/10.1117/12.205191
Event: SPIE's 1995 Symposium on OE/Aerospace Sensing and Dual Use Photonics, 1995, Orlando, FL, United States

Abstract

There are several models for neurons and their interconnections. Among them, feedforward artificial neural networks (FFANNs) are very popular for being quite simple. However, to make them truly reliable and smart information processing systems, such characteristics as learning speed, local minima, and generalization ability need more understanding. Difficulties such as long learning-time and local minima, may not affect them as much as the question of generalization ability, because in many applications a network needs only one training, and then it may be used for a long time. However, the question of generalization ability of ANNs is of great interest for both theoretical understanding and practical use, because generalization ability is a measure of a learning system that indicates how closely its actual output approximates to the desired output for an input that it has never seen. We investigate novel techniques for systematic initializations (as opposed to purely random initializations) of FFANN architectures for possible improvement of their generalization ability. Our preliminary work has successfully employed row-vectors of Hadamard matrices to generate initializations; this initialization method has produced networks with better generalization ability.

Citation Download Citation

Dilip Sarkar "Ortho-ordent initialization of feedforward artificial neural networks (FFANNs) to improve their generalization ability", Proc. SPIE 2492, Applications and Science of Artificial Neural Networks, (6 April 1995); https://doi.org/10.1117/12.205191

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available