Copy Link
Add to Bookmark
Report
Neuron Digest Volume 07 Number 44
Neuron Digest Monday, 12 Aug 1991 Volume 7 : Issue 44
Today's Topics:
Administrivia - Neuron Digest moves
Taxonomy of Neural Network Optimality
Re: Taxonomy of Neural Network Optimality
commercial applications of N.N. - Exploratory Action Neurocomputing
Neural Nets in Information Retrieval
Research Associate position in U.K.
Neural Nets in Information Retrieval References
postdoctoral position
email address
ACNN'92 Final Call
Send submissions, questions, address maintenance and requests for old issues to
"neuron-request@hplabs.hp.com" or "{any backbone,uunet}!hplabs!neuron-request"
Use "ftp" to get old issues from hplpm.hpl.hp.com (15.255.176.205).
----------------------------------------------------------------------
Subject: Administrivia - Neuron Digest moves
From: "Neuron-Digest Moderator -- Peter Marvit" <neuron@hplabs.hpl.hp.com>
Date: Mon, 12 Aug 91 10:32:27 -0700
A reminder that Neuron Digest will be moving soon. There will be no
issues from 16 August until approximately 1 September (or even later).
The ftp archive will also be unavailable during that time.
I will send out test messages when the Digest is ready to resume from the
new location (????.upenn.edu). I will also announce the new addresses.
Thanks for your patience and understanding. I will post reminders in the
next couple of issues...
-Peter "Philly Bound" Marvit
: Peter Marvit, Neuron Digest Moderator
: Courtesy of Hewlett-Packard Labs in Palo Alto, CA 94304 (415) 857-6646
: neuron-request@hplabs.hpl.hp.com OR {any backbone}!hplabs!neuron-request
------------------------------
Subject: Taxonomy of Neural Network Optimality
From: nelsonde%avlab.dnet@wrdc.af.mil
Date: Tue, 30 Jul 91 08:35:41 -0400
I N T E R O F F I C E M E M O R A N D U M
Date: 30-Jul-1991 08:25am EST
From: Dale E. Nelson
NELSONDE
Dept: AAAT-1
Tel No: 57646
Subject: Taxonomy of Neural Network Optimality
We are working on a taxonomy of parameters which may be used to determine
if one network is better than another. To this end the following list
has been developed. I would be interested in any comments or references
to this kind of listing.
PERFORMANCE:
1. Most accurate on training set.
2. Most accurate on test set.
3. Best at generalization.
4. Performance independent of starting weights.
5. Performance independent of training exemplar order.
TRAINING:
6. Trains in fewest epochs.
7. Trains in fewest Floating Point/Integer Operations.
8. Trains in least clock time.
9. Trains in fewest exemplars.
10. Uses least memory.
TOPOLOGY:
11. Has fewest layers.
12. Has fewest nodes.
13. Has fewest interconnects.
14. Distributed representation (fault tolerant)
I know that there is no explaination of what each of these mean, which
means that they are open to some interpretation. I would appreciate any
comments about additions to this list.
Dale E. Nelson
nelsonde%avlab.dnet@wrdc.af.mil
------------------------------
Subject: Re: Taxonomy of Neural Network Optimality
From: Scott.Fahlman@SEF-PMAX.SLISP.CS.CMU.EDU
Date: Tue, 30 Jul 91 12:33:03 -0400
PERFORMANCE:
1. Most accurate on training set.
2. Most accurate on test set.
3. Best at generalization.
What does this mean if not the same as 2? Also, "most accurate" might mean
number of cases wrong or something like sum-squared error, depending on the
problem.
4. Performance independent of starting weights.
5. Performance independent of training exemplar order.
TRAINING:
6. Trains in fewest epochs.
Some problems and algorithms just don't fit into epochs. Probably better
to use "pattern presentations", but some algorithms don't even fit into
that.
7. Trains in fewest Floating Point/Integer Operations.
8. Trains in least clock time.
Machine-dependent, of course, so it says very little about the algorithm.
9. Trains in fewest exemplars.
10. Uses least memory.
TOPOLOGY:
11. Has fewest layers.
"Layers" may be ill-defined. Maybe look instead at the longest path from
input to output.
12. Has fewest nodes.
13. Has fewest interconnects.
14. Distributed representation (fault tolerant)
A few others:
15. How hard it is to partition/parallelize the algorithm?
16. How many parameters must the user adjust, and how critical are the
adjustments?
17. Related to 16: What chance of immediate success on a new problem?
18. Range of problems covered:
Discrete vs. analog inputs and outputs
Can it handle time series?
Can it handle noisy data? (i.e misclassifying a few training points
leads to better generalization)
19. {Debugged, supported, portable, free} implementation available?
20. If not, how hard it the algorithm to implement?
21. Biologically plausible?
22. How does it scale with problem size?
-- Scott
------------------------------
Subject: commercial applications of N.N. - Exploratory Action Neurocomputing
From: BATTITI%ITNVAX.CINECA.IT@ICINECA.CINECA.IT
Date: Thu, 01 Aug 91 12:15:00 +0100
Dear readers of Neuron Digest,
in the framework of the Esprit Exploratory Action on Neurocomputing
(prof. John Taylor - King's College London), I am in charge of collecting
information about COMMERCIAL APPLICATIONS of neural nets. The project
aims at assessing the current situation on a world-wide basis. We are
interested both in R&D projects and fielded applications, if possible
with an analysis of the strengths and weaknesses of different models,
difficulties encountered, comparisons with "traditional" approaches.
Both direct information and pointers to other reference persons are
appreciated.
The results of this project will be available to the interested
people by the end of the current year.
Roberto Battiti
Dip. di Matematica
Universita` di Trento
38050 Povo (Trento)
Italy
tel: + 39 - 461 - 88 - 1639
fax: + 39 - 461 - 88 - 1624
e-mail: battiti@itnvax.cineca.it
DECNET: 37953::BATTITI
------------------------------
Subject: Neural Nets in Information Retrieval
From: SCHOLTES <@hplabs.hpl.hp.com,@BITNET.CC.CMU.EDU:SCHOLTES@ALF.LET.UVA.NL>
Date: Tue, 30 Jul 91 21:10:00 +0700
Recently, we started some research in the possible applications of Neural
Nets in Information Retrieval. At this moment we are trying to compile a
list of literature references and names of other people interested in
this subject.
Any information would be greatly appreciated. I will put the final list
on the network.
Thanks,
Jan Scholtes
*******************************************************************************
Jan C. Scholtes
University of Amsterdam
Faculty of Arts
Department of Computational Linguistics
Dufaystraat 1
1075 GR AMSTERDAM
The Netherlands
Tel: +31 20 6794273
Fax: +31 20 6710793
Email: scholtes@alf.let.uva.nl
*******************************************************************************
------------------------------
Subject: Research Associate position in U.K.
From: erh@minster.york.ac.uk
Date: 30 Jul 91 14:57:30 +0000
UNIVERSITY OF YORK
Department of Computer Science
Research Associate - Vision by Associative Reasoning
An opportunity exists for a research associate to join an
active group investigating the use of connectionist
approaches for scene interpretation. The successful appli-
cant will be involved in developing hierarchical and multis-
cale methods for processing uncertain image data. This
research forms part of a collaborative project involving
British Aerospace, Defence Research Agency (formerly RSRE) -
Malvern, and the University of Surrey. The overall goal is
to understand how to construct parallel distributed systems
for visual information processing and to apply them to
aerial scene interpretation.
Although the post would suite an individual with a back-
ground in any mathematical or physical science, experience
of computer vision, image processing, neural networks or
pattern recognition would be of particular value.
This post is funded under the DTI-SERC Information
Engineering Programme; The appointment will be for a period
of 21 months and will be on the RA1A scale.
Informal enquires about this post can be made to Dr Edwin
Hancock on 0904 43 3374. Applications consisting of two
copies of a full curriculum vitae and the names of two
referees should be sent to the Personnel Officer, University
of York, York Y01 5DD to arrive no later then 16 August
1991.
------------------------------
Subject: Neural Nets in Information Retrieval References
From: SCHOLTES <@hplabs.hpl.hp.com,@BITNET.CC.CMU.EDU:SCHOLTES@ALF.LET.UVA.NL>
Date: Sun, 04 Aug 91 14:59:00 +0700
Hereby the compiled list of received reactions on work done in
Information Retrieval and Connectionist or Neural Systems. Please keep me
informed of any new work in this field.
Regards,
Jan Scholtes
University of Amsterdam
Faculty of Arts
Department of Computational Linguistics
scholtes@alf.let.uva.nl
*********************************************************************
References Neural Nets in Information Retrieval
[Allen, 1991]: Allen, R.B. (1991). Knowledge Representation and
Information Retrieval with Simple Recurrent Networks.. Work. Notes of the
AAAI SSS on Connectionist Natural Language Processing. March 26th-28th
1991, Palo Alto, CA., pp. 1-6.
[Belew et al., 1988]: Belew, R.K. and Holland, M.P. (1988). A Computer
System Designed to Support the Near-Library User of Information
Retrieval. Microcomputers for Information Management, Vol. 5, No. 3,
December 1988, pp. 147-167.
[Belew, 1986]: Belew, R.K. (1986). Adaptive Information Retrieval:
Machine Learning in Associative Networks. Ph.D. Dissertation, Univ.
Michigan, CS Department, Ann Harbor, MI.
[Belew, 1987]: Belew, R.K. (1987). A Connectionist Approach to Conceptual
Information Retrieval. Proc. of the First Intl. conf. on AI and Law, pp.
116-126. ACM Press.
[Belew, 1989]: Belew, R.K. (1989). Adaptive Information Retrieval: Using
a Connectionist Representation to Retrieve and Learn About Documents.
Proc. SIGIR-89, June 11th-20th, 1989. Cambridge, MA.
[Brachman et al., 1988]: Brachman, R.J. and McGuinness, D.L. (1988).
Knowledge Representation, Connecitonism, and Conceptual Retrieval.
SIGIR-88,
[Doszkocs et al., 1990]: Doszkocs, T.E., Reggia, J. and Lin, X. (1990).
Connectionist Models and Information Retrieval. Ann. Review of
Information Science and Technology, Vol. 25, pp. 209-260.
[Eichmann et al., 1991]: Eichmann, D.A. and Srinivas, K. (1991). Neural
Network-Based Retrieval from Reuse Repositories. CHI '91 Workshop on
Pattern Recognition and Neural Networks in Human-Computer Interaction,
April 28th, 1991. New Orleans, LA.
[Eichmann et al., 1992]: Eichmann, D.A. and Srinivas, K. (1992). Neural
Network-Based Retrieval from Reuse Repositories. In: Neural Networks and
Pattern Recognition in Human Computer Interaction (R. Beale and J.
Findlay, Eds.), Ellis Horwood Ltd, WS, UK.
[Gersho et al., 1990]: Gersho, M. and Reiter, R. (1990). Information
Retrieval using a Hybrid Multi-Layer Neural Network. Proceedings of the
IJCNN, San Diego, June 17-21, 1990, Vol. 2, pp. 111-117.
[Honkela et al., 1991]: Honkela, T. and Vepsalainen, A.M. (1991).
Interpreting Imprecise Expressions: Experiments with Kohonen's
Self-Organizing Maps and Associative Memory. Proc. of the ICANN '91, June
24th-28th, Helsinki, Vol. 1, pp. 897-902.
[Jagota, 1990]: Jagota, A. (1990). Applying a Hopfield-style Network to
Degraded Printed Text Restoration. Proc. of the 3rd Conference on Neural
Networks and PDP, Indiana-Purdue University.
[Jagota, 1990]: Jagota, A. (1990). Applying a Hopfield-Style Network to
Degraded Text Recognition. Proc. of the IJCNN 1990,
[Jagota, 1991]: Jagota, A. (1991). Novelty Detection on a Very Large
Number of Memories in a Hopfield-style Network. Proc. of the IJCNN, July
8th-12th, 1991. Seattle, WA,
[Jagota, et al., 1990]: Jagota, A. and Hung, Y.-S. (1990). A Neural
Lexicon in a Hopfield-style Network. Proceedings of the IJCNN,
Washington, 1990, Vol. 2, pp. 607-610.
[Mitzman et al., 1990]: Mitzman, D. and Giovannini, R. (1990).
ActivityNets: A Neural Classifier of Natural Language Descriptions of
Economic Activities. Proc. of the Int. Workshop on Neural Nets for
Statistical and Economic Data, Dublin, December 10-11,
[Mozer, 1984]: Mozer, M.C. (1984). Inductive Information Retrieval Using
Parallel Distributed Computation. ICS Technical Report 8406, La Jolla,
UCSD.
[Rose et al., 1989]: Rose, D.E. and Belew, R.K. (1989). A Case for
Symbolic/Sub-Symbolic Hybrids. Proc. of the Cogn. Science Society, pp.
844-851.
[Rose et al., 1991]: Rose, D.E. and Belew, R.K. (1991). A Connectionist
and Symbolic Hybrid for Improving Legal Research. Int. Journal of
Man-Machine Studies, July 1991,
[Rose, 1990]: Rose, D.E. (1990). Appropriate Uses of Hybrid Systems. In:
Connectionist Models: Proc. of the 1990 Summer School, pp. 277-286].
Morgan-Kaufman Publishers.
[Rose, 1991]: Rose, D.E. (1991). A Symbolic and Connectionist Approach to
Legal Information Retrieval. Ph.D. Dissertation, UCSD, La Jolla, CA.
[Scholtes, 1991]: Scholtes, J.C. (1991). Filtering the Pravda with a
Self-Organizing Neural Net. Submitted to the Bellcore Workshop on High
Performance Information Filtering, November 5th-7th 1991, Chester, NJ.
[Scholtes, 1991]: Scholtes, J.C. (1991). Neural Nets and Their Relevance
in Information Retrieval. TR Dep. of Computation Linguistics, August
1991. University of Amsterdam.
[Scholtes, 1991]: Scholtes, J.C. (1991). Neural Nets versus Statistics in
Information Retrieval. Submitted to NIPS*91, December 2nd-5th 1991,
Boulder, Colorado.
[Scholtes, 1991]: Scholtes, J.C. (1991). Unsupervised Learning and the
Information Retrieval Problem. Submitted to IJCNN November 18th-22nd
1991, Singapore.
[Scholtes, 1992]: Scholtes, J.C. (1992). Filtering the Pravda with a
Self-Organizing Neural Net. Submitted to the Symposium on Document
Analysis and Information Retrieval. March 16th-18th 1992, Las Vegas, NV.
[Wermter, 1991]: Wermter, S. (1991). Learning to Classify Neural Language
Titles in a Recurrent Connectionist Model. Proc. of the ICANN '91, June
24th-28th, Helsinki, Vol. 2, pp. 1715-1718.
********************************************************************
------------------------------
Subject: postdoctoral position
From: Andy Barto <barto@envy.cs.umass.edu>
Date: Thu, 08 Aug 91 16:15:57 -0400
Postdoctoral Position in Computational Neuroscience.
I am looking for applicants for a postdoctoral position for the study of
computational aspects of the control of movement. The position will
involve working as a member of an interdisciplinary group on the modeling
and simulation of neural systems that control arm movements. The ideal
candidate would have experience in both neurophysiology and connectionist
modelling, with specific interests in learning algorithms and the
dynamics of nonlinear recurrent networks.
Andy Barto
Department of Computer Science
University of Massachusets at Amherst
Send curriculum vitae and two
references to: Gwyn Mitchell, Department of Computer Science,
University of Massachusets, Amherst MA 01003.
------------------------------
Subject: email address
From: xue@nimbus.anu.edu.au (Xue YANG)
Date: Thu, 08 Aug 91 17:52:57 -0500
If anybody knows the email address for the following person, please let
me know.
Bryan J. Travis
Los Alamos National Laboratory, Los Alamos, NM 87545
Thanks!
Xue YANG
Computer Science Laboratory
Research School of Physical Sciences and Engineering
Australian National University
xue@nimbus.anu.edu.au
------------------------------
Subject: ACNN'92 Final Call
From: Barry Flower <barryf@ee.su.OZ.AU>
Date: Thu, 08 Aug 91 11:47:23 +1000
FINAL CALL FOR PAPERS & ADVANCE REGISTRATION
(Deadline for Submissions is August 30, 1991)
Third Australian Conference On Neural Networks
(ACNN'92)
3rd - 5th February 1992
The Australian National University,
Canberra, Australia
The third Australian conference on neural networks will be held in
Canberra on February 3rd-5th 1992, at the Australian National University.
This conference is interdisciplinary, with emphasis on cross
discipline communication between Neuroscientists, Engineers, Computer
Scientists, Mathematicians and Psychologists concerned with understanding
the integrative nature of the nervous system and its implementation in
hardware/software. The categories for presentation and submissions
include:
1 - Neuroscience: Integrative function of neural networks in vision,
audition, motor, somatosensory and autonomic functions; Synaptic
function; Cellular information processing;
2 - Theory: Learning; generalisation; complexity; scaling; stability;
dynamics;
3 - Implementation: Hardware implementation of neural nets; Analog and
digital VLSI implementation; Optical implementations;
4 - Architectures and Learning Algorithms: New architectures and
learning algorithms; hierarchy; modularity; learning pattern
sequences; Information integration;
5 - Cognitive Science and AI: Computational models of cognition and
perception; Reasoning; Concept formation; Language acquisition;
Neural net implementation of expert systems;
6 - Applications: Application of neural nets to signal processing and
analysis; Pattern recognition: Speech, machine vision; Motor
control; Robotic;
ACNN'92 will feature an invited keynote speaker. The program will
include, presentations and poster sessions. Proceedings will be printed
and distributed to the attendees. There will be no parallel sessions.
Invited Keynote Speaker
~~~~~~~~~~~~~~~~~~~~~~~
Professor Terrence Sejnowski, The Salk Institute and University of
California at San Diego.
Call for Papers
~~~~~~~~~~~~~~~
Original research contributions are solicited and will be internationally
refereed. Authors must submit the following by August 30, 1991:
* Five copies of a four page (maximum) manuscript
* Five copies of a 100 word (maximum) abstract
* Covering letter indicating submission title and
correspondence addresses for authors.
Each manuscript and abstract should clearly indicate submission category
(from the six listed) and author preference for oral or poster
presentations.
Note that names or addresses of the authors should be omitted from the
manuscript and the abstract and should be included only on the covering
letter. Authors will be notified by November 1, 1991 whether their
submissions are accepted or not, and are expected to prepare a revised
manuscript (up to four pages) by December 13, 1991.
Submissions should be mailed to: Mrs Agatha Shotam
Secretariat ACNN'92
Sydney University
Electrical Engineering
NSW 2006 Australia
Registration material may be obtained by writing to Mrs Agatha Shotam at
the address above or by:
Tel: (+61-2) 692 4214
Fax: (+61-2) 660 1228
Email: acnn92@ee.su.oz.au.
Deadline for Submissions is August 30, 1991
Venue
~~~~~
Australian National University, Canberra, Australia.
Principal Sponsors
~~~~~~~~~~~~~~~~~~
* Australian Telecommunications & Electronics Research Board
* Telectronics Pacing Systems
ACNN'92 Organising Committee
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Organising Committee:
Chairman: Marwan Jabri, (SU)
Technical Program Chairman: Bill Levick, (ANU)
& Ah Chung Tsoi, (QU)
Stream Chairs:
Neuroscience: Max Bennent (SU)
Theory: Ah Chung Tsoi (QU)
Cognitive SCience & AI: Max Coltheart (MU)
Implementations: Marwan Jabri/Steve Pickard (SU)
Applications: Yianni Attikiouzel (WA)
Local Arrangements Chair: M Srinivasan (ANU)
Institutions Liason Chair: N Nandagopal (DSTO)
Sponsorship Chair: Steve Pickard (SU)
Publicity Chair: Barry Flower (SU)
Publications Chair: Philip Leong (SU)
Secretariat/Treasurer: Agatha Shotam (SU)
Registration
~~~~~~~~~~~~
The registration fee to attend ACNN'92 is:
Full Time Students $A75
Academics $A200
Other $A300
A discount of 20% applies for advance registration. Registration forms
must be posted before December 13th, 1991, to be entitled to the discount.
To be eligible for the Full Time Student rate a letter from the Head of
Department as verification of enrolment is required.
Accommodation
~~~~~~~~~~~~~
To assist attendees in obtaining accommodation, a list of hotels and
colleges close to the conference venue is shown below.
Lakeside Hotel Olims Canberra Hotel
London Circuit Cnr. Ainslie & Limestone Ave
Canberra City ACT 2600 Braddon ACT 2601
Tel: +61(6) 247 6244 Tel: +61(6) 248 5511
Fax: +61(6) 257 3071 Tel: +61(6) 247 0864
Macquarie Private Hotel Capital Hotel
18 National Circuit 108 Northbourne Ave
Barton ACT 2600 Canberra City ACT 2600
Tel: +61(6) 273 2325 Tel: +61(6) 248 6566
Fax: +61(6) 273 4241 Tel: +61(6) 248 8011
Brassey Hotel Canberra Rex Hotel
Belmore Gardens Northbourne Ave
Barton ACT 2600 Canberra City ACT 2600
Tel: +61(6) 273 3766 Tel: +61(6) 248 5311
Fax: +61(6) 273 2791 Tel: +61(6) 248 8357
Accommodation on Australian National University Campus
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
University House Burton & Garran Hall
Tel: +61(6) 249 5211 Tel: +61(6) 249 3083
Fax: +61(6) 249 5252 Fax: +61(6) 249 3136
Important Conference Dates
~~~~~~~~~~~~~~~~~~~~~~~~~~
30th August 1991 Deadline for Submissions
1st Novemeber 1991 Notification of Acceptance
13th December 1991 Deadline for Camera ready paper
13th December 1991 Deadline for advance registration with discount
3rd-5th February 1992 Conference
=---------------------------------------------------------------------------
ACNN'92
Registration Form
I wish to attend the conference ______
I wish to be on your mailing list ______
My research interests are:
Neuroscience _____ Modelling _____
Implementation _____ Other: ___________________________________
Name: _______________________________________________________________________
Title: ______________________________________________________________________
Organisation: _______________________________________________________________
Occupation: _________________________________________________________________
Address: ____________________________________________________________________
_________________________________________ City: _____________________________
State: ________________ Post Code: ____________ Country: ____________________
Tel: ____________________________________ Fax: ______________________________
E-Mail: _____________________________________________________________________
Find enclosed a cheque for the sum of ($A): ____________
(Deduct 20% of original registration cost if posted before December 13th, 1991)
OR
Please charge my credit card for the sum of (A$): ____________
(Deduct 20% of original registration cost if posted before December 13th, 1991)
Mastercard/Visa Number: ______________________ Expiry Date: ________________
Signature: ____________________________________ Date: _______________________
To register, please fill in this form and return it together with payment:
Secretariat ACNN'92
University of Sydney
Electrical Engineering
Sydney NSW 2006
Australia
------------------------------
End of Neuron Digest [Volume 7 Issue 44]
****************************************
