Copy Link
Add to Bookmark
Report
Neuron Digest Volume 02 Number 04
NEURON Digest 11 FEB 1987 Volume 2 Number 4
Topics in this digest --
Queries - Connectionism
Reports - Speech/Handwriting Network &
Report on applicaton of Statistical Mechanics
News - SCIENCE NEWS Article
Conferences/Call for papers - IEEE First Annual Conference
on Neural Networks
Bibliographies - RE: Connectionism
----------------------------------------------------------------------
Date: 4-FEB-1987 02:07
From: DJB@LAFITE.BELLCORE.COM
Subj: Speech/Handwriting Network
The following abstract may interest those who would like
to apply learning networks to speech or character recognition
problems. The paper appeared in Proc. IEEE Conference on Systems,
Man, and Cybernetics, Atlanta, GA, 1621-1625, October, 1986.
A Neural Network Digit Recognizer
D. J. Burr
Bell Communications Research
Morristown, New Jersey 07960
New robust learning methods [1-3] have stimulated a
renewed interest in neural networks for cognitive modeling
and artificial intelligence. This paper presents new
results applying a neural network to problems in speech and
handwriting recognition. A layered neural network is used
to recognize both spoken and handwritten numerals and per-
formance is compared to a conventional nearest neighbor
classifier. Recognition accuracies exceeding 98% were
obtained for both neural networks and nearest neighbor clas-
sifiers, indicating comparable performance of both methods.
------------------------------
Date: 5-FEB-1987 10:13
From: HUBERMAN.PA@XEROX.COM
Subj: Report on applicaton of Statistical Mechanics
The following report describes the application of statistical mechanics
techniques to parallel distributed computation. Copies may be obtaining
from HUBERMAN.PA@XEROX.ARPA
"Phase Transitions in Artificial Intelligence Systems"
B. A. Huberman and T. Hogg
We discuss the applicability of statistical mechanics to large scale
computational systems and show that they can have sudden and dramatic
changes in overall behavior which cannot be foreseen by examining
smaller scale systems. Moreover, this phenomenon, which is similar to
the phase transitions encountered in many physical situations, is
largely independent of local details and has important consequences. The
resulting phase changes can be quantitatively inferred from generic
parameters of the system. Also, the universal nature of this behavior
allows us to predict its occurrence in a large variety of situations.
These include heuristic searches, production systems, disambiguation
strategies in linguistics, and spreading activation networks.
These phase transitions are characterized by event horizons in
space-time that determine the range of causal connections between
processes. At transition, these event horizons undergo explosive changes
in size. This provides a new paradigm with which to analyze the behavior
of large scale computation and determine its generic features.
------------------------------
Date: 3-FEB-1987 17:18
From: EE.WORDEN@A20.CC.UTEXAS.EDU
Subj: SCIENCE NEWS Article
Ivan Amato, "Growing 'Brains' in a Computer", Science News,
Vol.131, No.4, 24 January 1987, pp.60-61.
This short article is a "popular science" type discussion of
Ralph Linsker's work:
"Linsker models a self-developing multilayered network
that is strikingly similar to that observed in the
first few stages of the mammalian visual system."
Related journal articles are mentioned, but not fully referenced.
The work of several other neural network researchers is briefly
touched upon.
------------------------------
Date: 7-FEB-1987 01:32
From: MIKE%BUCASA.BITNET@WISCVM.WISC.EDU "Michael Cohen"
Subj: IEEE First Annual Conference on Neural Networks
IEEE First Annual Conference on Neural Networks, San Diego,
California, 21-24 June 1987. Requests from many scientists who
heard about the meeting only recently have led to a revised
deadline for abstracts and papers.
Extended abstracts should be submitted for conference
presentation by April 1, 1987
Abstracts received after April 1, 1987 will be returned.
Please submit abstract plus 4 clean copies. Abstracts
must be neatly typed, single spaced, and no more than four
pages.
Abstracts will be carefully refereed as they are received.
Authors of accepted abstracts will be notified as soon after
receipt as possible, and no later than the first week of May.
Authors of accepted abstracts will promptly be sent materials
for paper preparation. Papers can be up to 8 pages in length.
Final papers for publication in the book of proceedings are
due no later than June 21, 1987 at the meeting. The
proceedings will be published in the Fall of 1987.
Address all correspondence referring to abstracts and papers
to:
Maureen Caudill
IEEE - ICNN
10615G Tierrasanta Blvd.
Suite 346
San Diego, California 92124
Telephone: (619) 457-5550, ext. 221
------------------------------
Date: 9-FEB-1987 22:12
From: LAWS@SRI-STRIPE.ARPA
Subj: Connectionism
I wonder if anyone could give me some -> Up to date <- pointers to current
literature on the field of connectionism/neural networks. The only things
I seem to be able to dig up of our Technical libraries (in Sweden) is stuff
about moths and leeches and other equally wierd things.
Where's the computer-related stuff??? Please give some hints complete with
which company that sells them, ISBN, etc..
Thank you very, very much.
/Peter (turbo) Svenson pesv@enea (UUCP) enea!pesv@seismo.arpa (ARPA)
"Zen can make you help other people, or, failing that, at least get them off
your back."
------------------------------
Date: 9-FEB-1987 22:13
From: LAWS@SRI-STRIPE.ARPA
Subj: Connectionism/Neural Net references
>Peter (turbo) Svenson pesv@enea (UUCP) enea!pesv@seismo.arpa (ARPA)
>I wonder if anyone could give me some -> Up to date <- pointers to current
>literature on the field of connectionism/neural networks. The only things
>I seem to be able to dig up of our Technical libraries (in Sweden) is stuff
>about moths and leeches and other equally wierd things.
Enclosed is a small sampling of what is available. Hope it helps. The
format is bib, but refer should work.
(Some of the references became a little scrambled courtesy of uncompact.
Sorry if bib/refer complain).
Jonathan A. Chandross
allegra!rutgers!topaz!chandros
%A Dell, Gary S.
%T A Spreading-Activation Theory of Retrieval in Sentence Production
%J Psychological Review
%V 93
%N 3
%D 1983
%P 283-321
%A Fahlman, Scott E.
%T Representing Implicit Knowledge
%B Parallel Models of Associative Memory
%E E Geoffrey E. Hinton
%E James A. Anderson
%D 1981
%I Lawrence Erlbaum Associates
%C Hillsdale, New Jersey
%A Fanty, Mark
%T Context-Free Parsing in Connectionist Networks
%R Tech Report TR174
%I Department of Computer Science, University of Rochester
%D Nov. 1985
%A Feldman, Jerome A.
%T A Connectionist Model of Visual Memory
%B Parallel Models of Associative Memory
%E Geoffrey E. Hinton
%E James A. Anderson
%D 1981
%I Lawrence Erlbaum Associates
%C Hillsdale, New Jersey
%A Feldman, Jerome A.
%A Dana H. Ballard
%T Connectionist Models and Their Properties
%J Cognitive Science
%V 6
%P 205-254
%D 1982
%A Feldman, Jerome A.
%T Dynamic Connections in Neural Networks
%J Biological Cybernetics
%I Springer-Verlag
%V 46
%D 1982
%P 27-39
%A Fodor, Jerry A.
%T Information and Association
%O This paper is a critique of connectionism. Author is with department
of Philosophy, MIT, Cambridge Massachussetts.
%A Hopfield, John J.
%T Neural Networks and physical systems with emergent collective
computational abilities
%J Proceedings National Acadamy of Science
%V 79
%P 2554-2558
%D Apr. 1982
%A Hopfield, John J.
%A David W. Tank
%T Simple "Neural" Optimization Networks: An A/D Converter, Signal Decision
Circuit, and a Linear Programming Circuit
%J IEEE Transactions on Circuits and Systems
%V CAS-33
%N 5
%P 533-541
%D May 1986
%A Hopfield, John J.
%A David W. Tank
%T Collective Computation with Continuous Variables
%J Disordered Systems and Biological Organization
%I Springer-Verlag
%O In press, 1986
%A Hopfield, John J.
%A David W. Tank
%T "Neural" Computation of Decisions in Optimization Problems
%J Biological Cybernetics
%I Springer-Verlag
%V 52
%D 1985
%P 141-152
%A Kosslyn, Stephen M.
%A Gary Hatfield
%T Representation without Symbol Systems
%J Social Research
%V 51
%N 4
%D 1984
%P 1019-1044
%O Winter 1984
%A Matthews, Robert J.
%T Problems with Representationalism
%J Social Research
%V 51
%N 4
%D 1984
%O Winter 1984
%P 1065-1097
%A McClelland, James L.
%A Jerome Feldman
%A Beth Adelson
%A Gordon Bower
%A Drew McDermott
%T Connectionist Models and Cognitive Science: Goals, Directions and
Implications
%D Jan. 1987
%O National Science Foundation Grant Proposal
%A McClelland, James L.
%A David E. Rumelhart
%A The PDP Research Group
%T Parallel Distributed Processing: Explorations in the Microstructures
of Cognition
%I MIT Press
%C Cambridge, Massachusetts
%D 1986
%O Two Volume Set
%A Plaut, David C.
%J Visual Recognition of Simple Objects by a Connection Network
%R Tech Report TR143
%I Computer Science Department, University of Rochester
%D Aug. 1984
%A Pylyshyn, Zenon W.
%T Computation and Cognition: Toward a Foundation for Cognitive Science
%I MIT Press
%D 1984
%C Cambridge, Massachusetts
%A Reiss, Richard F.
%T An Abstract Machine Based on Classical Association Psychology
%B Proceedings 1962 Joint Computer Conference
%I AFIPS
%D 1962
%V 21
%A Shastri, Lokendra
%A Jerome A. Feldman
%T Semantic Networks and Neural Nets
%R Tech Report TR131
%I Computer Science Department, University of Rochester
%D June 1984
%A Schwartz, Robert
%T "The" Problems of Representation
%J Social Research
%V 51
%N 4
%D 1984
%P 1047-1064
%O Winter 1984
%A Touretzky, David S.
%A Geoffrey E. Hinton
%T Symbols Among the Neurons: Details of a Connectionist Inference
Architecture
%J IJCAI
%D Aug. 1985
------------------------------
Date: 9-FEB-1987 22:13
From: LAWS@SRI-STRIPE.ARPA
Subj: Re: Connectionism
Ackley, D.H., Hinton, G.E., and Sejnowski, T.J. " A learning algorithm for
Boltzmann Machines", COGNITIVE SCIENCE 9, pp. 147-149, 1985.
Ballard, D.H., Hinton, G.E., and Sejnowski, T.J. "Parallel visual computation",
NATURE (London) 306, pp.21-26, 1983
Ballard, D.H., "Cortical connections and parallel processing: structure
and function", BEHAV. BRAIN SCI., 1985.
Barto, A.G. "Learning by statistical cooperation of self-interested neuron-
like computing elements", HUMAN NEUROBIOLOGY 4, pp. 229-256, 1985.
Feldman, J.A. and Ballard, D.H., "Connectionist models and their properties",
COGNITIVE SCIENCE 6, pp. 205-254, 1982.
Hinton, G.E. "Learning in Massively Parallel Nets", an invited talk at the
AAAI 1986 confence in Philadelphia. (The talk is not published in the
proceedings but may be available from the author--don't quote me).
Hinton, G.E. and Sejnowski, T.J. "Optimal perceptual inference" in
PROCEEDINGS OF THE IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION
AND PATTERN RECOGNITION, pp. 448-453, 1983.
Hopfield, J.J. and Tank, D.W., " 'Neural' computation of decisions in
optimization problems", BIOLOGICAL CYBERNETICS 52, pp. 141-152, 1985.
Kienker, P.K, Sejnowski, T.J., Hinton, G.E., Schumacher, L.E., "Separating
figure From ground with a parallel network", PERCEPTION 15, pp. 197-216.
Kirkpatrick, S., Gelatt, S., and Vecchi, M., "Optimization by Simulated
Annealing", SCIENCE 220, pp. 672-680, 1983.
Rumelhart, D.E., MccClelland, J.L. and the PDP research group, PARALLEL
DISTRIBUTED PROCESSING: EXPLORATIONS IN THE MICROSTRUCTURE OF COGNITION,
MIT Press, Cambridge Mass., 1986.
Saund, Eric "Abstraction and Representation of Continuous Variables
in Connectionist Networks", AAAI CONFERENCE PROCEEDINGS, pp. 638-644,
1986.
Sejnowski, T.J., Kienker, P.K., and Hinton, G.E., "Learning symmetry groups
with hidden units: Beyond the perceptron", PHYSICA D 22, 1986.
These references offer a starting point.
------------------------------
End of NEURON Digest
********************
