http:^^www.cs.utexas.edu^users^nl-acq^paper-history.html

This data set contains WWW-pages collected from computer science departments of various universities

MIME-Version: 1.0
Server: CERN/3.0
Date: Tuesday, 07-Jan-97 15:45:28 GMT
Content-Type: text/html
Content-Length: 35843
Last-Modified: Monday, 25-Nov-96 21:50:20 GMT

<title>UTCS nl-acq paper history</title>
<center>
<h2>Natural Language Acquisition Group</h2>
<h3>at the University of Texas at Austin</h3>
<h1>Previously Discussed Papers</h1>
</center>
<p>
<left><!WA0><!WA0><img src=http://www.cs.utexas.edu/users/nl-acq/gifs/hline.gif></left>
<p>

<PRE>
Papers discussed (incl. some additional papers):

<A NAME="1992">
[discussed on April 17, 1992]
Learning Words from Context, Hastings, Lytinen, & Lindsay,
ML-91 Workshop

[discussed on April 17, 1992]
Sumita, Eiichiro and Iida, Hitoshi,  "Experiments and Prospects
of Example-Based Machine Translation" Proc 29th Mtng of ACL, 1991,
pp 185-192.

[discussed on May 1, 1992]
W. A. Gale and K. W. Church, "A Program for Aligning sentences
in  bilingual corpora." ACL-91, pp 177-184.

[additional reading]
P. Brown, J.c.Lai, & R. Mercer, "Aligning sentences in parallel
corpora"  ACL-91, pp 169-176

[discussed on May 1, 1992]
P. Brown, J. Cocke, S. Della Pietra, F. Jelinek, R. Mercer and P. Rossin,
"A Statistical Approach to Machine Translation"
COLING-88, pp. 71-76
where they basically treat French as a garbled version of English and
use statistical techniques to de-cryptify it. 

[discussed on May 22, 1992]
Steven Pinker, "Language Acquisition", from "Foundations of Cognitive Science",
ed. by Michael Posner, MIT Press, 1989, Chapter 9

[distibuted as further reading for May 22, 1992 discussion]
Chapter 4 from Slobin, "Psycholinguistics", which "gives some cogent ideas
about NL acquisition from the psycholinguistic point of view".

[discussed on June 19, 1992]
Miniature Language Acquisition: A touchstone for Cognitive Science,
Feldman, Lakoff, Stolke, & Weber, COGSCI-90

[discussed on June 19, 1992]
"Learning Spatial Concepts Using a Partially-Structured Connectionist
Architecture", Terry Regier, Berkeley TR-91-050, Oct. 1991

[further readings on topic discussed on June 19, 1992]
[available by ftp from icsi-ftp.berkeley.edu pub/techreports]
  Andreas Stolcke: Syntactic Category Formation with Vector Space Grammars
     COGSCI-91, pp.908--912 publ. 1989
  Andreas Stolcke: Learning Feature-Based Semantics with Simple Recurrent Networks
     TR-90-015 Berkeley, CA publ. 1990
  Terry Regier: Learning Perceptually Grounded Semantics in the ${L}_0$ Project
     Proc. 29th Annual Meeting ACL, pp. 138--145 publ. 1991
  Terry Regier: Learning Object-Relative Spatial Concepts in the ${L}_0$ Project
     COGSCI-91, pp.191--196 publ. 1991

[discussed July 7, 1992]
Distributed Representations, Simple Recurrent Networks, and Grammatical
Structure;  Elman; Machine Learning 7, 195-225 (Sept. 1991) 

[discussed July 31, 1992]
Induction of Augmented Transition Networks; Anderson, Cognitive Science 1977
or Readings on Machine Learning, pp. 774-790

[discussed August 21, 1992]
Learning Structural Descriptions of grammar rules from examples;
Berwick, IJCAI-79

[discussed on Sept. 4, 1992]
An architecture combining two RAAMs for translating Spanish<->English.
Some surprising results; extreme distributed point of view. My
favorite RAAM paper.
  Lonnie Chrisman: "Learning Recursive Distributed Representations for
  Holistic Computation", Connection Science, vol. 3, 1992, pages 345--366

[discussed on Sept. 4, 1992]
Parsing into RAAM representations.
  George Berg: "A Connectionist Parser with Recursive Sentence Structure
  and Lexical Disambiguation", AAAI-92, pages 32--37 (MIT Press)

[discussed on Sept. 18, 1992]
Lehnert, "Learning to Integrate Syntax and Semantics",
ML workshop, 1988.

[discussed on Sept. 18, 1992]
Zernik, "How Do Machine-Learning Paradigms Fare in Language
Acquisition?", ML workshop, 1988.

[discussed on Oct. 2, 1992]
St. John, Mark F.: "The Story Gestalt: {A} Model of Knowledge-Intensive
Processes in Text Comprehension", Cog. Sc. 1992, vol. 16, pp 271-276

[discussed on Oct. 2, 1992]
St. John, Mark F.: "Learning Language in the Service of a Task",
Cog. Sc. 1992, pp 271-276

[discussed on Oct. 16, 1992]
Hobbs, Jerry,  "Resolving Pronoun References"
from Lingua 1978, reprinted in Grosz et. al.,
Readings in Natural Language Processing.

[discussed on Oct. 16, 1992]
Pan, Haihua  "Interpreting Intrasentential Anaphora"
mss. 1992.

[discussed on Oct. 30, 1992]
Wolff, J. G. "Language Acquisition, data compression, and Generalization",
Language and Communication, 2, 1982.

[discussed on Nov. 13, 1992]
Anderson, "A Theory of Language Acquisition based on General
LEarning Principles", IJCAI, 1981.

[discussed on Dec. 11, 1992]
Ling, Cherwenka and Marinov, "A General Symbolic Pattern 
Associator", <hardcopy>

<A NAME="1993">
[discussed on Jan. 15, 1993]
Ezra Black, John Lafferty, Salim Roukos, "Development 
and Evaluation of a Broad-Coverage Probabilistic Grammar 
of English-Language Computer Manuals"
30th ACL Conf. 1992, pp.185-192

[discussed on Jan. 29, 1993]
J. Zelle, R. Mooney: "Learning Semantic Grammars with
Constructive Inductive Logic Programming" [Submitted to
AAAI '93]

[discussed on Feb. 12, 1993]
P. Langley and J. Carbonell, "Language Acquisition and Machine Learning"
   from the book, "Mechanisms of Language Acquisition", 1985

[discussed on Feb. 26, 1993]
Berwick, "Parsability and learnability"
from the book, "Mechanisms of Language Acquisition", 1985

[discussed on March 12, 1993]
Schuetze, Hinrich, "Word Space", from book "Advances in Neural Information 
Processing Systems 5", ed. C. L. Giles, S. J. Hanson and J. D. Cowan, 
San Mateo CA: Morgan Kaufmann, 1993

[discussed on March 26, 1993]
Claire Cardie, "Learning to Disambiguate Relative Pronouns" AAAI-92
[the following paper is virtually identical:]
Claire Cardie, "Corpus-based Acquisition of Relative Pronoun Disambiguation
heuristics" ACL-92

[discussed on April 9, 1993]
Gregers Koch, "Computational Logico-Semantic Induction", Natural Language Understanding
and Logic Programming, II, 1988, pp. 107-133

[discussed on May 21, 1993]
Ulf Hermjakob, "Example Based Acquisition of Relevant Features and Grammar Learning
for Parsing and Machine Translation." (draft)

[discussed on June 4, 1993]
From the book, "Mechanisms of Language Acquisition", 1985
 -   Bates B. and MacWhinney B., "Competition, Variation and Language Learning." (Note:
        This is more lingusitic/cog sci, not a concrete model)

[discussed on June 18, 1993]
Donald Hindle and Mats Rooth, "Structural Ambiguity and Lexical Relations",
Comp. Ling. March 1993

[discussed on July 2, 1993]
Kenneth. W. Church and Robert L. Mercer, "Introduction to the Special Issue
on Computational Linguistics Using Large Corpora", Comp. Ling. March 1993

[discussed on July 30, 1993]
Rey-Long Liu, Von-Wun Soo, "An Empirical Study on Thematic Knowledge Acquisition 
Based on Syntactic Clues and Heuristics", ACL Proc. June '93, pp. 243 - 250

[discussed on Aug. 13, 1993]
Ted Briscoe and John Carroll, "Generalized Probabilistic LR Parsing of Natural
Language (Corpora) with Unification-Based Grammars", Comp. Ling. March 1993

[discussed on Aug. 27, 1993]
R. Weischedel, R. Schwarz, J. Palmucci, M. Meteer, L. Ramshaw: "Coping with Ambiguity
and Unknown Words through Probabilistic Models", Computational Linguistics June 1993, pp. 359-382

[discussed on Sept. 10, 1993]
Shannon D. Moeser and Albert S. Bregman, "Imagery and Language Acquisition",
Journal of Verbal Learning and Verbal Behaviour (JVLVB), 1973, vol. 12, pp. 91-98
[related paper (but not discussed):]
Shannon D. Moeser and Albert S. Bregman, "The Role of Reference in the Acquisition of a 
Miniature Artificial Language", Journal of Verbal Learning and Verbal Behaviour (JVLVB),
1972, vol. 11, pp. 759-769

[discussed on Sept. 24, 1993]
Risto Miikkulainen: "Subsymbolic Case-role Analysis of Sentences with embedded
clauses", TR AI93-202, July 1993

[discussed on Oct. 8, 1993]
McMillan, Mozer and Smolensky, "Dynamic Conflict Resolution in a Connectionist
Rule-Based System", IJCAI 93, pp1366-1371.

[discussed on Oct. 8, 1993]
Michael C. Mozer, Sreruupa Das, "A Connectionist Symbol Manipulator That
Discovers the Structure of Context-Free Languages", NIPS5, 1993, pp. 863-870
[related paper (but not discussed):]
Learning to recognize regular strings from positive and negative examples.
@InProceedings{WatrousKuhn:NIPS4,
  author =      "Watrous, Raymond L. and Kuhn, Gary M.",
  title =       "Induction of Finite-State Automata Using
                 Second-Order Recurrent Networks",
  booktitle =   "Advances in Neural Information Processing Systems 4",
  year =        1992,
  editor =      "Moody, J. E. and Hanson, S. J. and Lippman, R. P.",
  pages =       "309--316",
  publisher =   "Morgan Kaufmann Publishers",
  address =     "San Mateo, California",
}
[related paper (but not discussed):]
Similar to the above, but now they also extract the grammar from the
network.
@InProceedings{Giles:NIPS4,
  author =      "Giles, C. L. and Miller, C. B. and Chen, D. and Sun,
                 G. Z. and Chen, H. H. and Lee, Y. C.",
  title =       "Extracting and Learning an Unknown Grammar with
                 Recurrent Neural Networks",
  booktitle =   "Advances in Neural Information Processing Systems 4",
  year =        1992,
  editor =      "Moody, J. E. and Hanson, S. J. and Lippman, R. P.",
  pages =       "317--324",
  publisher =   "Morgan Kaufmann Publishers",
  address =     "San Mateo, California",
}
[related paper (but not discussed):]
This one looks like a pretty complete (35 pages) presentation of
their external stack idea. Maybe be more interesting as a NN technique
than language learning. We'll read it in my NN meeting this Friday; if
it turns out interesting language-acquisition-wise, I'll let you know.
@TechReport{sun:pushdown,
  author =      "G.Z. Sun and C.L. Giles and H.H. Chen and Y.C. Lee",
  title =       "The Neural Network Pushdown Automaton: {M}odel, Stack
                 and Learning Simulations",
  institution = "Department of Computer Science, University of
                 Maryland",
  year =        "1993",
  number =      "UMIACS-TR-93-77",
  address =     "College Park, MD"
}
[related paper (but not discussed):]
Looks like a shorter version of the above. Perhaps more appropriate to
this crowd.
@InProceedings{das:contextfree,
  author =      "Sreerupa Das and C. Lee Giles and Guo-Zheng Sun",
  title =       "Learning Context-free Grammars: {C}apabilities and
                 Limitations of a Recurrent Neural Network with an
                 External Stack Memory",
  booktitle =   COGSCI-92,
  year =        "1992",
  publisher =   LEA,
  address =     LEA-ADDR
}

[discussed on Oct. 22, 1993]
Brill, E. "Automatic Grammar Induction and Parsing Free Text: A
Transformation-Based Approach", ACL 93, pp. 259-265

[discussed on Oct. 22, 1993]
Black, Jelinek, et al. "Towards History-Based Grammars: Using Richer Models
for Probability-based Parsing", ACL 93, pp. 31-37.

[discussed on Nov. 5, 1993]
@InCollection{jain:generalization,
  author =      "Ajay N. Jain",
  title =       "Generalization Performance in {PARSEC}---{A} Structured
                 Connectionist Parsing Architecture",
  booktitle =   NIPS4,
  publisher =   KAUF,
  editor =      "John E. Moody and Stephen J. Hanson and Richard P.
                 Lippmann",
  year =        "1992",
  pages =       "209--216",
  address =     KAUF-ADDR
}

[discussed on Nov. 19, 1993]
Pereira, F. and Schabes, Y. "Inside-Outside reestimation from partially
bracketed corpora.  ACL 1992, 128-135.

[discussed on Dec. 3, 1993]
Langley, "Language acquisition through error recovery", Cognition and
Brain Theory, 5, 1982.

<A NAME="1994">
[discussed on Jan. 14, 1994]
Building a Large Annotated Corpus of English: The Penn Treebank,
Marcus, Marcinkiewicz, and Santorini, Comp Ling, 19,2.

[discussed on Jan. 28, 1994]
Nancy Chindor, Lynette Hirschman, David D. Lewis:
"Evaluating Message Understanding Systems: An analysis of the Third
Message Understanding Conference (MUC-3)", Comp. Ling. Sept 1993

[discussed on Feb. 11, 1994]
Eve V. Clark: "Meanings and Concepts", chapter 12 of book "Cognitive Development",
vol. 3 of series "Handbook of Child Psychology", pp. 787-840, Wiley 1983

[discussed on Feb. 25, 1994]
Derek Bickerton: "The Language Bioprogram Hypothesis", BBS (journal) 1984,
vol.7, pp. 173-221
[Risto: He makes a strong case for the innateness of certain linguistic
        principles, based on studies on pidgin and creole languages]

[discussed on Mar. 11, 1994]
Lin and Soo, "Augmenting and Efficiently utilizing Domain Theory
in Explanation-Based Natural Language Acquisition", ML92.