http:^^www.cs.utexas.edu^users^ml^ilp.html

This data set contains WWW-pages collected from computer science departments of various universities

MIME-Version: 1.0
Server: CERN/3.0
Date: Tuesday, 07-Jan-97 15:56:47 GMT
Content-Type: text/html
Content-Length: 27721
Last-Modified: Wednesday, 16-Oct-96 15:34:59 GMT

<title>Inductive Logic Programming</title>

<h1>Inductive Logic Programming</h1>

To view a paper, click on the open book image. <br> 
<br>


<ol>

<! ===========================================================================>

<a name="chill-ilp-96.ps.Z"</a>

<b><li>Inductive Logic Programming for Natural Language Processing</b>
Raymond J. Mooney<br>

<cite>Proceedings of the 6th International Inductive Logic Programming Workshop</cite>, pp. 205-224, Stockholm, Sweden, August 1996. <p>

<blockquote>
This paper reviews our recent work on applying inductive logic
programming to the construction of natural language processing
systems. We have developed a system, CHILL, that learns a parser from
a training corpus of parsed sentences by inducing heuristics that
control an initial overly-general shift-reduce parser.  CHILL learns
syntactic parsers as well as ones that translate English database
queries directly into executable logical form.  The ATIS corpus of
airline information queries was used to test the acquisition of
syntactic parsers, and CHILL performed competitively with recent
statistical methods.  English queries to a small database on
U.S. geography were used to test the acquisition of a complete natural
language interface, and the parser that CHILL acquired was more
accurate than an existing hand-coded system.  The paper also includes
a discussion of several issues this work has raised regarding the
capabilities and testing of ILP systems as well as a summary of our
current research directions.
</blockquote>

<!WA0><a href="file://ftp.cs.utexas.edu/pub/mooney/papers/chill-ilp-96.ps.Z">
<!WA1><img align=top src="http://www.cs.utexas.edu/users/ml/paper.xbm"></a><p>

<! ===========================================================================>

<a name="scope-proposal-96.ps.Z"</a>

<b><li> Integrating Explanation-Based and Inductive Learning Techniques
to Acquire Search-Control for Planning<br></b>
Tara A. Estlin<br>

Ph.D. proposal, Department of Computer Sciences, University of Texas
at Austin, 1996. <p>

<blockquote>
Planning systems have become an important tool for automating
a wide variety of tasks. Control knowledge guides a planner to find
solutions quickly and is crucial for efficient planning in most
domains.  Machine learning techniques enable a planning system to 
automatically acquire domain-specific search-control knowledge for
different applications.  Past approaches to learning control
information have usually employed explanation-based learning
(EBL) to generate control rules.  Unfortunately, EBL alone often
produces overly complex rules that actually decrease rather than
improve overall planning efficiency.  This paper presents a novel
learning approach for control knowledge acquisition that integrates
explanation-based learning with techniques from inductive logic
programming. In our learning system SCOPE, EBL is used to constrain
an inductive search for control heuristics that help a planner choose
between competing plan refinements. SCOPE is one of the few systems
to address learning control information for newer, partial-order
planners.  Specifically, this proposal describes how SCOPE learns
domain-specific control rules for the UCPOP planning algorithm. The
resulting system is shown to produce significant speedup in two
different planning domains, and to be more effective than a pure EBL
approach.  <p>

Future research will be performed in three main areas.
First, SCOPE's learning algorithm will be extended to include
additional techniques such as constructive induction and rule utility
analysis.  Second, SCOPE will be more thoroughly tested; several
real-world planning domains have been identified as possible testbeds,
and more in-depth comparisons will be drawn between SCOPE and other
competing approaches.  Third, SCOPE will be implemented in a
different planning system in order to test its portability to other
planning algorithms.  This work should demonstrate that
machine-learning techniques can be a powerful tool in the quest for
tractable real-world planning.<p>
</blockquote>

<!WA2><a href="file://ftp.cs.utexas.edu/pub/mooney/papers/scope-proposal-96.ps.Z">
<!WA3><img align=top src="http://www.cs.utexas.edu/users/ml/paper.xbm"></a><p>

<! ===========================================================================>

<a name="scope-msl-96.ps.Z"</a>

<b><li> Integrating EBL and ILP to Acquire Control Rules for Planning<br></b>
Tara A. Estlin and Raymond J. Mooney<br>

<cite>Proceedings of the Third International Workshop on
Multi-Strategy Learning</cite>, pp. 271-279, Harpers Ferry, WV, May
1996. (MSL-96).<p>

<blockquote>
Most approaches to learning control information in planning systems
use explanation-based learning to generate control rules.
Unfortunately, EBL alone often produces overly complex rules that
actually decrease planning efficiency.  This paper presents a novel
learning approach for control knowledge acquisition that integrates
explanation-based learning with techniques from inductive logic
programming. EBL is used to constrain an inductive search for
selection heuristics that help a planner choose between competing plan
refinements. SCOPE is one of the few systems to address learning
control information in the newer partial-order planners.
Specifically, SCOPE learns domain-specific control rules for a version
of the UCPOP planning algorithm. The resulting system is shown to
produce significant speedup in two different planning domains.
</blockquote>

<!WA4><a href="file://ftp.cs.utexas.edu/pub/mooney/papers/scope-msl-96.ps.Z">
<!WA5><img align=top src="http://www.cs.utexas.edu/users/ml/paper.xbm"></a><p>

<! ===========================================================================>

<a name="chill-aaai-96.ps.Z"</a>

<b><li>Learning to Parse Database Queries using Inductive Logic Programming<br></b>
John M. Zelle and Raymond J. Mooney<br>

<cite>Proceedings of the Thirteenth National Conference on Aritificial Intelligence</cite>,
pp. 1050-1055, Portland, OR, August, 1996. (AAAI-96)<p>


<blockquote>
This paper presents recent work using the CHILL parser acquisition
system to automate the construction of a natural-language interface
for database queries.  CHILL treats parser acquisition as the learning
of search-control rules within a logic program representing a
shift-reduce parser and uses techniques from Inductive Logic
Programming to learn relational control knowledge.  Starting with a
general framework for constructing a suitable logical form, CHILL is
able to train on a corpus comprising sentences paired with database
queries and induce parsers that map subsequent sentences directly into
executable queries.  Experimental results with a complete
database-query application for U.S. geography show that CHILL is able
to learn parsers that outperform a pre-existing, hand-crafted
counterpart.  These results demonstrate the ability of a corpus-based
system to produce more than purely syntactic representations.  They
also provide direct evidence of the utility of an empirical approach
at the level of a complete natural language application.
</blockquote>

<!WA6><a href="file://ftp.cs.utexas.edu/pub/mooney/papers/chill-aaai-96.ps.Z">
<!WA7><img align=top src="http://www.cs.utexas.edu/users/ml/paper.xbm"></a><p>

<! ===========================================================================>

<a name="foidl-ml-96.ps.Z"</a>

<b><li>Advantages of Decision Lists and Implicit Negative in Inductive Logic
Programming<br></b>
Mary Elaine Califf and Raymond J. Mooney<br>

Technical Report, Artificial Intelligence Lab, 
University of Texas at Austin, 1996. <p>

<blockquote> This paper demonstrates the capabilities of FOIDL, an
inductive logic programming (ILP) system whose distinguishing
characteristics are the ability to produce first-order decision lists,
the use of an output completeness assumption to provide implicit
negative examples, and the use of intensional background knowledge.
The development of FOIDL was originally motivated by the problem of
learning to generate the past tense of English verbs; however, this
paper demonstrates its superior performance on two different sets of
benchmark ILP problems.  Tests on the finite element mesh design
problem show that FOIDL's decision lists enable it to produce better
results than all other ILP systems whose results on this problem have
been reported.  Tests with a selection of list-processing problems
from Bratko's introductory Prolog text demonstrate that the
combination of implicit negatives and intensionality allow FOIDL to
learn correct programs from far fewer examples than FOIL.
</blockquote>

<!WA8><a href="file://ftp.cs.utexas.edu/pub/mooney/papers/foidl-ml-96.ps.Z">
<!WA9><img align=top src="http://www.cs.utexas.edu/users/ml/paper.xbm"></a><p>

<! ===========================================================================>

<a name="chill-bkchapter-95.ps.Z"</a>

<b><li>Comparative Results on Using Inductive Logic Programming
for Corpus-based Parser Construction<br></b>
John M. Zelle and Raymond J. Mooney<br>

<cite>Symbolic, Connectionist, and Statistical Approaches to Learning for Natural
Language Processing</cite>, S. Wermter, E. Riloff and G. Scheler, Eds,
Spring Verlag, 1995. <p> 

<blockquote>
This paper presents results from recent experimenets with CHILL, a
corpus-based parser acquisition system.  CHILL treats language
acquisition as the learning of search-control rules within a logic
program.  Unlike many current corpus-based approaches that use
statistical learning algorithms, CHILL uses techniques from inductive
logic programming (ILP) to learn relational representations.  CHILL is
a very flexible system and has been used to learn parsers that produce
syntactic parse trees, case-role analyses, and executable database
queries.  The reported experiments compare CHILL's performance to that
of a more naive application of ILP to parser acquisition.  The results
show that ILP techniques, as employed in CHILL, are a viable
alternative to statistical methods and that the control-rule framework
is fundamental to CHILL's success.
</blockquote>

<!WA10><a href="file://ftp.cs.utexas.edu/pub/mooney/papers/chill-bkchapter-95.ps.Z">
<!WA11><img align=top src="http://www.cs.utexas.edu/users/ml/paper.xbm"></a><p>

<! ===========================================================================>

<a name="foidl-bkchapter-95.ps.Z"</a>

<b><li>Learning the Past Tense of English Verbs Using Inductive Logic 
Programming<br></b>
Raymond J. Mooney and Mary Elaine Califf<br>

<cite>Symbolic, Connectionist, and Statistical Approaches to Learning for Natural
Language Processing</cite>, S. Wermter, E. Riloff and G. Scheler, Eds,
Spring Verlag, 1995. <p> 

<blockquote> 

This paper presents results on using a new inductive logic programming
method called FOIDL to learn the past tense of English verbs. The past
tense task has been widely studied in the context of the
symbolic/connectionist debate.  Previous papers have presented results
using various neural-network and decision-tree learning methods.  We
have developed a technique for learning a special type of Prolog
program called a <em>first-order decision list</em>, defined as an
ordered list of clauses each ending in a cut.  FOIDL is based on FOIL
(Quinlan, 1990) but employs intensional background knowledge and
avoids the need for explicit negative examples.  It is particularly
useful for problems that involve rules with specific exceptions, such
as the past-tense task.  We present results showing that FOIDL learns
a more accurate past-tense generator from significantly fewer examples
than all other previous methods.
</blockquote>

<!WA12><a href="file://ftp.cs.utexas.edu/pub/mooney/papers/foidl-bkchapter-95.ps.Z">
<!WA13><img align=top src="http://www.cs.utexas.edu/users/ml/paper.xbm"></a><p>

<! ===========================================================================>

<a name="chill-dissertation-95.ps.Z"</a>

<b><li>Using Inductive Logic Programming to Automate the Construction of 
Natural Language Parsers<br></b>

John M. Zelle<br>

Ph.D. Thesis, Department of Computer Sciences, University of Texas at Austin, August, 1995.<p>

<blockquote>
Designing computer systems to understand natural language input is a
difficult task.  In recent years there has been considerable interest
in corpus-based methods for constructing natural language parsers.
These empirical approaches replace hand-crafted grammars with
linguistic models acquired through automated training over language
corpora.  A common thread among such methods to date is the use of
propositional or probablistic representations for the learned
knowledge.  This dissertation presents an alternative approach based
on techniques from a subfield of machine learning known as inductive
logic programming (ILP).  ILP, which investigates the learning of
relational (first-order) rules, provides an empirical method for
acquiring knowledge within traditional, symbolic parsing frameworks.<p>

This dissertation details the architecture, implementation and
evaluation of CHILL a computer system for acquiring natural
language parsers by training over corpora of parsed text.  CHILL
treats language acquisition as the learning of search-control rules
within a logic program that implements a shift-reduce parser.  Control
rules are induced using a novel ILP algorithm which handles difficult
issues arising in the induction of search-control heuristics.  Both
the control-rule framework and the induction algorithm are crucial to
CHILL's success.<p>

The main advantage of CHILL over propositional counterparts is
its flexibility in handling varied representations.  CHILL has
produced parsers for various analyses including case-role mapping,
detailed syntactic parse trees, and a logical form suitable for
expressing first-order database queries.  All of these tasks are
accomplished within the same framework, using a single, general
learning method that can acquire new syntactic and semantic categories
for resolving ambiguities.<p>

Experimental evidence from both aritificial and real-world corpora
demonstrate that CHILL learns parsers as well or better than
previous artificial neural network or probablistic approaches on
comparable tasks.  In the database query domain, which goes beyond the
scope of previous empirical approaches, the learned parser outperforms
an existing hand-crafted system.  These results support the claim that
ILP techniques as implemented in CHILL represent a viable
alternative with significant potential advantages over neural-network,
propositional, and probablistic approaches to empirical parser
construction.<p>
</blockquote>