📄 ngram-merge.html
字号:
<! $Id: ngram-merge.1,v 1.7 2004/12/03 17:59:01 stolcke Exp $><HTML><HEADER><TITLE>ngram-merge</TITLE><BODY><H1>ngram-merge</H1><H2> NAME </H2>ngram-merge - merge N-gram counts<H2> SYNOPSIS </H2><B> ngram-merge </B>[<B>-help</B>]<B></B>[<B> -write </B><I>outfile</I>]<I></I>[<B>-float-counts</B>]<B></B>[<B>--</B>]<B></B><I> infile1 </I><I> infile2 </I>...<H2> DESCRIPTION </H2><B> ngram-merge </B>reads two or more lexicographically sorted N-gram count files(as produced by <B>ngram-count -sort</B>)<B></B>and outputs the merged, sorted counts.The output is thus suitable for subsequent merging steps.<P>The input format consists of one N-gram count per line,<BR><I> word1 word2 ... wordn count</I><BR>The lines must be sorted lexicographically on the words, leftmost first.The input may contain N-grams of different lengths.<P>Each filename argument can be a plain ASCII count file, or a compressed file (name ending in .Z or .gz), or ``-'' to indicatestdin/stdout.<P><B> ngram-merge </B>is recommended in cases where the full counts would far exceed available real memory.Although an arbitrary number of input count files is accepted,it is best to use the program as follows.First, partition the input text into the largest chunks so that<B> ngram-count </B>can run in real memory.Then merge the resulting sorted counts using<B> ngram-merge </B>pairwise, and continue doing so in a binary tree pattern until asingle count file containing all N-grams remains.This procedure is automated by the<B> make-batch-counts </B>and<B> merge-batch-counts </B>scripts.<H2> OPTIONS </H2><P>Each filename argument can be an ASCII file, or a compressed file (name ending in .Z or .gz), or ``-'' to indicatestdin/stdout.<DL><DT><B> -help </B><DD>Print option and usage summary.<DT><B> -version </B><DD>Print version information.<DT><B>-write</B><I> outfile</I><B></B><DD>Write merged counts to<I>outfile</I>,<I></I>instead of standard output.<DT><B> -float-counts </B><DD>Process counts as floating point numbers.By default counts are assumed to be unsigned integers.<DT><B> -- </B><DD>Indicates the end of options, in case the first input filename beginswith ``-''.</DD></DL><H2> SEE ALSO </H2><A HREF="ngram-count.html">ngram-count(1)</A>, <A HREF="ngram.html">ngram(1)</A>, <A HREF="training-scripts.html">training-scripts(1)</A>.<H2> AUTHOR </H2>Andreas Stolcke <stolcke@speech.sri.com><BR>Copyright 1995-2004 SRI International</BODY></HTML>⌨️ 快捷键说明
复制代码
Ctrl + C
搜索代码
Ctrl + F
全屏模式
F11
切换主题
Ctrl + Shift + D
显示快捷键
?
增大字号
Ctrl + =
减小字号
Ctrl + -