portals3.lyx

lustre 1.6.5 source code

#LyX 1.2 created this file. For more info see http://www.lyx.org/
\lyxformat 220
\textclass report
\begin_preamble
\usepackage{fullpage}
\renewenvironment{comment}%
{\begin{quote}\textbf{Discussion}: \slshape}%
{\end{quote}}
\pagestyle{myheadings}
\end_preamble
\language american
\inputencoding auto
\fontscheme pslatex
\graphics default
\paperfontsize 10
\spacing single 
\papersize letterpaper
\paperpackage a4
\use_geometry 0
\use_amsmath 0
\use_natbib 0
\use_numerical_citations 0
\paperorientation portrait
\secnumdepth 2
\tocdepth 2
\paragraph_separation indent
\defskip medskip
\quotes_language english
\quotes_times 2
\papercolumns 1
\papersides 2
\paperpagestyle headings

\layout Title

The Portals 3.2 Message Passing Interface 
\newline 
 Revision 1.1
\layout Author

Ron Brightwell
\begin_inset Foot
collapsed true

\layout Standard

R.
 Brightwell and R.
 Riesen are with the Scalable Computing Systems Department, Sandia National
 Laboratories, P.O.
 Box 5800, Albuquerque, NM\SpecialChar ~
\SpecialChar ~
87111-1110, [e-mail], [e-mail].
\end_inset 

, Arthur B.
 Maccabe
\begin_inset Foot
collapsed true

\layout Standard

A.
 B.
 Maccabe is with the Computer Science Department, University of New Mexico,
 Albuquerque, NM\SpecialChar ~
\SpecialChar ~
87131-1386, [e-mail].
\end_inset 

, Rolf Riesen and Trammell Hudson
\layout Abstract

This report presents a specification for the Portals 3.2 message passing
 interface.
 Portals 3.2 is intended to allow scalable, high-performance network communicatio
n between nodes of a parallel computing system.
 Specifically, it is designed to support a parallel computing platform composed
 of clusters of commodity workstations connected by a commodity system area
 network fabric.
 In addition, Portals 3.2 is well suited to massively parallel processing
 and embedded systems.
 Portals 3.2 represents an adaption of the data movement layer developed
 for massively parallel processing platforms, such as the 4500-node Intel
 TeraFLOPS machine.
 
\layout Standard


\begin_inset ERT
status Collapsed

\layout Standard

\backslash 
clearpage
\backslash 
pagenumbering{roman}
\backslash 
setcounter{page}{3}
\end_inset 


\layout Standard


\begin_inset LatexCommand \tableofcontents{}

\end_inset 


\layout Standard


\begin_inset ERT
status Collapsed

\layout Standard

\backslash 
cleardoublepage
\end_inset 


\layout Standard


\begin_inset FloatList figure

\end_inset 


\layout Standard


\begin_inset ERT
status Collapsed

\layout Standard

\backslash 
cleardoublepage
\end_inset 


\layout Standard


\begin_inset FloatList table

\end_inset 


\layout Standard


\begin_inset ERT
status Collapsed

\layout Standard

\backslash 
cleardoublepage
\end_inset 


\layout Chapter*

Summary of Changes for Revision 1.1
\layout Enumerate

Updated version number to 3.2 throughout the document
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sub:PtlGetId}

\end_inset 

: added 
\family typewriter 
PTL_SEGV
\family default 
 to error list for 
\shape italic 
PtlGetId
\shape default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:meattach}

\end_inset 

: added 
\family typewriter 
PTL_ML_TOOLONG
\family default 
 to error list for 
\shape italic 
PtlMEAttach
\shape default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:meunlink}

\end_inset 

: removed text referring to a list of associated memory descriptors.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:mdfree}

\end_inset 

: added text to describe unlinking a free-floating memory descriptor.
\layout Enumerate

Table 
\begin_inset LatexCommand \ref{tab:types}

\end_inset 

: added entry for 
\family typewriter 
ptl_seq_t
\family default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:md-type}

\end_inset 

:
\begin_deeper 
\layout Enumerate

added definition of 
\family typewriter 
max_offset
\family default 
.
\layout Enumerate

added text to clarify 
\family typewriter 
PTL_MD_MANAGE_REMOTE
\family default 
.
\end_deeper 
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:mdattach}

\end_inset 

: modified text for 
\family typewriter 
unlink_op
\family default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:niinit}

\end_inset 

: added text to clarify multiple calls to 
\shape italic 
PtlNIInit
\shape default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:mdattach}

\end_inset 

: added text to clarify 
\family typewriter 
unlink_nofit
\family default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:receiving}

\end_inset 

: removed text indicating that an MD will reject a message if the associated
 EQ is full.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:mdfree}

\end_inset 

: added 
\family typewriter 
PTL_MD_INUSE
\family default 
 error code and text to indicate that only MDs with no pending operations
 can be unlinked.
\layout Enumerate

Table 
\begin_inset LatexCommand \ref{tab:retcodes}

\end_inset 

: added 
\family typewriter 
PTL_MD_INUSE
\family default 
 return code.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:event-type}

\end_inset 

: added user id field, MD handle field, and NI specific failure field to
 the 
\family typewriter 
ptl_event_t
\family default 
 structure.
\layout Enumerate

Table 
\begin_inset LatexCommand \ref{tab:types}

\end_inset 

: added 
\family typewriter 
ptl_ni_fail_t
\family default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:event-type}

\end_inset 

: added 
\family typewriter 
PTL_EVENT_UNLINK
\family default 
 event type.
\layout Enumerate

Table 
\begin_inset LatexCommand \ref{tab:func}

\end_inset 

: removed 
\shape slanted 
PtlTransId
\shape default 
.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:meattach}

\end_inset 

, Section 
\begin_inset LatexCommand \ref{sec:meinsert}

\end_inset 

, Section 
\begin_inset LatexCommand \ref{sec:put}

\end_inset 

: listed allowable constants with relevant fields.
\layout Enumerate

Table 
\begin_inset LatexCommand \ref{tab:func}

\end_inset 

: added 
\shape italic 
PtlMEAttachAny
\shape default 
 function.
\layout Enumerate

Table 
\begin_inset LatexCommand \ref{tab:retcodes}

\end_inset 

: added 
\family typewriter 
PTL_PT_FULL
\family default 
 return code for 
\shape italic 
PtlMEAttachAny
\shape default 
.
\layout Enumerate

Table 
\begin_inset LatexCommand \ref{tab:oconsts}

\end_inset 

: updated to reflect new event types.
\layout Enumerate

Section 
\begin_inset LatexCommand \ref{sec:id-type}

\end_inset 

: added 
\family typewriter 
ptl_nid_t
\family default 
, 
\family typewriter 
ptl_pid_t
\family default 
, and 
\family typewriter 
ptl_uid_t
\family default 
.
\layout Chapter*

Summary of Changes for Version 3.1
\layout Section*

Thread Issues
\layout Standard

The most significant change to the interface from version 3.0 to 3.1 involves
 the clarification of how the interface interacts with multi-threaded applicatio
ns.
 We adopted a generic thread model in which processes define an address
 space and threads share the address space.
 Consideration of the API in the light of threads lead to several clarifications
 throughout the document: 
\layout Enumerate

Glossary: 
\begin_deeper 
\layout Enumerate

added a definition for 
\emph on 
thread
\emph default 
, 
\layout Enumerate

reworded the definition for 
\emph on 
process
\emph default 
.
 
\end_deeper 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:apiover}

\end_inset 

: added section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:threads}

\end_inset 

 to describe the multi-threading model used by the Portals API.
 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:ptlinit}

\end_inset 

: 
\emph on 
PtlInit
\emph default 
 must be called at least once and may be called any number of times.
 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:ptlfini}

\end_inset 

: 
\emph on 
PtlFini
\emph default 
 should be called once as the process is terminating and not as each thread
 terminates.
 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:pid}

\end_inset 

: Portals does not define thread ids.
 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:ni}

\end_inset 

: network interfaces are associated with processes, not threads.
 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:niinit}

\end_inset 

: 
\emph on 
PtlNIInit
\emph default 
 must be called at least once and may be called any number of times.
 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:eqget}

\end_inset 

: 
\emph on 
PtlEQGet
\emph default 
 returns 
\family typewriter 
PTL_EQ_EMPTY
\family default 
 if a thread is blocked on 
\emph on 
PtlEQWait
\emph default 
.
 
\layout Enumerate

Section\SpecialChar ~

\begin_inset LatexCommand \ref{sec:eqwait}

\end_inset 

: waiting threads are awakened in FIFO order.
 
\layout Standard

Two functions, 
\emph on 
PtlNIBarrier
\emph default 
 and 
\emph on 
PtlEQCount
\emph default 
 were removed from the API.
 
\emph on 
PtlNIBarrier
\emph default 
 was defined to block the calling process until all of the processes in
 the application group had invoked 
\emph on 
PtlNIBarrier
\emph default