node1.html

Design and building parallel program

<LI> <A NAME=tex2html1734 HREF="node93.html#SECTION034110000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node93.html#SECTION034110000000000000000"> Chapter Notes</A>
</UL> 
<LI> <A NAME=tex2html1735 HREF="node94.html#SECTION03500000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node94.html#SECTION03500000000000000000">8 Message Passing Interface</A>
<UL> 
<LI> <A NAME=tex2html1736 HREF="node95.html#SECTION03510000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node95.html#SECTION03510000000000000000">8.1 The MPI Programming Model</A>
<LI> <A NAME=tex2html1737 HREF="node96.html#SECTION03520000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node96.html#SECTION03520000000000000000">8.2 MPI Basics</A>
<UL> 
<LI> <A NAME=tex2html1738 HREF="node96.html#SECTION03521000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node96.html#SECTION03521000000000000000">8.2.1 Language Bindings</A>
<UL> 
<LI> <A NAME=tex2html1739 HREF="node96.html#SECTION03521010000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node96.html#SECTION03521010000000000000"> C Language Binding.</A>
<LI> <A NAME=tex2html1740 HREF="node96.html#SECTION03521020000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node96.html#SECTION03521020000000000000"> Fortran Language Binding.</A>
</UL> 
<LI> <A NAME=tex2html1741 HREF="node96.html#SECTION03522000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node96.html#SECTION03522000000000000000">8.2.2 Determinism</A>
</UL> 
<LI> <A NAME=tex2html1742 HREF="node97.html#SECTION03530000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node97.html#SECTION03530000000000000000">8.3 Global Operations</A>
<UL> 
<LI> <A NAME=tex2html1743 HREF="node97.html#SECTION03531000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node97.html#SECTION03531000000000000000">8.3.1 Barrier</A>
<LI> <A NAME=tex2html1744 HREF="node97.html#SECTION03532000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node97.html#SECTION03532000000000000000">8.3.2 Data Movement</A>
<LI> <A NAME=tex2html1745 HREF="node97.html#SECTION03533000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node97.html#SECTION03533000000000000000">8.3.3 Reduction Operations</A>
</UL> 
<LI> <A NAME=tex2html1746 HREF="node98.html#SECTION03540000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node98.html#SECTION03540000000000000000">8.4 Asynchronous Communication</A>
<LI> <A NAME=tex2html1747 HREF="node99.html#SECTION03550000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node99.html#SECTION03550000000000000000">8.5 Modularity</A>
<UL> 
<LI> <A NAME=tex2html1748 HREF="node99.html#SECTION03551000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node99.html#SECTION03551000000000000000">8.5.1 Creating Communicators</A>
<LI> <A NAME=tex2html1749 HREF="node99.html#SECTION03552000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node99.html#SECTION03552000000000000000">8.5.2 Partitioning Processes</A>
<LI> <A NAME=tex2html1750 HREF="node99.html#SECTION03553000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node99.html#SECTION03553000000000000000">8.5.3 Communicating between Groups</A>
</UL> 
<LI> <A NAME=tex2html1751 HREF="node100.html#SECTION03560000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node100.html#SECTION03560000000000000000">8.6 Other MPI Features</A>
<UL> 
<LI> <A NAME=tex2html1752 HREF="node100.html#SECTION03561000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node100.html#SECTION03561000000000000000">8.6.1 Derived Datatypes</A>
<LI> <A NAME=tex2html1753 HREF="node100.html#SECTION03562000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node100.html#SECTION03562000000000000000">8.6.2 MPI Features Not Covered</A>
</UL> 
<LI> <A NAME=tex2html1754 HREF="node101.html#SECTION03570000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node101.html#SECTION03570000000000000000">8.7 Performance Issues</A>
<LI> <A NAME=tex2html1755 HREF="node102.html#SECTION03580000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node102.html#SECTION03580000000000000000">8.8 Case Study: Earth System Model</A>
<LI> <A NAME=tex2html1756 HREF="node103.html#SECTION03590000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node103.html#SECTION03590000000000000000">8.9 Summary</A>
<LI> <A NAME=tex2html1757 HREF="node104.html#SECTION035100000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node104.html#SECTION035100000000000000000"> Exercises</A>
<LI> <A NAME=tex2html1758 HREF="node105.html#SECTION035110000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node105.html#SECTION035110000000000000000"> Chapter Notes</A>
</UL> 
<LI> <A NAME=tex2html1759 HREF="node106.html#SECTION03600000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node106.html#SECTION03600000000000000000">9 Performance Tools</A>
<UL> 
<LI> <A NAME=tex2html1760 HREF="node107.html#SECTION03610000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node107.html#SECTION03610000000000000000">9.1 Performance Analysis</A>
<LI> <A NAME=tex2html1761 HREF="node108.html#SECTION03620000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node108.html#SECTION03620000000000000000">9.2 Data Collection</A>
<UL> 
<LI> <A NAME=tex2html1762 HREF="node108.html#SECTION03621000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node108.html#SECTION03621000000000000000">9.2.1 Profiles</A>
<LI> <A NAME=tex2html1763 HREF="node108.html#SECTION03622000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node108.html#SECTION03622000000000000000">9.2.2 Counters</A>
<LI> <A NAME=tex2html1764 HREF="node108.html#SECTION03623000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node108.html#SECTION03623000000000000000">9.2.3 Traces</A>
<LI> <A NAME=tex2html1765 HREF="node108.html#SECTION03624000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node108.html#SECTION03624000000000000000">9.2.4 Summary of Data Collection Tools</A>
</UL> 
<LI> <A NAME=tex2html1766 HREF="node109.html#SECTION03630000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node109.html#SECTION03630000000000000000">9.3 Data Transformation and Visualization</A>
<UL> 
<LI> <A NAME=tex2html1767 HREF="node109.html#SECTION03631000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node109.html#SECTION03631000000000000000">9.3.1 Profile and Counts</A>
<LI> <A NAME=tex2html1768 HREF="node109.html#SECTION03632000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node109.html#SECTION03632000000000000000">9.3.2 Traces</A>
<LI> <A NAME=tex2html1769 HREF="node109.html#SECTION03633000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node109.html#SECTION03633000000000000000">9.3.3 Data-Parallel Languages</A>
</UL> 
<LI> <A NAME=tex2html1770 HREF="node110.html#SECTION03640000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03640000000000000000">9.4 Tools</A>
<UL> 
<LI> <A NAME=tex2html1771 HREF="node110.html#SECTION03641000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03641000000000000000">9.4.1 Paragraph</A>
<LI> <A NAME=tex2html1772 HREF="node110.html#SECTION03642000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03642000000000000000">9.4.2 Upshot</A>
<LI> <A NAME=tex2html1773 HREF="node110.html#SECTION03643000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03643000000000000000">9.4.3 Pablo</A>
<LI> <A NAME=tex2html1774 HREF="node110.html#SECTION03644000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03644000000000000000">9.4.4 Gauge</A>
<LI> <A NAME=tex2html1775 HREF="node110.html#SECTION03645000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03645000000000000000">9.4.5 ParAide</A>
<LI> <A NAME=tex2html1776 HREF="node110.html#SECTION03646000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03646000000000000000">9.4.6 IBM's Parallel Environment</A>
<LI> <A NAME=tex2html1777 HREF="node110.html#SECTION03647000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03647000000000000000">9.4.7 AIMS</A>
<LI> <A NAME=tex2html1778 HREF="node110.html#SECTION03648000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node110.html#SECTION03648000000000000000">9.4.8 Custom Tools</A>
</UL> 
<LI> <A NAME=tex2html1779 HREF="node111.html#SECTION03650000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node111.html#SECTION03650000000000000000">9.5 Summary</A>
<LI> <A NAME=tex2html1780 HREF="node112.html#SECTION03660000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node112.html#SECTION03660000000000000000"> Exercises</A>
<LI> <A NAME=tex2html1781 HREF="node113.html#SECTION03670000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node113.html#SECTION03670000000000000000"> Chapter Notes</A>
</UL> 
</UL> 
<LI> <A NAME=tex2html1782 HREF="node114.html#SECTION04000000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node114.html#SECTION04000000000000000000">Part III: Resources</A>
<UL> 
<LI> <A NAME=tex2html1783 HREF="node115.html#SECTION04100000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node115.html#SECTION04100000000000000000"> Part III: Resources</A>
<LI> <A NAME=tex2html1784 HREF="node116.html#SECTION04200000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node116.html#SECTION04200000000000000000">10 Random Numbers</A>
<UL> 
<LI> <A NAME=tex2html1785 HREF="node117.html#SECTION04210000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node117.html#SECTION04210000000000000000">10.1 Sequential Random Numbers</A>
<LI> <A NAME=tex2html1786 HREF="node118.html#SECTION04220000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node118.html#SECTION04220000000000000000">10.2 Parallel Random Numbers</A>
<LI> <A NAME=tex2html1787 HREF="node119.html#SECTION04230000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node119.html#SECTION04230000000000000000">10.3 Distributed Random Generators</A>
<UL> 
<LI> <A NAME=tex2html1788 HREF="node119.html#SECTION04231000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node119.html#SECTION04231000000000000000">10.3.1 The Random Tree Method</A>
<LI> <A NAME=tex2html1789 HREF="node119.html#SECTION04232000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node119.html#SECTION04232000000000000000">10.3.2 The Leapfrog Method</A>
<LI> <A NAME=tex2html1790 HREF="node119.html#SECTION04233000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node119.html#SECTION04233000000000000000">10.3.3 Modified Leapfrog</A>
</UL> 
<LI> <A NAME=tex2html1791 HREF="node120.html#SECTION04240000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node120.html#SECTION04240000000000000000">10.4 Summary</A>
<LI> <A NAME=tex2html1792 HREF="node121.html#SECTION04250000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node121.html#SECTION04250000000000000000"> Exercises</A>
<LI> <A NAME=tex2html1793 HREF="node122.html#SECTION04260000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node122.html#SECTION04260000000000000000"> Chapter Notes</A>
</UL> 
<LI> <A NAME=tex2html1794 HREF="node123.html#SECTION04300000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node123.html#SECTION04300000000000000000">11 Hypercube Algorithms</A>
<UL> 
<LI> <A NAME=tex2html1795 HREF="node124.html#SECTION04310000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node124.html#SECTION04310000000000000000">11.1 The Hypercube Template</A>
<LI> <A NAME=tex2html1796 HREF="node125.html#SECTION04320000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node125.html#SECTION04320000000000000000">11.2 Vector Reduction</A>
<LI> <A NAME=tex2html1797 HREF="node126.html#SECTION04330000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node126.html#SECTION04330000000000000000">11.3 Matrix Transposition</A>
<LI> <A NAME=tex2html1798 HREF="node127.html#SECTION04340000000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node127.html#SECTION04340000000000000000">11.4 Mergesort</A>
<UL> 
<LI> <A NAME=tex2html1799 HREF="node127.html#SECTION04340010000000000000" tppabs="http://www.dit.hcmut.edu.vn/books/system/par_anl/node127.html#SECTION04340010000000000000"> Compare-Exchange.</A>
<LI> <A NAME=tex2html1800 HREF="node127.html#SECTION043