MPI Collective Communication
Unlike PVM, with MPI you should use the collective operations. They are likely to be highly tuned for the architecture.
These operations are very difficult to optimize and are often the bottlenecks in parallel applications.