Message Passing Optimizations
Try to keep message sizes not small
Try to pipeline communication/computation
Avoid data translation and data types unless necessary for good performance
Align application buffers to double words and page sizes. Be careful of cache lines!