The MPI Protocol
Short messages
MPI processes have a finite number of small preallocated buffers for short messages.
Messages that are less than this threshold are sent without any handshake.
If the receive is posted, the data is received in place. Otherwise, the message is copied into an available buffer. If no buffers are available, the send may block or signal an error.