Example for square matrix multiplication in SPMD using 3 nodes.

The hole sequence.

Step 1: Virtually split the matrix.

Step 2: Spawn other nodes.

Step 3: Configure all nodes.

Step 4: Distribute A.

Step 5: Distribute B.

Step 6: Perform calculations.

Step 7: Shift A.

Step 8: Perform calculations.

Step 9: Shift A.

Step 10: Perform calculations.

Step 11: Collect results.

© Robin Wolff - The University of Reading / Salford