Collective Communication

• Barrier

  • Synchronize all processes

• Broadcast

• Gather

  • Gather data from all processes to one process

• Scatter

• Reduction

  • Global sums, products, etc.

Previous slide

Next slide

Back to first slide

View graphic version