Skip to content
Snippets Groups Projects
Commit 6f85cd37 authored by Claudia Frauen's avatar Claudia Frauen
Browse files

Added OpenMP - MPI comparison slide

parent b6de6321
No related branches found
No related tags found
1 merge request!72Draft: Compute devices lecture
Pipeline #70694 passed
......@@ -116,6 +116,21 @@ If we want to scale beyond one node, what do we need in our example?
* Often used for boundary exchange
* A lot of the details are beyond the scope of this lecture.
## OpenMP vs MPI
:::{.smaller}
| OpenMP | MPI |
| ------ | --- |
| shared memory | distributed memory |
| can't scale beyond one node | can scale across many nodes |
| uses independent threads| uses ranks that need to communicate with each other |
| pragmas inserted in the code tell the compiler where to parallelise | API to vendor specific libraries |
* OpenMPI is a MPI implementation and has nothing to do with OpenMP
:::
## Collectives
* Collective communication that involves a group of processes (ranks)
* Examples: broadcast, gather, scatter, reduction ...
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment