Skip to content
Snippets Groups Projects
Commit 94c2ce8a authored by Dominik Zobel's avatar Dominik Zobel
Browse files

Add chapters, intended takeaway and some reformatting

parent 2c7ca7e2
No related branches found
No related tags found
1 merge request!74Memory hierarchies lecture
Hide whitespace changes
Inline Side-by-side
lectures/memory-hierarchies/slides.qmd
+ 112
− 18
View file @ 94c2ce8a
...@@ -11,6 +11,15 @@ author: "Dominik Zobel and Florian Ziemen" ...@@ -11,6 +11,15 @@ author: "Dominik Zobel and Florian Ziemen"
## Intended Takeaways
- Locality matters: data-centric view
- Think workbench: Operating with parts of the data
- Processor tries to be busy all the time (prefetching)
- Latency and memory sizes of components
## Questions {.handson .incremental} ## Questions {.handson .incremental}
- Why not keep everything in memory? - Why not keep everything in memory?
...@@ -19,6 +28,8 @@ author: "Dominik Zobel and Florian Ziemen" ...@@ -19,6 +28,8 @@ author: "Dominik Zobel and Florian Ziemen"
# Speed and access time
## Processor speed vs. memory speed ## Processor speed vs. memory speed
![](static/speed.png){width=70%} ![](static/speed.png){width=70%}
...@@ -135,12 +146,12 @@ new_data = operate_on_data(data=data, ...@@ -135,12 +146,12 @@ new_data = operate_on_data(data=data,
``` ```
--> -->
| | Levante (Fixed) | Local (Fixed) | Levante (Random) | Local (Random) | | | Levante (Fixed) | Laptop (Fixed) | Levante (Random) | Laptop (Random) |
| -------------------------- | ----------------- | ----------------- | ----------------- | ----------------- | | -------------------------- | ----------------- | ----------------- | ----------------- | ----------------- |
| Create data | 0.5607 | 0.2280 | 1.6623 | 0.8759 | | Create data | 0.56 | 0.23 | 1.66 | 0.88 |
| Load data | 0.7605 | 0.8767 | 0.7615 | 0.9225 | | Load data | 0.76 | 0.88 | 0.76 | 0.92 |
| Store data | 2.2317 | 4.0427 | 2.2327 | 3.4378 | | Store data | 2.23 | 4.04 | 2.23 | 3.44 |
| Process data | 0.7618 | 0.3792 | 0.7572 | 0.3747 | | Process data | 0.76 | 0.38 | 0.76 | 0.37 |
:::{.smaller} :::{.smaller}
Time in seconds using a 2 GB numpy array ($128 \times 128 \times 128 \times 128$) either with a fixed number or random number in each entry Time in seconds using a 2 GB numpy array ($128 \times 128 \times 128 \times 128$) either with a fixed number or random number in each entry
...@@ -156,6 +167,9 @@ Time in seconds using a 2 GB numpy array ($128 \times 128 \times 128 \times 128$ ...@@ -156,6 +167,9 @@ Time in seconds using a 2 GB numpy array ($128 \times 128 \times 128 \times 128$
# Theory
## Techniques ## Techniques
- Caching - Caching
...@@ -248,6 +262,8 @@ T_{avg,s} &= H_1 T_1 + ((1-H_1)\cdot H_2)\cdot(T_1+T_2)\\ ...@@ -248,6 +262,8 @@ T_{avg,s} &= H_1 T_1 + ((1-H_1)\cdot H_2)\cdot(T_1+T_2)\\
# Visualizations
## Memory Pyramid (upwards) ## Memory Pyramid (upwards)
...@@ -269,14 +285,25 @@ T_{avg,s} &= H_1 T_1 + ((1-H_1)\cdot H_2)\cdot(T_1+T_2)\\ ...@@ -269,14 +285,25 @@ T_{avg,s} &= H_1 T_1 + ((1-H_1)\cdot H_2)\cdot(T_1+T_2)\\
## Memory Pyramid (downwards) - check numbers {auto-animate=true} ## Memory Pyramid (downwards) {auto-animate=true}
Order of magnitude on Levante (AMD EPYC 7763) Order of magnitude on Levante (AMD EPYC 7763)
- Base frequency: 2.45 GHz - Base frequency: 2.45 GHz
## Memory Pyramid (downwards) - check numbers {auto-animate=true}
## Memory Pyramid (downwards) {auto-animate=true}
::::::::{.r-stack}
:::{.normal style="color: #ffcccc; font-size: 3em; font-weight: bold; rotate: -30deg; opacity: 0.5;"}
Check numbers
:::
:::{.normal}
Order of magnitude on Levante (AMD EPYC 7763) Order of magnitude on Levante (AMD EPYC 7763)
...@@ -284,6 +311,9 @@ Order of magnitude on Levante (AMD EPYC 7763) ...@@ -284,6 +311,9 @@ Order of magnitude on Levante (AMD EPYC 7763)
------------ ----------------- --------- ------------ ----------------- ---------
Register ~0.4 1 KB Register ~0.4 1 KB
:::
::::::::
:::{.incremental} :::{.incremental}
...@@ -292,7 +322,17 @@ Register ~0.4 1 KB ...@@ -292,7 +322,17 @@ Register ~0.4 1 KB
::: :::
## Memory Pyramid (downwards) - check numbers {auto-animate=true} ## Memory Pyramid (downwards) {auto-animate=true}
::::::::{.r-stack}
:::{.normal style="color: #ffcccc; font-size: 3em; font-weight: bold; rotate: -30deg; opacity: 0.5;"}
Check numbers
:::
:::{.normal}
Order of magnitude on Levante (AMD EPYC 7763) Order of magnitude on Levante (AMD EPYC 7763)
...@@ -301,6 +341,10 @@ Order of magnitude on Levante (AMD EPYC 7763) ...@@ -301,6 +341,10 @@ Order of magnitude on Levante (AMD EPYC 7763)
Register ~0.4 1 KB Register ~0.4 1 KB
L1 Cache ~1.1 32 KB L1 Cache ~1.1 32 KB
:::
::::::::
:::{.incremental} :::{.incremental}
- Same factors for L2 and L3 - Same factors for L2 and L3
...@@ -308,7 +352,17 @@ L1 Cache ~1.1 32 KB ...@@ -308,7 +352,17 @@ L1 Cache ~1.1 32 KB
::: :::
## Memory Pyramid (downwards) - check numbers {auto-animate=true} ## Memory Pyramid (downwards) {auto-animate=true}
::::::::{.r-stack}
:::{.normal style="color: #ffcccc; font-size: 3em; font-weight: bold; rotate: -30deg; opacity: 0.5;"}
Check numbers
:::
:::{.normal}
Order of magnitude on Levante (AMD EPYC 7763) Order of magnitude on Levante (AMD EPYC 7763)
...@@ -319,6 +373,10 @@ L1 Cache ~1.1 32 KB ...@@ -319,6 +373,10 @@ L1 Cache ~1.1 32 KB
L2 Cache ~3.3 512 KB L2 Cache ~3.3 512 KB
L3 Cache ~12.8 32 MB L3 Cache ~12.8 32 MB
:::
::::::::
:::{.incremental} :::{.incremental}
- 256 GB of main memory (default) with a theoretical memory bandwidth of ~200 GB/s - 256 GB of main memory (default) with a theoretical memory bandwidth of ~200 GB/s
...@@ -327,7 +385,17 @@ L3 Cache ~12.8 32 MB ...@@ -327,7 +385,17 @@ L3 Cache ~12.8 32 MB
## Memory Pyramid (downwards) - check numbers {auto-animate=true} ## Memory Pyramid (downwards) {auto-animate=true}
::::::::{.r-stack}
:::{.normal style="color: #ffcccc; font-size: 3em; font-weight: bold; rotate: -30deg; opacity: 0.5;"}
Check numbers
:::
:::{.normal}
Order of magnitude on Levante (AMD EPYC 7763) Order of magnitude on Levante (AMD EPYC 7763)
...@@ -339,6 +407,10 @@ L2 Cache ~3.3 512 KB ...@@ -339,6 +407,10 @@ L2 Cache ~3.3 512 KB
L3 Cache ~12.8 32 MB L3 Cache ~12.8 32 MB
Main Memory 60 256 GB Main Memory 60 256 GB
:::
::::::::
:::{.incremental} :::{.incremental}
- Fast Data as Flash based file system - Fast Data as Flash based file system
...@@ -347,7 +419,17 @@ Main Memory 60 256 GB ...@@ -347,7 +419,17 @@ Main Memory 60 256 GB
## Memory Pyramid (downwards) - check numbers {auto-animate=true} ## Memory Pyramid (downwards) {auto-animate=true}
::::::::{.r-stack}
:::{.normal style="color: #ffcccc; font-size: 3em; font-weight: bold; rotate: -30deg; opacity: 0.5;"}
Check numbers
:::
:::{.normal}
Order of magnitude on Levante (AMD EPYC 7763) Order of magnitude on Levante (AMD EPYC 7763)
...@@ -358,7 +440,11 @@ L1 Cache ~1.1 32 KB ...@@ -358,7 +440,11 @@ L1 Cache ~1.1 32 KB
L2 Cache ~3.3 512 KB L2 Cache ~3.3 512 KB
L3 Cache ~12.8 32 MB L3 Cache ~12.8 32 MB
Main Memory 60 256 GB Main Memory 60 256 GB
SSD 100 1 PB SSD 100 200 TB
:::
::::::::
:::{.incremental} :::{.incremental}
...@@ -368,7 +454,17 @@ SSD 100 1 PB ...@@ -368,7 +454,17 @@ SSD 100 1 PB
## Memory Pyramid (downwards) - check numbers {auto-animate=true} ## Memory Pyramid (downwards) {auto-animate=true}
::::::::{.r-stack}
:::{.normal style="color: #ffcccc; font-size: 3em; font-weight: bold; rotate: -30deg; opacity: 0.5;"}
Check numbers
:::
:::{.normal}
Order of magnitude on Levante (AMD EPYC 7763) Order of magnitude on Levante (AMD EPYC 7763)
...@@ -379,15 +475,13 @@ L1 Cache ~1.1 32 KB ...@@ -379,15 +475,13 @@ L1 Cache ~1.1 32 KB
L2 Cache ~3.3 512 KB L2 Cache ~3.3 512 KB
L3 Cache ~12.8 32 MB L3 Cache ~12.8 32 MB
Main Memory ~60 256 GB Main Memory ~60 256 GB
SSD ~100 1 PB SSD ~100 200 TB
Hard disk ~3000 130 PB Hard disk ~3000 130 PB
:::{.incremental}
- Tape backup also possible
::: :::
::::::::
## Memory Mountain (1/2) ## Memory Mountain (1/2)
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment

Imprint | Privacy Policy