Added timer hands-on

lectures/file-and-data-systems/slides.qmd

@@ -97,6 +97,16 @@ author: "Florian Ziemen and Karl-Hermann Wieners"
 * Serialized access only
 * Backup / long-term storage
 
+## Hands-on {.handson}
+::: {.smaller}
+{{< embed timer.ipynb echo=true  >}}
+:::
+Take this set of calls, improve the code, and measure the write speed for different file sizes on your `/scratch/`
+
+## Hands-on {.handson}
+
+Add a similar function for reading, and read the data you just produced. What's your throughput?
+
 # Storage Architectures
 
 > These aren't books in which events of the past are pinned like so many butterflies to a cork. These are the books from which history is derived. There are more than twenty thousand of them; each one is ten feet high, bound in lead, and the letters are so small that they have to be read with a magnifying glass.
@@ -186,6 +196,7 @@ The file system becomes an independent system.
 * All nodes see the same set of files.
 * A set of central servers manages the file system.
 * All nodes accessing the lustre file system run local *clients*.
+* Optimized for high traffic volumes in large files.
 
 ## Metadata and storage servers
 * The index is spread over a group of Metadata servers (MDS, 8 for work on levante).

lectures/file-and-data-systems/timer.ipynb

+{
+ "cells": [
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "bc0cdf17-1d21-4ade-a090-45101abf8ab5",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "import timeit"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 2,
+   "id": "bcf39570-a5bc-4af4-9354-06a801222826",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "def write (path, length, blocksize=1024**2):\n",
+    "    with open(path, \"wb\") as of:\n",
+    "        data = bytearray(blocksize)\n",
+    "        times = length // (blocksize)\n",
+    "        remainder = length % blocksize\n",
+    "        for i in range (times):\n",
+    "            of.write(data)\n",
+    "        if remainder:\n",
+    "            of.write(bytearray(remainder))\n",
+    "        of.close()"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 3,
+   "id": "34a59ea9-52c9-4c3f-8664-a5a97882e5e0",
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "{'1GB': 0.5966405299986945}\n"
+     ]
+    }
+   ],
+   "source": [
+    "duration = {}\n",
+    "duration['1GB'] = timeit.timeit(lambda : write(\"/scratch/k/k202134/test.1GB\", (1024**3)), number =1)\n",
+    "print (duration)"
+   ]
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "0 Python 3 (based on the module python3/unstable",
+   "language": "python",
+   "name": "python3_unstable"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.10.10"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}