Skip to content
Snippets Groups Projects
Commit 689da692 authored by Florian Ziemen's avatar Florian Ziemen
Browse files

Added content to properties of storage systems

parent 9022741d
No related branches found
No related tags found
1 merge request!11File and Data Systems
Pipeline #70886 passed
......@@ -16,15 +16,26 @@ author: "Florian Ziemen and Karl-Hermann Wieners"
# Properties of storage systems
## Latency
* How long does it take until we get the first bit of data?
* Crucial when opening many small files (e.g. starting python)
* Less crucial when reading one big file start-to end.
* Largely determined by moving pieces in the storage medium.
## Continuous read / write
## Random read / write
* How much data do we get per second when we are reading continuously?
* Important for reading/writing large blobs of data from/into individual files.
## Caching
## Random read / write
## Parallel read / write
* Mixture of latency and continuous read/write
* Reading many small files / skipping around in files
## Caching
* Keeping data *in memory* for frequent re-use.
* Usually storage media like disks have small caches with better properties.
* e.g. HDD of 16 TB with a 512 MB of cache.
* Operating systems also cache read.
# Hardware types and access options
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment