Systems

Slides in Keynote and PDF.

Content

• Hardware

  • Processor, RAM, buses, GPU, disk, SSD, network, switches, racks, server centers

  • Bandwidth, latency and faults

• Basic parallelization paradigms

  • Trees, stars, rings, queues

  • Hashing (consistent, proportional)

  • Distributed hash tables and P2P

• Storage

  • RAID

  • Google File System / HadoopFS

  • Distributed (key, value) storage

• Processing

  • MapReduce

  • Dryad

  • S4 / stream processing

Supplementary material

• Consistent hashing (Karger et al.) paper

• Stateless Proportional Caching (Chawla et al.) paper, slides

• Pastry P2P routing (Rowstron and Druschel) paper, site

• MapReduce (Dean and Ghemawat) site

• Google File System (Ghemawat, Gobioff, Leung) site

• Amazon Dynamo (deCandia et al.) slides, paper, Peter Vogel's DynamoDB post

• BigTable (Chang et al.) site

• CEPH filesystem (proportional hashing, file system) homepage, paper on distribution protocol

• CPUS Sandy Bridge, ARM micoarchitecture

• NVIDIA CUDA CUDA site

• ATI Stream Computing site

• Microsoft Dryad (Isard et al.) site

• Yahoo S4 (Neumayer et al.) site, slides, paper

• Memcached site

• Linked.In Voldemort (key,value) storage design description

• PNUTS distributed storage (Cooper et al.) paper

• SSDs (solid state drives) benchmarks

• All Things Distributed, Peter Vogel's blog

Videos