Expect and Tolerate Failures
Hardware fails every week (at this scale)
Focus on graceful degradation
- Node loss causes linear degradation in database size (random records removed)
- DB size * queries/sec ~ constant
=> We can reduce tradeoff DB size during surges