Building distributed systems is hard. Fortunately, there is a robust body of mathematical research from which we can draw inspiration. Idempotent endpoints prevent duplication in the face of repeated messages. Commutative operations tolerate messages arriving out of order. Conflict Free Replicated Data Types (CRDTs) ensure that systems approach a consistent state as they exchange information.