Unraveling the Law of Large Numbers