The Architecture of Loss