We discuss a recent attempt by Chris Daly and Simon Langford to do away with mathematical explanations of physical phenomena. Daly and Langford suggest that mathematics merely indexes parts of the physical world, and on this understanding of the role of mathematics in science, there is no need to countenance mathematical explanation of physical facts. We argue that their strategy is at best a sketch and only looks plausible in very simple toy cases. We also draw attention to how frequently Daly and Langford find themselves in conflict with mathematical and scientific practice.