Thermal and Athermal Swarms of Self-Propelled Particles