Performance-efficient mechanisms for managing irregularity in throughput processors