Enabling and Scaling Matrix Computations on Heterogeneous Multi-Core and Multi-GPU Systems