Fine-grained Parallel ILU Preconditioners with Fill-ins for Multi-core CPUs and GPUs