A memory optimization technique for software-managed scratchpad memory in GPUs