Set Variation-aware Shared LLC Management for CPU-GPU Heterogeneous Architecture
Zhaoying Li, Lei Jua, Hongjun Dai, Xin Li, Mengying Zhao and Zhiping Jia
Shandong University, China
ajulei@sdu.edu.cn
ABSTRACT
Heterogeneous CPU-GPU multiprocessor systemson-chip (HMPSoC) becomes a popular architecture choice for high performance embedded systems, where shared last-level cache (LLC) management becomes a critical design consideration. We observe that within a sampling period, CPU and GPU may have distinct access behaviors over various LLC sets. In this work, we propose a light-weighted and fined-grained cache management policy to cope with the CPU-GPU access behavior variation among cache sets. In particular, CPU and GPU requests are prioritized disparately in each LLC set during cache block insertion and promotion, based on the per-core utility behaviors and a per-set CPU-GPU miss counter. Experimental results show that our LLC management scheme outperforms the two state of-the-art schemes TAP-RRIP and LSP by 12.6% and 10.01%, respectively.
