IEEE

CIR-NoC: Accelerating CNN Inference Through In-Router Computation During Network Congestion

Abstract: Traditional Network-on-Chip (NoC) architectures frequently suffer from network congestion when processing complex Convolutional Neural Network (CNN) models, primarily due to the massive data ...
IEEE

Computational Caching-Empowered Collaborative LLM Inference Framework in VEC Networks

Abstract: The overwhelming scale of large language models (LLMs) exhausts the on-device communication and computation resources in vehicular networks, limiting its application in performing inference ...