NB-Cache: Non-blocking in-network caching for high-speed content routers

Tian Pan, Xingchen Lin, Jiao Zhang, Tao Huang, Hao Li, Jianhui Lv, Bin Liu, Beichuan Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations


Information-Centric Networking (ICN) provides scalable and efficient content distribution at the Internet scale due to its in-network caching and native multicast capabilities. To support these features, a content router needs high performance at its data plane, which consists of three forwarding steps: checking the Content Store (CS), then the Pending Interest Table (PIT), and finally the Forwarding Information Base (FIB). While prior works focus on performance optimization of a single step, we build an analytical model of content router's entire data plane and identify that CS is the actual bottleneck in the pipeline. Compared with PIT and FIB, CS is more challenging because it has more data to read/write, may have more entries in its table to store and lookup, and needs to organize content objects to sustain frequent cache replacement. Then, we propose a novel mechanism called "NB-Cache" to address CS's performance issue from a network-wide point of view rather than a single router's. In NB-Cache, when packets arrive at a router whose CS is fully loaded, instead of being blocked and waiting for the CS, these packets are forwarded to the next-hop router, whose CS may not be fully loaded. This approach essentially utilizes Content Stores of all the routers along the forwarding path in parallel rather than checking each CS sequentially. Our experiments show significant improvement of data plane performance: 70% reduction in round-trip time (RTT) and 130% increase in throughput.

Original languageEnglish (US)
Title of host publicationProceedings of the International Symposium on Quality of Service, IWQoS 2019
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450367783
StatePublished - Jun 24 2019
Event2019 International Symposium on Quality of Service, IWQoS 2019 - Phoenix, United States
Duration: Jun 24 2019Jun 25 2019

Publication series

NameProceedings of the International Symposium on Quality of Service, IWQoS 2019


Conference2019 International Symposium on Quality of Service, IWQoS 2019
Country/TerritoryUnited States


  • Bottleneck Bypassing
  • Content Router
  • ICN
  • Non-Blocking I/O

ASJC Scopus subject areas

  • Management of Technology and Innovation
  • Computer Networks and Communications
  • Safety, Risk, Reliability and Quality
  • Media Technology


Dive into the research topics of 'NB-Cache: Non-blocking in-network caching for high-speed content routers'. Together they form a unique fingerprint.

Cite this