publications

2026

1. SIGMOD 2027

   CatKV: Accelerating Position-Independent Caching with Context-Adaptive KV Cache Compression

   Jie Xu, Renjie Liu, Yi Li, and 1 more author

   SIGMOD 2027

   Abs DOI PDF

   Context caching is widely adopted to reduce the dominant prefill cost for long prompts across various large language model (LLM) applications. Recently, position-independent caching (PIC) has emerged to improve KV cache reuse beyond strict prefix matching. However, the required KV caches often reside in a persistent remote store in realistic deployments, making KV transfer the new bottleneck on time-to-first-token (TTFT). Existing KV compression techniques are primarily designed for long contexts. Since text chunks in PIC are much smaller, they fail to deliver sufficient compression and/or lead to substantial generation quality degradation.In this work, we propose CatKV, an end-to-end PIC serving system for efficient KV cache reuse. Specifically, we devise a context-adaptive mixed-precision compression scheme in CatKV, which combines SVD factorization with adaptive scalar quantization in latent space. Given a target compression ratio, CatKV automatically determines the SVD and quantization configurations by analyzing the singular-value spectrum using the elbow method. To improve system efficiency, CatKV offloads online compression of cold text chunks to the CPU for asynchronous execution and exploits grouped factorization across chunks to further reduce storage consumption. Furthermore, CatKV introduces a six-stage layer-wise pipeline to reduce end-to-end latency. Extensive experiments demonstrate the superiority of CatKV across 3 PIC algorithms, 4 benchmarks, and 3 LLMs. In particular, CatKV achieves 2–5\texttimes faster TTFT and 6–10\texttimes higher compression ratios compared to baselines, all while preserving model accuracy. CatKV is open-source at https://github.com/AlayaDB-AI/CatKV.git.

2. ICML 2026

   FiX: Introducing Fine-grained Forget Gate into Softmax Attention

   Runzhong Li, Renjie Liu, Li Qing, and 1 more author

   ICML 2026

   PDF
3. ICDE 2026

   Efficient Neural-Symbolic Data System via Multi-Agent Collaboration

   Ye Yuan, Bo Tang, Zhaojing Luo, and 2 more authors

   ICDE 2026

   DOI PDF

2025

1. Arxiv 2025

   PolyG: Adaptive Graph Traversal for Diverse GraphRAG Questions

   Renjie Liu, Haitian Jiang, Xiao Yan, and 2 more authors

   Arxiv 2025

   PDF
2. SIGMOD 2025

   DiskGNN: Bridging I/O Efficiency and Model Accuracy for Out-of-Core GNN Training

   Renjie Liu^*, Yichuan Wang^*, Xiao Yan, and 5 more authors

   SIGMOD 2025, *equal contribution

   Abs DOI PDF

   Graph neural networks (GNNs) are models specialized for graph data and widely used in applications. To train GNNs on large graphs that exceed CPU memory, several systems have been designed to store data on disk and conduct out-of-core processing. However, these systems suffer from either read amplification when conducting random reads for node features that are smaller than a disk page, or degraded model accuracy by treating the graph as disconnected partitions. To close this gap, we build DiskGNN for high I/O efficiency and fast training without model accuracy degradation. The key technique is offline sampling, which decouples graph sampling from model computation. In particular, by conducting graph sampling beforehand for multiple mini-batches, DiskGNN acquires the node features that will be accessed during model computation and conducts pre-processing to pack the node features of each mini-batch contiguously on disk to avoid read amplification for computation. Given the feature access information acquired by offline sampling, DiskGNN also adopts designs including four-level feature store to fully utilize the memory hierarchy of GPU and CPU to cache hot node features and reduce disk access, batched packing to accelerate feature packing during pre-processing, and pipelined training to overlap disk access with other operations. We compare DiskGNN with state-of-the-art out-of-core GNN training systems. The results show that DiskGNN has more than 8x speedup over existing systems while matching their best model accuracy. DiskGNN is open-source at https://github.com/Liu-rj/DiskGNN.

3. PPoPP 2025

   Adaptive Parallel Training for Graph Neural Networks

   Kaihao Ma^*, Renjie Liu^*, Xiao Yan, and 5 more authors

   PPoPP 2025, *equal contribution

   Abs DOI PDF

   There are several strategies to parallelize graph neural network (GNN) training over multiple GPUs. We observe that there is no consistent winner (i.e., with the shortest running time), and the optimal strategy depends on the graph dataset, GNN model, training algorithm, and hardware configurations. As such, we design the APT system to automatically select efficient parallelization strategies for GNN training tasks. To this end, we analyze the trade-offs of the strategies and design simple yet effective cost models to compare their execution time and facilitate strategy selection. Moreover, we also propose a general abstraction of the strategies, which allows to implement a unified execution engine that can be configured to run different strategies. Our experiments show that APT usually chooses the optimal or a close to optimal strategy, and the training time can be reduced by over 2x compared with always using a single strategy. APT is open-source at https://github.com/kaihaoma/APT.

4. ICLR 2025

   MuseGNN: Forming Scalable, Convergent GNN Layers that Minimize a Sampling-Based Energy

   Haitian Jiang, Renjie Liu, Zengfeng Huang, and 5 more authors

   ICLR 2025

   PDF

2023

1. SOSP 2023

   gSampler: General and Efficient GPU-based Graph Sampling for Graph Learning

   Ping Gong, Renjie Liu, Zunyao Mao, and 5 more authors

   SOSP 2023

   Abs DOI PDF

   Graph sampling prepares training samples for graph learning and can dominate the training time. Due to the increasing algorithm diversity and complexity, existing sampling frameworks are insufficient in the generality of expression and the efficiency of execution. To close this gap, we conduct a comprehensive study on 15 popular graph sampling algorithms to motivate the design of gSampler, a general and efficient GPU-based graph sampling framework. gSampler models graph sampling using a general 4-step Extract-Compute-Select-Finalize (ECSF) programming model, proposes a set of matrix-centric APIs that allow to easily express complex graph sampling algorithms, and incorporates a data-flow intermediate representation (IR) that translates high-level API codes for efficient GPU execution. We demonstrate that implementing graph sampling algorithms with gSampler is easy and intuitive. We also conduct extensive experiments with 7 algorithms, 4 graph datasets, and 2 hardware configurations. The results show that gSampler introduces sampling speedups of 1.14–32.7\texttimes and an average speedup of 6.54\texttimes, compared to state-of-the-art GPU-based graph sampling systems such as DGL, which translates into an overall time reduction of over 40% for graph learning. gSampler is open-source at https://tinyurl.com/29twthd4.