North Carolina State University

TensorWorld studies sparse and structured computation across HPC, systems, and AI.

TensorWorld is a research group led by Dr. Jiajia Li at North Carolina State University. We build parallel algorithms, software, and systems for sparse and irregular tensor workloads, performance analysis, heterogeneous computing, and large-scale scientific and AI applications.

Research Themes

  • Sparse and structured tensor methods
  • GPU and heterogeneous systems
  • Performance profiling and analysis
  • Software infrastructure for AI and science

What We Build

Projects

CROSS

Cross-layer coordination and optimization for scalable and sparse tensor networks. TensorWorld leads NSF-supported work on abstractions, systems, and performance portability for tensor network workloads.

NSF PPoSS LARGE, 2023-2028

Sparse Tensor Systems

We design algorithms, data structures, and runtime support for sparse tensor contraction, decomposition, and related kernels on CPUs, GPUs, and emerging architectures.

Performance Profiling

Our group builds profiling and analysis tools for modern ML workloads, with an emphasis on data types, memory behavior, GPU execution, and framework-level performance bottlenecks.

Irregular Applications

We study performance optimization for irregular algorithms in graph, hypergraph, tensor, and scientific computing workloads, including auto-tuning and architecture-aware implementation strategies.

New Results

Recent Publications

  • TypeCraft: A Lightweight Data Type Profiler with High Resolution

    Zecheng Li, Xu Liu, Namhyung Kim, Blake Jones, Alexey Alexandrov, Jiajia Li

    OSDI 2026 (Accepted)

  • SmartDispatch: Dynamic Substitution of NumPy-style APIs on Heterogenous CPU-GPU Systems

    Jinku Cui, Yueming Hao, Shuyin Jiao, Jiajia Li, Xu Liu

    FSE 2026 (Accepted)

  • G-HEMP: Fast Multi-GPU Private Inference for Large-Scale GCNs with Homomorphic Encryption

    Ran Ran, Zhaoting Gong, Zhaowei Li, Xianting Lu, Jiajia Li, Wujie Wen

    MLSys 2026 (Accepted)

  • STTID: High-Performance Sparse Tensor-Train Interpolative Decomposition

    Zhaonan Meng, Miles Stoudenmire, Karl Pierce, Frank Mueller, Jiajia Li

    IPDPS 2026

  • RedSan: A Redundant Memory Instruction Sanitizer for GPU Programs

    Yanbo Zhao, Yueming Hao, Zecheng Li, Shuyin Jiao, Xu Liu, Jiajia Li

    SC 2025

  • DeepContext: A Context-aware, Cross-platform, and Cross-framework Tool for Performance Profiling and Analysis of Deep Learning Workloads

    Qidong Zhao, Hao Wu, Yueming Hao, Zilingfeng Ye, Jiajia Li, Xu Liu, Keren Zhou

    ASPLOS 2025

  • FASTEN: Fast GPU-accelerated Segmented Matrix Multiplication for Heterogenous Graph Neural Networks

    Keren Zhou, Karthik Ganapathi Subramanian, Po-Hsun Lin, Matthias Fey, Binqian Yin, Jiajia Li

    ICS 2024

Open Source

Software

STTID

STTID: High-Performance Sparse Tensor-Train Interpolative Decomposition.

RedSan

RedSan: A Redundant Memory Instruction Sanitizer for GPU Programs.

SymProp

SymProp: Scaling Sparse Symmetric Tucker Decomposition via Symmetry Propagation.

HiParTI

A hierarchical parallel tensor infrastructure for sparse and structured tensor computing.

PASTA

A parallel sparse tensor algorithm benchmark suite spanning CPUs and GPUs.

ParTI

A parallel tensor infrastructure for data analysis and tensor kernels.

AdaTM

Adaptive tensor memoization support for CP decomposition.

InTensLi

Input-adaptive and in-place dense tensor-times-matrix multiplication.

SMAT

A sparse matrix-vector multiplication auto-tuner.

Team

People

Faculty

  • Jiajia Li PI, Department of Computer Science, NC State University

Ph.D. Students

Current

  • Feiyang ZhengStarted 2025
  • Devadatta MandaoganeStarted 2025
  • Rahmy SalmanStarted 2024
  • Zhaonan MengStarted 2024
  • Sai Krishna Teja Varma ManthenaStarted 2024
  • Zecheng LiStarted 2023
  • Sogolsadat MansouriStarted 2022
  • Yanbo ZhaoCo-advised, started 2022
  • Yi WangCo-advised, started 2021
  • Jinku CuiCo-advised, started 2020

Alumni

  • Qidong ZhaoCo-advised, graduated 2025, Google

Master's Students

Current

  • Zizhong WangStarted 2025

Alumni

  • Sri Harshavardhan Reddy DeverapalliGraduated 2026, NCSU
  • Mushtaq Ahmed ShaikhGraduated 2025
  • Ahmed TaimoorGraduated 2025, NCSU
  • Devadatta MandaoganeGraduated 2025, NCSU
  • Swarnamalya MohanGraduated 2024
  • Sounder RajendranGraduated 2024, AMD
  • Sai Krishna Teja Varma ManthenaGraduated 2024, NCSU
  • Karthik Ganapathi SubramanianGraduated 2024
  • Po-Hsun LinGraduated 2024