Real-Time Edge AI and Sensing Group

Popular repositories Loading

1. SmartThinker SmartThinker Public

   Repository for the paper “SmartThinker: Progressive Chain-of-Thought Length Calibration for Efficient Large Language Model Reasoning”

   Python 17

2. TokenFlow TokenFlow Public

   Forked from sgl-project/sglang

   [EuroSys 2026] TokenFlow: Buffer-aware preemptive scheduling and proactive KV-cache management for responsive LLM streaming.

   Python 5

3. SemiCMT SemiCMT Public

   SemiCMT: Contrastive Cross-Modal Knowledge Transfer for IoT Sensing with Semi-Paired Multi-Modal Signals

   1

4. vattention vattention Public

   Forked from microsoft/vattention

   Dynamic Memory Management for Serving LLMs without PagedAttention

   C

5. LightLLM LightLLM Public

   Forked from ModelTC/LightLLM

   LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

   Python