Skip to content
View sysuTobo's full-sized avatar
🐷
🐷

Block or report sysuTobo

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. pegainfer-project/pegainfer pegainfer-project/pegainfer Public

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Rust 743 121

  2. FeathBow/invar FeathBow/invar Public

    When a new kernel changes your model's numbers, Invar decides whether the evidence supports the replacement for a declared use, with a confidence bound.

    Haskell 3 1

  3. NVIDIA-NeMo/Automodel NVIDIA-NeMo/Automodel Public

    🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

    Python 1.1k 385

  4. vllm-project/vllm-omni vllm-project/vllm-omni Public

    A framework for efficient model inference with omni-modality models

    Python 7.8k 2.1k

  5. inclusionAI/ASpec inclusionAI/ASpec Public

    A high-throughput training framework for Speculative decoding models.

    Python 54 7

  6. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

    FlashInfer: Kernel Library for LLM Serving

    Cuda 6.9k 1.8k