Popular repositories Loading

1. inference inference Public

   Forked from furiosa-ai/inference

   Reference implementations of MLPerf™ inference benchmarks

   Python

2. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

3. rf-detr rf-detr Public

   Forked from roboflow/rf-detr

   RF-DETR is a real-time object detection and segmentation model architecture developed by Roboflow, SOTA on COCO and designed for fine-tuning.

   Python

4. KVTuner KVTuner Public

   Forked from cmd2001/KVTuner

   KVTuner: Sensitivity-Aware Layer-wise Mixed Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference

   Python

5. simple-evals simple-evals Public

   Forked from furiosa-ai/simple-evals

   Python 1

6. SnapKV SnapKV Public

   Forked from FasterDecoding/SnapKV

   Python