Python bindings for the Transformer models implemented in C/C++ using GGML library.
Features
- It provides a unified interface for all models
- It also provides access to the low-level C API
- It can be used with models hosted on the Hub
- It is integrated into LangChain
- Install CUDA libraries
- Load a GPTQ model
Categories
Large Language Models (LLM)License
MIT LicenseFollow CTransformers
Other Useful Business Software
Save Up to 91% on Cloud Compute With Spot VMs
Run batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of CTransformers!