Python bindings for the Transformer models implemented in C/C++ using GGML library.

Features

  • It provides a unified interface for all models
  • It also provides access to the low-level C API
  • It can be used with models hosted on the Hub
  • It is integrated into LangChain
  • Install CUDA libraries
  • Load a GPTQ model

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow CTransformers

CTransformers Web Site

Other Useful Business Software
Save Up to 91% on Cloud Compute With Spot VMs Icon
Save Up to 91% on Cloud Compute With Spot VMs

Automatic sustained-use discounts. One free VM per month. No negotiation needed.

Run batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
Try Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of CTransformers!

Additional Project Details

Programming Language

C

Related Categories

C Large Language Models (LLM)

Registered

2023-08-25