DeepSpeed

DeepSpeed

Microsoft
+
+

Related Products

  • Gemini Enterprise Agent Platform
    967 Ratings
    Visit Website
  • RunPod
    211 Ratings
    Visit Website
  • Cloudflare
    2,010 Ratings
    Visit Website
  • Qloo
    23 Ratings
    Visit Website
  • Fraud.net
    56 Ratings
    Visit Website
  • Dragonfly
    16 Ratings
    Visit Website
  • PackageX OCR Scanning
    48 Ratings
    Visit Website
  • Retool
    577 Ratings
    Visit Website
  • Bright Data
    1,388 Ratings
    Visit Website
  • Nexo
    18,034 Ratings
    Visit Website

About

DeepSpeed is an open source deep learning optimization library for PyTorch. It's designed to reduce computing power and memory use, and to train large distributed models with better parallelism on existing computer hardware. DeepSpeed is optimized for low latency, high throughput training. DeepSpeed can train DL models with over a hundred billion parameters on the current generation of GPU clusters. It can also train up to 13 billion parameters in a single GPU. DeepSpeed is developed by Microsoft and aims to offer distributed training for large-scale models. It's built on top of PyTorch, which specializes in data parallelism.

About

Horovod was originally developed by Uber to make distributed deep learning fast and easy to use, bringing model training time down from days and weeks to hours and minutes. With Horovod, an existing training script can be scaled up to run on hundreds of GPUs in just a few lines of Python code. Horovod can be installed on-premise or run out-of-the-box in cloud platforms, including AWS, Azure, and Databricks. Horovod can additionally run on top of Apache Spark, making it possible to unify data processing and model training into a single pipeline. Once Horovod has been configured, the same infrastructure can be used to train models with any framework, making it easy to switch between TensorFlow, PyTorch, MXNet, and future frameworks as machine learning tech stacks continue to evolve.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Deep learning model developers

Audience

Developers in need of a powerful Development Framework solution

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Microsoft
Founded: 1975
United States
www.deepspeed.ai/

Company Information

Horovod
horovod.ai/

Alternatives

Alternatives

MXNet

MXNet

The Apache Software Foundation
GPT-NeoX

GPT-NeoX

EleutherAI
AWS Neuron

AWS Neuron

Amazon Web Services
AWS Neuron

AWS Neuron

Amazon Web Services

Categories

Categories

Integrations

PyTorch
Python
Amazon Web Services (AWS)
Axolotl
Azure Databricks
Cake AI
Comet LLM
Flyte
Keras
MXNet
Microsoft Azure
Nurix
TensorFlow

Integrations

PyTorch
Python
Amazon Web Services (AWS)
Axolotl
Azure Databricks
Cake AI
Comet LLM
Flyte
Keras
MXNet
Microsoft Azure
Nurix
TensorFlow
Claim DeepSpeed and update features and information
Claim DeepSpeed and update features and information
Claim Horovod and update features and information
Claim Horovod and update features and information