Search results

[BUG] Errors in GPT-MoE models Inferences

bugSomething isn't workingSomething isn't working

inference

Status: Open.

#6973�?In microsoft/DeepSpeed;

· 1155157110 opened on Jan 25, 2025

[BUG] libaio on amd node

bugSomething isn't workingSomething isn't working

training

Status: Open.

#6972�?In microsoft/DeepSpeed;

· GuanhuaWang opened on Jan 25, 2025

GPUUtil-0 remains 0 during the process loading a 72B model

Status: Open.

#6970�?In microsoft/DeepSpeed;

· NivinaNull opened on Jan 24, 2025

[BUG] the input variables may be changed to scalars when use activation checkpoint

bugSomething isn't workingSomething isn't working

training

Status: Open.

#6969�?In microsoft/DeepSpeed;

· zhangvia opened on Jan 23, 2025

[BUG] z3+compile+gradient checkpoint uses more memory

bugSomething isn't workingSomething isn't working

training

Status: Open.

#6966�?In microsoft/DeepSpeed;

· oraluben opened on Jan 22, 2025

[BUG] deepspeed fails with torch 2.5 due to module._parameters is a dict, no longer a OrderedDict

bugSomething isn't workingSomething isn't working

training

Status: Open.

#6961�?In microsoft/DeepSpeed;

· skydoorkai opened on Jan 20, 2025

Is "Hierarchical All-to-all" feat available in current version?

Status: Open.

#6957�?In microsoft/DeepSpeed;

· GalanPei opened on Jan 16, 2025

[REQUEST] FPDT backward test

enhancementNew feature or requestNew feature or request

Status: Open.

#6955�?In microsoft/DeepSpeed;

· YizhouZ opened on Jan 16, 2025

[REQUEST] Pipeline Parallelism support multi optimizer to train

enhancementNew feature or requestNew feature or request

Status: Open.

#6951�?In microsoft/DeepSpeed;

· whcjb opened on Jan 15, 2025

[BUG] model(**input) cannot use under zero stage 3.

bugSomething isn't workingSomething isn't working

training

Status: Open.

#6949�?In microsoft/DeepSpeed;

· MarkDeng1 opened on Jan 14, 2025

[Roadmap] DeepSpeed Roadmap Q1 2025

roadmapRoadmap direction for DeepSpeedRoadmap direction for DeepSpeed

Status: Open.

#6946�?In microsoft/DeepSpeed;

· loadams opened on Jan 13, 2025

nv-nightly CI test failure

ci-failure

Status: Open.

#6935�?In microsoft/DeepSpeed;

· github-actions opened on Jan 9, 2025