Search results

Qwen3 MoE support

Status: Open.

#22 In shawntan/scattermoe;

· avacaondata opened on Oct 3, 2025

Recommended environment

Status: Open.

#19 In shawntan/scattermoe;

· Cy-47 opened on Nov 26, 2024

Different number of experts for each token

Status: Open.

#18 In shawntan/scattermoe;

· Cy-47 opened on Nov 23, 2024

torch.autocast errors

Status: Open.

#17 In shawntan/scattermoe;

· JCBrouwer opened on Oct 17, 2024

Can't use torch.compile

Status: Open.

#12 In shawntan/scattermoe;

· shikhartuli opened on Jul 3, 2024

Question: Multi-node training

Status: Open.

#11 In shawntan/scattermoe;

· casper-hansen opened on Apr 13, 2024

No module named 'torch'

Status: Open.

#9 In shawntan/scattermoe;

· winkelstein opened on Apr 10, 2024

Megablocks example

Status: Open.

#7 In shawntan/scattermoe;

· ehartford opened on Apr 5, 2024

Segfault CUDA 12.2

Status: Open.

#4 In shawntan/scattermoe;

· sshleifer opened on Mar 19, 2024

Tensor Parallelism

Status: Open.

#1 In shawntan/scattermoe;

· timmytwoteeth opened on Mar 14, 2024