Search results

About collect training data. Encounter error about Bus

Status: Open.

#37 In FMInference/DejaVu;

· Phan1000-7 opened on Jun 7, 2025

lm_head.weight in convert_opt_checkpoint.py

Status: Open.

#36 In FMInference/DejaVu;

· quaternior opened on Oct 31, 2024

How to calculate Activated Neurons

Status: Open.

#34 In FMInference/DejaVu;

· LiuJinzhe-Keepgoing opened on Sep 20, 2024

No such file ./trace_json/xxxxx

Status: Open.

#33 In FMInference/DejaVu;

· MathsCode opened on Sep 4, 2024

How to test the sparsity of the model？

Status: Open.

#32 In FMInference/DejaVu;

· lw20191012 opened on Aug 21, 2024

Training of predictors based on MOE model

Status: Open.

#31 In FMInference/DejaVu;

· mailonghua opened on Jul 23, 2024

Question about downsteam tasks accuracy

Status: Open.

#30 In FMInference/DejaVu;

· W-215 opened on Jul 10, 2024

the issue of parameter settings

Status: Open.

#29 In FMInference/DejaVu;

· W-215 opened on Jun 7, 2024

How to run on a single GPU?

Status: Open.

#28 In FMInference/DejaVu;

· xbzjsj opened on Apr 17, 2024

PyTorch 1.12 and flash-attn==0.2.8 are not compatible.

Status: Open.

#27 In FMInference/DejaVu;

· heheda12345 opened on Apr 10, 2024

the code about collect activations while inferencing

Status: Open.

#25 In FMInference/DejaVu;

· mli-tian opened on Apr 9, 2024

How to run the code with smaller ckpt like opt-6.7B

Status: Open.

#24 In FMInference/DejaVu;

· chenzq-98 opened on Apr 6, 2024