[AutoTP] Enable HF colwise_gather_output to support lm_head replace - #8146

[AutoTP] Enable HF colwise_gather_output to support lm_head replace#8146

delock merged 12 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

jinyouzhi:lm_head_colwisejinyouzhi/DeepSpeed:lm_head_colwiseCopy head branch name to clipboard