[Arxiv Preprint] PiSSA: Principal Singular values and Singular vectors Adaptation

A faster and better LoRA initialization method, (Paper, Code)

Fanxu Meng, Zhaohui Wang, Muhan Zhang.

[Arxiv Preprint] RM -R ./Removing Residual Connection Equivalently

A plug-in tricks for efficient pruning, (Paper, Code)

Fanxu Meng, Hao Cheng, Jiaxin Zhuang, Ke Li, Xing Sun.

[NeurIPS 2020] Pruning Filter in Filter

Stripe wise pruning, (Paper, Code)

Fanxu Meng, Hao Cheng, Ke Li, Huixiang Luo, Xiaowei Guo, Guangming Lu, Xing Sun.

[CVPR 2020] Filter Grafting for Deep Neural Networks

Reactivate invalid filter while training,(Paper, Code)

Fanxu Meng, Hao Cheng, Ke Li, Zhixin Xu, Rongrong Ji, Xing Sun, Guangming Lu.