Fanxu Meng(孟繁续)

I am currently a Ph.D. student at the Institute for Artificial Intelligence, Peking University, under the supervision of Prof. Muhan Zhang. My research focuses on efficient LLMs and model compression. I have also served as a reviewer for ICML 2022, ICLR 2023, and TPAMI.

News

Selected Publications


[NeurIPS 2024 spotlight] PiSSA: Principal Singular values and Singular vectors Adaptation

A faster and better LoRA initialization method, (Paper, Code)

Fanxu Meng, Zhaohui Wang, Muhan Zhang.


[Arxiv Preprint] RM -R ./Removing Residual Connection Equivalently

A plug-in tricks for efficient pruning, (Paper, Code)

Fanxu Meng*, Hao Cheng*, Jiaxin Zhuang, Ke Li, Xing Sun.


[NeurIPS 2020] Pruning Filter in Filter

Stripe wise pruning, (Paper, Code)

Fanxu Meng*, Hao Cheng*, Ke Li, Huixiang Luo, Xiaowei Guo, Guangming Lu, Xing Sun.


[CVPR 2020] Filter Grafting for Deep Neural Networks

Reactivate invalid filter while training,(Paper, Code)

Fanxu Meng*, Hao Cheng*, Ke Li, Zhixin Xu, Rongrong Ji, Xing Sun, Guangming Lu.

Get in touch