Sparsing Law: Towards Large Language Models with Greater Activation Sparsity.

Liqun Deng Yuqi Luo Chenyang Song Xu Han 0007 Yingfa Chen Chaojun Xiao Xiaojun Meng Liqun Deng Jiansheng Wei Zhiyuan Liu 0001 Maosong Sun 0001 Sparsing Law: Towards Large Language Models with Greater Activation Sparsity. 2025 ICML https://proceedings.mlr.press/v267/luo25i.html https://openreview.net/forum?id=SBUc5wirM8 conf/icml/2025 db/conf/icml/icml2025.html#LuoS0CXMDW0025

Yichun Yin Wenyong Huang Kaikai Song Yehui Tang Xueyu Wu Wei Guo 0006 Peng Guo Yaoyuan Wang Xiaojun Meng Yasheng Wang Dong Li 0016 Can Chen Dandan Tu Yin Li Fisher Yu 0003 Ruiming Tang Yunhe Wang 0001 Baojun Wang Bin Wang 0004 Bo Wang Boxiao Liu Changzheng Zhang Duyu Tang Fei Mi Hui Jin Jiansheng Wei Jiarui Qin Jinpeng Li 0004 Jun Zhao Liqun Deng Lin Li Minghui Xu Naifu Zhang Nianzu Zheng Qiang Li 0024 Rongju Ruan Shengjun Cheng Tianyu Guo 0001 Wei He 0001 Wei Li 0002 Weiwen Liu Wulong Liu Xinyi Dai Yonghan Dong Yu Pan Yue Li Yufei Wang 0005 Yujun Li Yunsheng Ni Zhe Liu Zhenhe Zhang Zhicheng Liu 0001 Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUs. 2025 April abs/2504.07866 CoRR https://doi.org/10.48550/arXiv.2504.07866 db/journals/corr/corr2504.html#abs-2504-07866 streams/journals/corr

Yehui Tang Yichun Yin Yaoyuan Wang Hang Zhou Yu Pan Wei Guo 0006 Zhiguo Zhang Miao Rang Fangcheng Liu Naifu Zhang Binghan Li Yonghan Dong Xiaojun Meng Yasheng Wang Dong Li 0016 Yin Li Dandan Tu Can Chen Youliang Yan Fisher Yu 0003 Ruiming Tang Yunhe Wang 0001 Botian Huang Bo Wang Boxiao Liu Changzheng Zhang Da Kuang Fei Liu Gang Huang Jiansheng Wei Jiarui Qin Jie Ran Jinpeng Li 0004 Jun Zhao Liang Dai Lin Li Liqun Deng Peifeng Qin Pengyuan Zeng Qiang Gu Shaohua Tang Shengjun Cheng Tao Gao Tao Yu Tianshu Li Tianyu Bi Wei He 0001 Weikai Mao Wenyong Huang Wulong Liu Xiabing Li Xianzhi Yu Xueyu Wu Xu He Yangkai Du Yan Xu Ye Tian Yimeng Wu Yongbing Huang Yong Tian Yong Zhu Yue Li Yufei Wang 0005 Yuhang Gai Yujun Li Yu Luo Yunsheng Ni Yusen Sun Zelin Chen Zhe Liu Zhicheng Liu 0001 Zhipeng Tu Zilin Ding Zongyuan Zhan Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs. 2025 May abs/2505.04519 CoRR https://doi.org/10.48550/arXiv.2505.04519 db/journals/corr/corr2505.html#abs-2505-04519 streams/journals/corr

Yidi Jiang Zhengyang Chen Ruijie Tao Liqun Deng Yanmin Qian Haizhou Li 0001 Prompt-Driven Target Speech Diarization. 11086-11090 2024 ICASSP https://doi.org/10.1109/ICASSP48485.2024.10446072 conf/icassp/2024 db/conf/icassp/icassp2024.html#JiangCTDQ024 Jingru Lin Meng Ge Junyi Ao Liqun Deng Haizhou Li 0001 SA-WavLM: Speaker-Aware Self-Supervised Pre-training for Mixture Speech. 2024 INTERSPEECH https://doi.org/10.21437/Interspeech.2024-787 conf/interspeech/2024 db/conf/interspeech/interspeech2024.html#LinGAD024 Dong Yao Jieming Zhu Jiahao Xun Shengyu Zhang 0001 Zhou Zhao 0001 Liqun Deng Wenqiao Zhang Zhenhua Dong Xin Jiang 0002 MART: Learning Hierarchical Music Audio Representations with Part-Whole Transformer. 967-970 2024 WWW (Companion Volume) https://doi.org/10.1145/3589335.3651535 https://www.wikidata.org/entity/Q131012332 conf/www/2024c db/conf/www/www2024c.html#YaoZXZZDZD024 Jiahao Xun Shengyu Zhang 0001 Yanting Yang Jieming Zhu Liqun Deng Zhou Zhao 0001 Zhenhua Dong Ruiqi Li Lichao Zhang Fei Wu 0001 DisCover: Disentangled Music Representation Learning for Cover Song Identification. 453-463 2023 SIGIR https://doi.org/10.1145/3539618.3591664 https://www.wikidata.org/entity/Q131014032 conf/sigir/2023 db/conf/sigir/sigir2023.html#XunZYZDZDLZ023

Jiahao Xun Shengyu Zhang 0001 Yanting Yang Jieming Zhu Liqun Deng Zhou Zhao 0001 Zhenhua Dong Ruiqi Li Lichao Zhang Fei Wu 0001 DisCover: Disentangled Music Representation Learning for Cover Song Identification. 2023 abs/2307.09775 CoRR https://doi.org/10.48550/arXiv.2307.09775 db/journals/corr/corr2307.html#abs-2307-09775

Junyi Ao Mehmet Sinan Yildirim Meng Ge Shuai Wang 0016 Ruijie Tao Yanmin Qian Liqun Deng Longshuai Xiao Haizhou Li 0001 USED: Universal Speaker Extraction and Diarization. 2023 abs/2309.10674 CoRR https://doi.org/10.48550/arXiv.2309.10674 db/journals/corr/corr2309.html#abs-2309-10674

Dong Yao Shengyu Zhang 0001 Zhou Zhao 0001 Jieming Zhu Liqun Deng Wenqiao Zhang Zhenhua Dong Ruiming Tang Xin Jiang 0002 Music-PAW: Learning Music Representations via Hierarchical Part-whole Interaction and Contrast. 2023 abs/2312.06197 CoRR https://doi.org/10.48550/arXiv.2312.06197 db/journals/corr/corr2312.html#abs-2312-06197

Tao Wang 0074 Jiangyan Yi Liqun Deng Ruibo Fu Jianhua Tao 0001 Zhengqi Wen Context-Aware Mask Prediction Network for End-to-End Text-Based Speech Editing. 6082-6086 2022 ICASSP https://doi.org/10.1109/ICASSP43922.2022.9746765 conf/icassp/2022 db/conf/icassp/icassp2022.html#WangYDFTW22 Lichao Zhang Yi Ren 0006 Liqun Deng Zhou Zhao 0001 HiFiDenoise: High-Fidelity Denoising Text to Speech with Adversarial Networks. 7232-7236 2022 ICASSP https://doi.org/10.1109/ICASSP43922.2022.9747155 conf/icassp/2022 db/conf/icassp/icassp2022.html#ZhangRDZ22 Lichao Zhang Zhou Zhao 0001 Yi Ren 0006 Liqun Deng EditSinger: Zero-Shot Text-Based Singing Voice Editing System with Diverse Prosody Modeling. 4503-4509 2022 IJCAI https://doi.org/10.24963/ijcai.2022/625 conf/ijcai/2022 db/conf/ijcai/ijcai2022.html#ZhangZ0D22 Haoquan Yang Liqun Deng Yu Ting Yeung Nianzu Zheng Yong Xu Streamable Speech Representation Disentanglement and Multi-Level Prosody Modeling for Live One-Shot Voice Conversion. 2578-2582 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-10277 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#YangDYZX22 Shuai Zhang 0014 Jiangyan Yi Zhengkun Tian Jianhua Tao 0001 Yu Ting Yeung Liqun Deng reducing multilingual context confusion for end-to-end code-switching automatic speech recognition. 3894-3898 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-10286 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#0014YTTYD22 Nianzu Zheng Liqun Deng Wenyong Huang Yu Ting Yeung Baohua Xu Yuanyuan Guo Yasheng Wang Xiao Chen 0012 Xin Jiang 0002 Qun Liu 0001 CoCA-MDD: A Coupled Cross-Attention based Framework for Streaming Mispronunciation Detection and Diagnosis. 4352-4356 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-11155 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#ZhengDHYXGWC0022 Daxin Tan Liqun Deng Nianzu Zheng Yu Ting Yeung Xin Jiang 0002 Xiao Chen 0012 Tan Lee CorrectSpeech: A Fully Automated System for Speech Correction and Accent Reduction. 81-85 2022 ISCSLP https://doi.org/10.1109/ISCSLP57327.2022.10038107 conf/iscslp/2022 db/conf/iscslp/iscslp2022.html#TanDZYJCL22 Lichao Zhang Ruiqi Li Shoutong Wang Liqun Deng Jinglin Liu Yi Ren 0006 Jinzheng He Rongjie Huang 0001 Jieming Zhu Xiao Chen Zhou Zhao 0001 M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus. 2022 conf/nips/2022 NeurIPS http://papers.nips.cc/paper_files/paper/2022/hash/2de60892dd329683ec21877a4e7c3091-Abstract-Datasets_and_Benchmarks.html db/conf/nips/neurips2022.html#ZhangLWDL0HHZCZ22

Shuai Zhang 0014 Jiangyan Yi Zhengkun Tian Jianhua Tao 0001 Yu Ting Yeung Liqun Deng Reducing language context confusion for end-to-end code-switching automatic speech recognition. 2022 abs/2201.12155 CoRR https://arxiv.org/abs/2201.12155 db/journals/corr/corr2201.html#abs-2201-12155

Daxin Tan Liqun Deng Nianzu Zheng Yu Ting Yeung Xin Jiang 0002 Xiao Chen 0012 Tan Lee CorrectSpeech: A Fully Automated System for Speech Correction and Accent Reduction. 2022 abs/2204.05460 CoRR https://doi.org/10.48550/arXiv.2204.05460 db/journals/corr/corr2204.html#abs-2204-05460

Daxin Tan Liqun Deng Yu Ting Yeung Xin Jiang 0002 Xiao Chen 0012 Tan Lee EditSpeech: A Text Based Speech Editing System Using Partial Inference and Bidirectional Fusion. 626-633 2021 ASRU https://doi.org/10.1109/ASRU51503.2021.9688051 conf/asru/2021 db/conf/asru/asru2021.html#TanDYJCL21 Disong Wang Liqun Deng Yang Zhang 0025 Nianzu Zheng Yu Ting Yeung Xiao Chen 0012 Xunying Liu Helen Meng Fcl-Taco2: Towards Fast, Controllable and Lightweight Text-to-Speech Synthesis. 5714-5718 2021 ICASSP https://doi.org/10.1109/ICASSP39728.2021.9414870 conf/icassp/2021 db/conf/icassp/icassp2021.html#WangDZZYCLM21 Disong Wang Liqun Deng Yu Ting Yeung Xiao Chen 0012 Xunying Liu Helen Meng VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-Shot Voice Conversion. 1344-1348 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-283 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#WangDYCLM21 Disong Wang Liqun Deng Yu Ting Yeung Xiao Chen 0012 Xunying Liu Helen Meng Unsupervised Domain Adaptation for Dysarthric Speech Detection via Domain Adversarial Training and Mutual Information Minimization. 2956-2960 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-2139 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#WangDYCLM21a

Disong Wang Liqun Deng Yu Ting Yeung Xiao Chen 0012 Xunying Liu Helen Meng Unsupervised Domain Adaptation for Dysarthric Speech Detection via Domain Adversarial Training and Mutual Information Minimization. 2021 abs/2106.10127 CoRR https://arxiv.org/abs/2106.10127 db/journals/corr/corr2106.html#abs-2106-10127

Disong Wang Liqun Deng Yu Ting Yeung Xiao Chen 0012 Xunying Liu Helen Meng VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion. 2021 abs/2106.10132 CoRR https://arxiv.org/abs/2106.10132 db/journals/corr/corr2106.html#abs-2106-10132

Daxin Tan Liqun Deng Yu Ting Yeung Xin Jiang 0002 Xiao Chen 0012 Tan Lee EditSpeech: A Text Based Speech Editing System Using Partial Inference and Bidirectional Fusion. 2021 abs/2107.01554 CoRR https://arxiv.org/abs/2107.01554 db/journals/corr/corr2107.html#abs-2107-01554

Nianzu Zheng Liqun Deng Wenyong Huang Yu Ting Yeung Baohua Xu Yuanyuan Guo Yasheng Wang Xin Jiang 0002 Qun Liu 0001 CCA-MDD: A Coupled Cross-Attention based Framework for Streaming Mispronunciation detection and diagnosis. 2021 abs/2111.08191 CoRR https://arxiv.org/abs/2111.08191 db/journals/corr/corr2111.html#abs-2111-08191

Yang Zhang Liqun Deng Yasheng Wang Unified Mandarin TTS Front-end Based on Distilled BERT Model. 2020 abs/2012.15404 CoRR https://arxiv.org/abs/2012.15404 db/journals/corr/corr2012.html#abs-2012-15404

Liqun Deng Guowei Huang 0002 Yuzheng Zhuang Jiansheng Wei Youliang Yan HiGene: A high-performance platform for genomic data analysis. 576-583 2016 BIBM https://doi.org/10.1109/BIBM.2016.7822584 https://doi.ieeecomputersociety.org/10.1109/BIBM.2016.7822584 conf/bibm/2016 db/conf/bibm/bibm2016.html#DengHZWY16

Yang Yang 0046 Howard Leung Lihua Yue Liqun Deng Generating a two-phase lesson for guiding beginners to learn basic dance movements. 1-20 2013 61 Comput. Educ. https://doi.org/10.1016/j.compedu.2012.09.006 db/journals/ce/ce61.html#YangLYD13

Liqun Deng Howard Leung Naijie Gu Yang Yang 0046 Generalized Model-Based Human Motion Recognition with Body Partition Index Maps. 202-215 2012 31 Comput. Graph. Forum 1 https://doi.org/10.1111/j.1467-8659.2011.02095.x db/journals/cgf/cgf31.html#DengLGY12

Yang Yang 0046 Howard Leung Lihua Yue Liqun Deng Automatic Dance Lesson Generation. 191-198 2012 5 IEEE Trans. Learn. Technol. 3 https://doi.org/10.1109/TLT.2011.31 http://doi.ieeecomputersociety.org/10.1109/TLT.2011.31 db/journals/tlt/tlt5.html#YangLYD12

Liqun Deng Howard Leung Naijie Gu Yang Yang 0046 Real-time mocap dance recognition for an interactive dancing game. 229-237 2011 22 Comput. Animat. Virtual Worlds 2-3 https://doi.org/10.1002/cav.397 db/journals/jvca/jvca22.html#DengLGY11

Liqun Deng Howard Leung Naijie Gu Yang Yang 0046 Recognizing Dance Motions with Segmental SVD. 1537-1540 2010 ICPR https://doi.org/10.1109/ICPR.2010.380 https://doi.ieeecomputersociety.org/10.1109/ICPR.2010.380 conf/icpr/2010 db/conf/icpr/icpr2010.html#DengLGY10 Yang Yang 0046 Howard Leung Lihua Yue Liqun Deng Automatically Constructing a Compact Concept Map of Dance Motion with Motion Captured Data. 329-338 2010 ICWL https://doi.org/10.1007/978-3-642-17407-0_34 conf/icwl/2010 db/conf/icwl/icwl2010.html#YangLYD10 Yang Yang 0046 Howard Leung Lihua Yue Liqun Deng Evaluating Human Motion Complexity Based on Un-Correlation and Non-smoothness. 538-548 2010 PCM (2) https://doi.org/10.1007/978-3-642-15696-0_50 conf/pcm/2010-2 db/conf/pcm/pcm2010-2.html#YangLYD10 Liqun Deng Howard Leung Naijie Gu Yang Yang 0046 Automated Recognition of Sequential Patterns in Captured Motion Streams. 250-261 2010 WAIM https://doi.org/10.1007/978-3-642-14246-8_26 conf/waim/2010 db/conf/waim/waim2010.html#DengLGY10 Junyi Ao Tianyu Bi Can Chen Xiao Chen Xiao Chen 0012 Yingfa Chen Zelin Chen Zhengyang Chen Shengjun Cheng Liang Dai Xinyi Dai Zilin Ding Yonghan Dong Zhenhua Dong Yangkai Du Ruibo Fu Yuhang Gai Tao Gao Meng Ge Naijie Gu Qiang Gu Peng Guo Tianyu Guo 0001 Wei Guo 0006 Yuanyuan Guo Xu Han 0007 Jinzheng He Wei He 0001 Xu He Botian Huang Gang Huang Guowei Huang 0002 Rongjie Huang 0001 Wenyong Huang Yongbing Huang Xin Jiang 0002 Yidi Jiang Hui Jin Da Kuang Tan Lee Howard Leung Binghan Li Dong Li 0016 Haizhou Li 0001 Jinpeng Li 0004 Lin Li Qiang Li 0024 Ruiqi Li Tianshu Li Wei Li 0002 Xiabing Li Yin Li Yue Li Yujun Li Jingru Lin Boxiao Liu Fangcheng Liu Fei Liu Jinglin Liu Qun Liu 0001 Weiwen Liu Wulong Liu Xunying Liu Zhe Liu Zhicheng Liu 0001 Zhiyuan Liu 0001 Yu Luo Yuqi Luo Weikai Mao Helen M. MengHelen Meng Xiaojun Meng Fei Mi Yunsheng Ni Yu Pan Yanmin Qian Jiarui Qin Peifeng Qin Jie Ran Miao Rang Yi Ren 0006 Rongju Ruan Chenyang Song Kaikai Song Maosong Sun 0001 Yusen Sun Daxin Tan Duyu Tang Ruiming Tang Shaohua Tang Yehui Tang Jianhua Tao 0001 Ruijie Tao Ye Tian Yong Tian Zhengkun Tian Dandan Tu Zhipeng Tu Baojun Wang Bin Wang 0004 Bo Wang Disong Wang Shoutong Wang Shuai Wang 0016 Tao Wang 0074 Yaoyuan Wang Yasheng Wang Yufei Wang 0005 Yunhe Wang 0001 Jiansheng Wei Zhengqi Wen Fei Wu 0001 Xueyu Wu Yimeng Wu Chaojun Xiao Longshuai Xiao Baohua Xu Minghui Xu Yan Xu Yong Xu Jiahao Xun Youliang Yan Haoquan Yang Yang Yang 0046 Yanting Yang Dong Yao Yu Ting Yeung Jiangyan Yi Mehmet Sinan Yildirim Yichun Yin Fisher Yu 0003 Tao Yu Xianzhi Yu Lihua Yue Pengyuan Zeng Zongyuan Zhan Changzheng Zhang Lichao Zhang Naifu Zhang Shengyu Zhang 0001 Shuai Zhang 0014 Wenqiao Zhang Yang Zhang Yang Zhang 0025 Zhenhe Zhang Zhiguo Zhang Jun Zhao Zhou Zhao 0001 Nianzu Zheng Hang Zhou Jieming Zhu Yong Zhu Yuzheng Zhuang