Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting.

Huaixiu Steven Zheng Zilong Wang 0002 Zifeng Wang 0002 Long T. Le Huaixiu Steven Zheng Swaroop Mishra Vincent Perot Yuwei Zhang 0001 Anush Mattapalli Ankur Taly Jingbo Shang Chen-Yu Lee Tomas Pfister Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting. 2025 ICLR https://openreview.net/forum?id=xgQfWbV6Ey conf/iclr/2025 db/conf/iclr/iclr2025.html#00020LZMP0MTSLP25 Jie Huang 0009 Xinyun Chen Swaroop Mishra Huaixiu Steven Zheng Adams Wei Yu Xinying Song Denny Zhou Large Language Models Cannot Self-Correct Reasoning Yet. 2024 ICLR https://openreview.net/forum?id=IkmD3fKBPQ conf/iclr/2024 db/conf/iclr/iclr2024.html#0009CMZYSZ24 Huaixiu Steven Zheng Swaroop Mishra Xinyun Chen Heng-Tze Cheng Ed H. Chi Quoc V. Le Denny Zhou Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models. 2024 ICLR https://openreview.net/forum?id=3bq3jsvcQ1 conf/iclr/2024 db/conf/iclr/iclr2024.html#ZhengMCCCLZ24 Pei Zhou Jay Pujara Xiang Ren 0001 Xinyun Chen Heng-Tze Cheng Quoc V. Le Ed H. Chi Denny Zhou Swaroop Mishra Huaixiu Steven Zheng SELF-DISCOVER: Large Language Models Self-Compose Reasoning Structures. 2024 NeurIPS http://papers.nips.cc/paper_files/paper/2024/hash/e41efb03e20ca3c231940a3c6917ef6f-Abstract-Conference.html conf/nips/2024 db/conf/nips/neurips2024.html#ZhouP0CCLCZMZ24

Pei Zhou Jay Pujara Xiang Ren 0001 Xinyun Chen Heng-Tze Cheng Quoc V. Le Ed H. Chi Denny Zhou Swaroop Mishra Huaixiu Steven Zheng Self-Discover: Large Language Models Self-Compose Reasoning Structures. 2024 abs/2402.03620 CoRR https://doi.org/10.48550/arXiv.2402.03620 db/journals/corr/corr2402.html#abs-2402-03620

Huaixiu Steven Zheng Swaroop Mishra Hugh Zhang Xinyun Chen Minmin Chen Azade Nova Le Hou Heng-Tze Cheng Quoc V. Le Ed H. Chi Denny Zhou NATURAL PLAN: Benchmarking LLMs on Natural Language Planning. 2024 abs/2406.04520 CoRR https://doi.org/10.48550/arXiv.2406.04520 db/journals/corr/corr2406.html#abs-2406-04520

Zilong Wang 0002 Zifeng Wang 0002 Long T. Le Huaixiu Steven Zheng Swaroop Mishra Vincent Perot Yuwei Zhang 0001 Anush Mattapalli Ankur Taly Jingbo Shang Chen-Yu Lee Tomas Pfister Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting. 2024 abs/2407.08223 CoRR https://doi.org/10.48550/arXiv.2407.08223 db/journals/corr/corr2407.html#abs-2407-08223 streams/journals/corr

Yi Tay Jason Wei Hyung Won Chung Vinh Q. Tran 0002 David R. So Siamak Shakeri Xavier Garcia Huaixiu Steven Zheng Jinfeng Rao Aakanksha Chowdhery Denny Zhou Donald Metzler Slav Petrov Neil Houlsby Quoc V. Le Mostafa Dehghani 0001 Transcending Scaling Laws with 0.1% Extra Compute. 1471-1486 2023 EMNLP https://doi.org/10.18653/v1/2023.emnlp-main.91 https://aclanthology.org/2023.emnlp-main.91 conf/emnlp/2023 db/conf/emnlp/emnlp2023.html#TayWC0SSGZRCZMP23 Yi Tay Mostafa Dehghani 0001 Vinh Q. Tran 0002 Xavier Garcia Jason Wei Xuezhi Wang 0002 Hyung Won Chung Dara Bahri Tal Schuster Huaixiu Steven Zheng Denny Zhou Neil Houlsby Donald Metzler UL2: Unifying Language Learning Paradigms. 2023 ICLR https://openreview.net/forum?id=6ruVLB727MC conf/iclr/2023 db/conf/iclr/iclr2023.html#Tay00GW0CBSZZHM23

Jie Huang 0009 Xinyun Chen Swaroop Mishra Huaixiu Steven Zheng Adams Wei Yu Xinying Song Denny Zhou Large Language Models Cannot Self-Correct Reasoning Yet. 2023 abs/2310.01798 CoRR https://doi.org/10.48550/arXiv.2310.01798 db/journals/corr/corr2310.html#abs-2310-01798

Huaixiu Steven Zheng Swaroop Mishra Xinyun Chen Heng-Tze Cheng Ed H. Chi Quoc V. Le Denny Zhou Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models. 2023 abs/2310.06117 CoRR https://doi.org/10.48550/arXiv.2310.06117 db/journals/corr/corr2310.html#abs-2310-06117

Vamsi Aribandi Yi Tay Tal Schuster Jinfeng Rao Huaixiu Steven Zheng Sanket Vaibhav Mehta Honglei Zhuang Vinh Q. Tran 0002 Dara Bahri Jianmo Ni Jai Prakash Gupta 0001 Kai Hui 0001 Sebastian Ruder Donald Metzler ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. 2022 ICLR https://openreview.net/forum?id=Vzh1BFUCiIX conf/iclr/2022 db/conf/iclr/iclr2022.html#AribandiTSRZMZ022 Yun He Huaixiu Steven Zheng Yi Tay Jai Prakash Gupta 0001 Yu Du Vamsi Aribandi Zhe Zhao 0001 YaGuang Li Zhao Chen Donald Metzler Heng-Tze Cheng Ed H. Chi HyperPrompt: Prompt-based Task-Conditioning of Transformers. 8678-8690 2022 ICML https://proceedings.mlr.press/v162/he22f.html conf/icml/2022 db/conf/icml/icml2022.html#HeZTGDAZLCMCC22

Romal Thoppilan Daniel De Freitas Jamie Hall Noam Shazeer Apoorv Kulshreshtha Heng-Tze Cheng Alicia Jin Taylor Bos Leslie Baker Yu Du YaGuang Li Hongrae Lee Huaixiu Steven Zheng Amin Ghafouri Marcelo Menegali Yanping Huang Maxim Krikun Dmitry Lepikhin James Qin Dehao Chen Yuanzhong Xu Zhifeng Chen Adam Roberts Maarten Bosma Yanqi Zhou Chung-Ching Chang Igor Krivokon Will Rusch Marc Pickett Kathleen S. Meier-Hellstern Meredith Ringel Morris Tulsee Doshi Renelito Delos Santos Toju Duke Johnny Soraker Ben Zevenbergen Vinodkumar Prabhakaran Mark Diaz Ben Hutchinson Kristen Olson Alejandra Molina Erin Hoffman-John Josh Lee Lora Aroyo Ravi Rajakumar Alena Butryna Matthew Lamm Viktoriya Kuzmina Joe Fenton Aaron Cohen Rachel Bernstein Ray Kurzweil Blaise Agüera y Arcas Claire Cui Marian Croak Ed H. Chi Quoc Le 0001 LaMDA: Language Models for Dialog Applications. 2022 abs/2201.08239 CoRR https://arxiv.org/abs/2201.08239 db/journals/corr/corr2201.html#abs-2201-08239

Yun He Huaixiu Steven Zheng Yi Tay Jai Prakash Gupta 0001 Yu Du Vamsi Aribandi Zhe Zhao 0001 YaGuang Li Zhao Chen Donald Metzler Heng-Tze Cheng Ed H. Chi HyperPrompt: Prompt-based Task-Conditioning of Transformers. 2022 abs/2203.00759 CoRR https://doi.org/10.48550/arXiv.2203.00759 db/journals/corr/corr2203.html#abs-2203-00759

Yi Tay Mostafa Dehghani 0001 Vinh Q. Tran 0002 Xavier Garcia Dara Bahri Tal Schuster Huaixiu Steven Zheng Neil Houlsby Donald Metzler Unifying Language Learning Paradigms. 2022 abs/2205.05131 CoRR https://doi.org/10.48550/arXiv.2205.05131 https://www.wikidata.org/entity/Q112075092 db/journals/corr/corr2205.html#abs-2205-05131

Blaise Agüera y Arcas Vamsi Aribandi Lora Aroyo Dara Bahri Leslie Baker Rachel Bernstein Taylor Bos Maarten Bosma Alena Butryna Chung-Ching Chang Dehao Chen Minmin Chen Xinyun Chen Zhao Chen Zhifeng Chen Heng-Tze Cheng Ed H. Chi Aakanksha Chowdhery Hyung Won Chung Aaron Cohen Marian Croak Claire Cui Mostafa Dehghani 0001 Mark Diaz Tulsee Doshi Yu Du Toju Duke Joe Fenton Daniel De Freitas Xavier Garcia Amin Ghafouri Jai Gupta 0001Jai Prakash Gupta 0001 Jamie Hall Yun He Erin Hoffman-John Le Hou Neil Houlsby Jie Huang 0009 Yanping Huang Kai Hui 0001 Ben Hutchinson Alicia Jin Maxim Krikun Igor Krivokon Apoorv Kulshreshtha Raymond KurzweilRay Kurzweil Viktoriya Kuzmina Matthew Lamm Long T. Le Quoc V. LeQuoc Le 0001 Chen-Yu Lee Hongrae Lee Josh Lee Dmitry Lepikhin YaGuang Li Anush Mattapalli Sanket Vaibhav Mehta Kathy Meier-HellsternKathleen S. Meier-Hellstern Marcelo Menegali Donald Metzler Swaroop Mishra Alejandra Molina Meredith Ringel Morris Jianmo Ni Azade Nova Kristen Olson Vincent Perot Slav Petrov Tomas Pfister Marc Pickett Vinodkumar Prabhakaran Jay Pujara James Qin Ravi Rajakumar Jinfeng Rao Xiang Ren 0001 Adam Roberts Sebastian Ruder Will Rusch Renelito Delos Santos Tal Schuster Siamak Shakeri Jingbo Shang Noam Shazeer David R. So Xinying Song Johnny Soraker Ankur Taly Yi Tay Romal Thoppilan Vinh Q. Tran 0002 Xuezhi Wang 0002 Zifeng Wang 0002 Zilong Wang 0002 Jason Wei Yuanzhong Xu Adams Wei Yu Bendert ZevenbergenBen Zevenbergen Hugh Zhang Yuwei Zhang 0001 Zhe Zhao 0001 Denny Zhou Pei Zhou Yanqi Zhou Honglei Zhuang