Nearest Neighbor Speculative Decoding for LLM Generation and Attribution

TitleNearest Neighbor Speculative Decoding for LLM Generation and Attribution
Publication TypeJournal Article
Year of Publication2024
AuthorsLi, M., X. Chen, A. Holtzman, B. Chen, J. Lin, W-tau. Yih, and X. Victoria Lin
JournalArXiv
Volumeabs/2405.19325
DOI10.48550/ARXIV.2405.19325