这是我们最新精选的有关大型语言模型（LLM）的全球英文出版物和专利，涉及众多科学在线期刊，分类并侧重于大型语言模型、LLM、生成式预训练变换器、预训练、变换器架构、梯度下降、GPT、标记化、生成式模型、自我注意机制、屏蔽语言模型和 MLM。
专利： 最近没有 专利权 有关这一特定主题的信息。请尝试在上面链接的专利数据库中进行广泛的人工搜索。
Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis
Published on 2024-05-25 by Sohee Yang, Jonghyeon Kim, Joel Jang, Seonghyeon Ye, Hyunji Lee, Minjoon Seo @MIT
Abstract: Previous works in prompt engineering for large language models have introduced different gradient-free probability-based prompt selection methods that aim to choose the optimal prompt among the candidates for a given task but have failed to provide a comprehensive and fair comparison between each other. In this paper, we propose a unified framework to interpret and evaluate the existing probability-based prompt selection methods by performing extensive experiments on 13 common and diverse NLP ta[...]
Our summary: Evaluation of probability-based prompt selection methods through unified framework, Improving prompt selection effectiveness through combinatorial variants of mutual information, Introducing Calibration by Marginalization method for unbiased prompt selection, Achieving high performance in prompt selection without calibration by maximizing mutual information.
prompt selection, probability-based, unified evaluation, analysis, NLP tasks
Publication
