Home » Latest Publications & Patents on Large Language Models (LLM)

Latest Publications & Patents on Large Language Models (LLM)

Carbon Emissions, Generative Design, Generative Pre-trained Transformer (GPT), Large Language Models (LLM), Natural Language Processing (NLP), Sustainability Practices, User Interface (UI)

This is our latest selection of worldwide publications and patents in english on Large Language Models (LLM), between many scientific online journals, classified and focused on large language model, LLM, generative pre-trained transformer, pre-training, transformer architecture, gradient descent, GPT, tokenization, generative model, self-attention mechanism, masked language model and MLM.

Patents: no recent patent on this particular topic. Please try the extensive manual search in the Patents Database linked just above.

Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis

Published on 2024-05-25 by Sohee Yang, Jonghyeon Kim, Joel Jang, Seonghyeon Ye, Hyunji Lee, Minjoon Seo @MIT

Abstract: Previous works in prompt engineering for large language models have introduced different gradient-free probability-based prompt selection methods that aim to choose the optimal prompt among the candidates for a given task but have failed to provide a comprehensive and fair comparison between each other. In this paper, we propose a unified framework to interpret and evaluate the existing probability-based prompt selection methods by performing extensive experiments on 13 common and diverse NLP ta[...]

Our summary: Evaluation of probability-based prompt selection methods through unified framework, Improving prompt selection effectiveness through combinatorial variants of mutual information, Introducing Calibration by Marginalization method for unbiased prompt selection, Achieving high performance in prompt selection without calibration by maximizing mutual information.

prompt selection, probability-based, unified evaluation, analysis, NLP tasks

Publication

Table of Contents

Add a header to begin generating the table of contents

DESIGN or PROJECT CHALLENGE?
Mechanical Engineer, Project or R&D Manager

Available for a new challenge on short notice in France & Swiss.
Contact me on LinkedIn
Plastic & metal products, Design-to-cost, Ergonomics, Medium to high-volume, Regulated industries, CE & FDA, CAD, Solidworks, Lean Sigma Black Belt, medical ISO 13485 Class II & III

We are looking for a new sponsor

Your company or institution is into technique, science or research ?
> send us a message <

Receive all new articles
Free, no spam, email not distributed nor resold

or you can get your full membership -for free- to access all restricted content >here<

Topics covered: Large Language Models, LLM, generative pre-trained transformer, pre-training, transformer architecture, gradient descent, GPT, tokenization, generative model, self-attention mechanism, masked language model, MLM, ISO/IEC 30170, ISO/IEC 27001, ISO/IEC 25000, ISO/IEC 30164, and ISO/IEC 27002..

Kira Moody

Interesting read! But arent we risking a bit by placing so much emphasis on LLMs? Just food for thought.
Faith

Interesting read! But dont you think we should also focus on the ethical implications of these LLM patents? Just food for thought guys!
1. Fabrice
  
  Absolutely! Ethics in LLM patents is a crucial debate we often overlook. Thanks for bringing it up!