Prompt Tuning For Large Language Models With Inference
Introduction Prompt tuning is a technique that uses frozen pre-trained language models to downstream tasks that minimize per-task storage and memory usage during the training phase and this is useful for Large Language Models (LLMs) such as GPT2, T5, GPT-J, GPT-NEO, GPT-NEOX, GPT-20B, GPT3, etc where the model is so large that fine-tuning becomes difficult […]