Skip to content

Latest commit

 

History

History
30 lines (16 loc) · 1.26 KB

instruction-tuning.md

File metadata and controls

30 lines (16 loc) · 1.26 KB
Raw

Instruction-Tuning

Papers

2021

  • (2021-04) Cross-task generalization via natural language crowdsourcing instructions. paper

  • (2021-04) Adapting language models for zero-shot learning by meta-tuning on dataset and prompt collections paper

  • (2021-04) Crossfit: A few-shot learning challenge for cross-task general- ization in NLP paper

  • (2021-09) Finetuned language models are zero-shot learners paper

    FLAN

  • (2021-10) Multitask prompted training enables zero-shot task generalization paper

  • (2021-10) MetaICL: Learning to learn in context paper

2022

  • (2022-03) Training language models to follow instructions with human feedback. paper

  • (2022-04) Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks paper

  • (20220-10) Scaling Instruction-Finetuned Language Models paper

    Flan-T5/PaLM

Useful Resources