Prompting

Prompting

Prompt Format

Most instruct/chat fine tunes use their own formatting (which can wildly differ). These can usually be dug out of model card/repos/localllama discussion/discords, but the best single reference I've found is oobabooga's Instruction Templates:

If using HF, see also the documentation on chat templating


Revision #2
Created 11 September 2023 16:56:55 by lhl
Updated 2 November 2023 00:41:50 by lhl