Prompt Format Llama 2

[schacki]

I have been using autogan with LM Studio and Lllama 2 models. Unfortunately, the results are poor; e.g. the group chat manager is not able to decide on the next speaker.

So I am wondering, if it is an issue with the prompt format, after reading this post: https://replicate.com/blog/how-to-prompt-llama#how-to-format-prompts-in-production

So my general question is, do i need to adapt the prompt for Llama 2 models. And if so, how would i do that?

[rickyloynd-microsoft]

Reliable group chats usually depend on gpt-4 today.

[schacki]

That might be true, but still does not answer the question, if and how the prompt should be adapted.

[rickyloynd-microsoft]

Yes, and your question about better prompt writing and formatting is the more interesting research question. There's a fair amount of discussion about it on our Discord channel.