how to use h2oai/h2ogpt-4096-llama2-13b-chat for custom use case.

5urabhi

On using the web client h2oai gpt(h2oai/h2ogpt-4096-llama2-13b-chat) I am getting the correct response however the same prompt is not working with the downloaded transformers (h2oai/h2ogpt-4096-llama2-13b-chat) for the same model. It worked for first 3-4 times then it started generating random text generation.

elastyc

Hi. Have you figured this out? I am running into the exact same issue and don't know how to fix.