how to use h2oai/h2ogpt-4096-llama2-13b-chat for custom use case.
Options
5urabhi
Member Posts: 1
On using the web client h2oai gpt(h2oai/h2ogpt-4096-llama2-13b-chat) I am getting the correct response however the same prompt is not working with the downloaded transformers (h2oai/h2ogpt-4096-llama2-13b-chat) for the same model. It worked for first 3-4 times then it started generating random text generation.
Answers
-
Hi. Have you figured this out? I am running into the exact same issue and don't know how to fix.
-
Please ask your h2oGPT question on the H2O Discord
https://discord.gg/generative-h2o-ai-community-1097462770674438174