why does chat-13B endless self talking #1475
-
|
After I ask him a long question in Chinese, he began talking to himself endless. Have you ever met the same thing? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
It happens sometimes, you can try a lower temperature like 0.1 |
Beta Was this translation helpful? Give feedback.
-
|
My bot did the exact same thing with 13B. Asked it "How old is your model" and it just spat out nonstop self-conversations (Not to mention, didn't reply with "Bot:" for the prompt like I set, which does work for 30B). I even had it switch languages randomly at one point to Korean - didn't know what the hell was going on. Tried to lower the temperature from 0.7 to 0.1, didn't change a thing. Any other settings that can be lowered? Or maybe it's just the model? Using
|
Beta Was this translation helpful? Give feedback.
It happens sometimes, you can try a lower temperature like 0.1