Downloaded mistral small 24b 2501 and it's just broken
-
fuutott11 last edited by
Downloaded mistral small 24b 2501 and it's just broken.
It runs and loads but half tokens are missing in response.I run the same model in lm studio and it's all ok.
Also most of the local models are not downloadable...
-
fuutott11 last edited by
LM studio on the left, Opera local model on the right.
both mistral small 24-b instruct 2501@q4_k_m
I'm testing 2501 as it's one of the models that did actually download without error from available opera local models.
Yeah I've got them both loaded but makes no difference if it's the only model loaded too.
