The chatbot still remains the most popular AI assistant worldwide with over 1.1 billion monthly users, followed by Gemini with 662 million and Claude with 245 million.
Maybe, but Mistral is a commercial company that offers commercial products that can’t really compete with OpenAI, Anthropic, and the others. That’s what I meant.
I’m curious as to why you say that? I use Le Chat and to me it feels exactly like ChatGPT or Claude, it can code well, translate, search online, everything.
Personally I really struggle with it. I wanna use it because it’s not from a US company, but it’s just wrong in like 60% of whatever I ask it. Sometimes even when corrected. It’s good though, makes me stop using the clanker and actually search for myself. Sometimes I do resort to ChatGPT or accidentally invoke Gemini when searching though, and those two have a way higher hit rate
Subjectively, it feels similar to models we used a year or two ago. Not that drastically different from what Anthropic and OpenAI offer today, but slightly worse. For instance, for complex coding tasks it offers basic solutions, while Claude often offers more options and details - as if it knows more.
Objectively, benchmarks. Mistral looks comparable to other open weight models (as another user mentioned), but not as good otherwise.
I see, that’s about the time they all got so good that I stopped trying to keep up with the latest benchmarks. It works perfectly for my needs so I definitely wouldn’t dismiss it for anyone wanting to switch to a European alternative.
Mistral has recently shown a good trajectory of improvement. It is already an important thing that there is a European mid range open weight model that can compete. (Frontier models need a lot more resources, it is important to compare apples with apples) This is good enough for many applications were data security and sovereignity are prime concerns. Of course, it would be good to have a frontier model, lets see how Large 4 will perform when we get there.
Maybe, but Mistral is a commercial company that offers commercial products that can’t really compete with OpenAI, Anthropic, and the others. That’s what I meant.
I’m curious as to why you say that? I use Le Chat and to me it feels exactly like ChatGPT or Claude, it can code well, translate, search online, everything.
Personally I really struggle with it. I wanna use it because it’s not from a US company, but it’s just wrong in like 60% of whatever I ask it. Sometimes even when corrected. It’s good though, makes me stop using the clanker and actually search for myself. Sometimes I do resort to ChatGPT or accidentally invoke Gemini when searching though, and those two have a way higher hit rate
Subjectively, it feels similar to models we used a year or two ago. Not that drastically different from what Anthropic and OpenAI offer today, but slightly worse. For instance, for complex coding tasks it offers basic solutions, while Claude often offers more options and details - as if it knows more.
Objectively, benchmarks. Mistral looks comparable to other open weight models (as another user mentioned), but not as good otherwise.
With the results of chat out of the box I kind of agree with you that mistral feels behind.
However, there are some features that I really like and make the experience even better than chatgpt.
(I have never tried the paid version of any LLM chat so I can only compare free tiers)
I see, that’s about the time they all got so good that I stopped trying to keep up with the latest benchmarks. It works perfectly for my needs so I definitely wouldn’t dismiss it for anyone wanting to switch to a European alternative.
Sure, totally depends on your needs. But it’d be great if we had one of them frontier models in Europe.
Mistral has recently shown a good trajectory of improvement. It is already an important thing that there is a European mid range open weight model that can compete. (Frontier models need a lot more resources, it is important to compare apples with apples) This is good enough for many applications were data security and sovereignity are prime concerns. Of course, it would be good to have a frontier model, lets see how Large 4 will perform when we get there.