The head of IT at my org is dying on this hill. He says specialized models with proper routing can outperform the big boys. … I really want him to be right, but I don’t believe it. I work with both. The 27B models are like working with ChatGPT on release day.
Well of course they outperform them if they’re specialized to a purpose… Theres a like 3B model that plays Minecraft and generally kicks the ass of all the more general llms
And in general, the big models are primarily better at remembering instructions and context… An 8B model can hold a basic conversation or perform simple tasks on a similar level to a frontier model
Really, really depends on what they’re specialized to do though
2 months until China drops a better one for free
Chinese models are typically only cheaper than models from western labs, not higher performance. Which is better in one aspect, but not the other
And it runs locally
(on 1TB memory)
27B ;)
or lower depends on your ram
Yeah but not comparable to a frontier model
The head of IT at my org is dying on this hill. He says specialized models with proper routing can outperform the big boys. … I really want him to be right, but I don’t believe it. I work with both. The 27B models are like working with ChatGPT on release day.
Well of course they outperform them if they’re specialized to a purpose… Theres a like 3B model that plays Minecraft and generally kicks the ass of all the more general llms
And in general, the big models are primarily better at remembering instructions and context… An 8B model can hold a basic conversation or perform simple tasks on a similar level to a frontier model
Really, really depends on what they’re specialized to do though
better then nothing i guess,but yeah true
I mean 27b models are practically speaking useless at anything but turning your computer into a space heater, in my experience, but yeah
Qwen 3.8 27B is very good at agentic work
atleast they are kinda decent
I made the aqwentance of this one already. The new one is particularly good.
i didnt test the 27B models cause of my RAM/VRAM,but they sound decent.