Of course, and this is why the new hotness is a Mixture of Experts for one model that is effectively a bunch of experts arguing over the answer, or else on a different scale there’s the Combination of Agents where different specialized agents perform specialized tasks.
I wonder if a good fine tuned model beats every general purpose LLM if you need it for a really specific purpose
Yes it does
Of course, and this is why the new hotness is a Mixture of Experts for one model that is effectively a bunch of experts arguing over the answer, or else on a different scale there’s the Combination of Agents where different specialized agents perform specialized tasks.
There is new project which they share fine-tuned modernbert on some task. Here is the org https://huggingface.co/adaptive-classifier