🧠 Someone Asked Me to Add a 975B Model to a LocaLLMs, here's Why we Can't (Yet)
⚠️ This blog post was created with the help of AI tools. The geeky fun and the 🤖 in C# are 100% mine. TL;DR Someone asked me to add Inkling — Thinking Machines’ shiny new open-weights model — to ElBruno.LocalLLMs. I did the evaluation, and the answer is: not for now. 🔴 Inkling is a 975B-parameter, Mixture-of-Experts, multimodal (text + image + audio) model. My library runs local LLMs in .NET…
View On WordPress













