SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 14 hours agoDo you host your own AI?message-squaremessage-square134linkfedilinkarrow-up1100arrow-down125file-text
arrow-up175arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 14 hours agomessage-square134linkfedilinkfile-text
minus-squarealexcleac@szmer.infolinkfedilinkEnglisharrow-up1·3 hours agoI’ve been running ministral on CPU on a home-server: works pretty nicely, not very performant for everyday tasks and the savings were not sufficient for it to make sense. It still was cheaper and faster to just use Mistral API and get better models.
I’ve been running ministral on CPU on a home-server: works pretty nicely, not very performant for everyday tasks and the savings were not sufficient for it to make sense. It still was cheaper and faster to just use Mistral API and get better models.