Discussion about this post

User's avatar
ToxSec's avatar

"Three days of migration. A few hundred dollars for the Mac Mini. Several late-night debugging sessions.

Absolutely worth it."

Hell yeah! this was an awesome read. Really glad to hear about your experience here.

Michael's avatar

Dev versus prod hell in a nutshell - nice read.

I have a Mac Studio and can run local models. I wouldn't get super excited about them - yes, they are "Free" but you pay for that with quality. You need very specialized use cases to make the "Free" worth it. You don't have to guess though - you can test them on OpenRouter.ai and compare against frontier models. If the math works out that the local models you can run on a 96GB or 256GB Mac Studio (the 512GB is no longer available) are cheaper than frontier, easy decision.

For me, it definitely wasn't.

4 more comments...

No posts

Ready for more?