Posts
-
Local LLM speed on a Mac: Apple Silicon vs Intel, tokens per second — two weeks on an M1 Max and an Intel i9: ollama against SwiftLM from 4K to 64K tokens of context, Whisper transcription at 33× real time on Apple Silicon, vision models scored for caption speed and quality, and which model fits each amount of memory.