Testing Apple's On-Device LLM: What apfel Gets Right (And Where It Falls Apart)

Thu, 09 Apr 2026 00:00:00 +0000

Apple’s Foundation Models framework ships with macOS 26+, silently powering Apple Intelligence features. But what if you want to use it directly? Not through Siri. Not through Writing Tools. Through an API you control.

apfel is an open-source OpenAI-compatible server that exposes Apple’s on-device LLM to any HTTP client. No API keys. No usage limits. No network calls. Just a local server running on your Mac.

I spent a week testing it. Fifteen distinct tasks. Every supported parameter. Real latency measurements.

Local-Llm on Digitaliziran si

Testing Apple's On-Device LLM: What apfel Gets Right (And Where It Falls Apart)