Every Mac with Apple Silicon has a built-in LLM. Apple locked it behind Siri. apfel sets it free - as a CLI tool, an OpenAI-compatible server, and a chat.

Benötigt macOS Tahoe auf einem Mac mit M1 oder neuer.

    • connaisseur@feddit.orgOP
      link
      fedilink
      arrow-up
      4
      ·
      7 天前

      There are much more powerful models for sure, this tool just taps into the convenience of using what is already on the device thanks to Apple frameworks. So it is fully local with no additional overhead.