{"@context":"https://schema.org","@type":"NewsArticle","generatedAt":"2026-09-22T01:01:24.779Z","headline":"在 M4 Pro Mac mini 上搭建本地 LLM 环境的完整方案","description":"作者分享在 48GB 内存 M4 Pro Mac mini 上运行本地 LLM 的完整方案，主模型为 Qwen3.6-35B-A3B-OptiQ-4bit（约占用 20GB 内存），轻量模型为 Gemma-4-E4B，推理服务用 oMLX，通过 Tailscale 让 iPhone、MacBook 共用同一后端，并接入 Hermes、Pi、Apollo 和 Raycast。","url":"https://www.aioga.com/news/cmtjlldks0381rori2d5pzkbw/","mainEntityOfPage":"https://www.aioga.com/news/cmtjlldks0381rori2d5pzkbw/","datePublished":"2026-09-02T04:17:22.000Z","dateModified":"2026-09-02T04:17:22.000Z","inLanguage":"zh-CN","publisher":{"@type":"NewsMediaOrganization","name":"Aioga","url":"https://www.aioga.com"},"citation":["https://lws.io/blog/my-local-model-setup","https://aihot.virxact.com/items/cmtjlldks0381rori2d5pzkbw"],"canonicalUrl":"https://www.aioga.com/news/cmtjlldks0381rori2d5pzkbw/","directAnswer":{"@type":"Answer","text":"作者介绍了一套运行在 48GB 内存 M4 Pro Mac mini 上的本地 LLM 环境，主模型为 Qwen3.6-35B-A3B-OptiQ-4bit，轻量模型为 Gemma-4-E4B，推理服务使用 oMLX，并通过 Tailscale 连接 iPhone 与 MacBook。","url":"https://www.aioga.com/news/cmtjlldks0381rori2d5pzkbw/","dateCreated":"2026-09-02T04:17:22.000Z","author":{"@type":"Organization","@id":"https://www.aioga.com/authors/aioga-editorial/#editorial-team","name":"Aioga Editorial Team","url":"https://www.aioga.com/authors/aioga-editorial/"}},"evidence":[{"@type":"CreativeWork","name":"lws.io source article","url":"https://lws.io/blog/my-local-model-setup","datePublished":"2026-09-02T04:17:22.000Z","provider":{"@type":"Organization","name":"lws.io","url":"https://lws.io/blog/my-local-model-setup"}},{"@type":"CreativeWork","name":"AIHot archive record","url":"https://aihot.virxact.com/items/cmtjlldks0381rori2d5pzkbw","datePublished":"2026-09-02T04:17:22.000Z","provider":{"@type":"Organization","name":"AIHot","url":"https://aihot.virxact.com/items/cmtjlldks0381rori2d5pzkbw"}}],"aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","originalPublisher":{"name":"lws.io","url":"https://lws.io/blog/my-local-model-setup"},"geoDeepAnswer":null,"article":{"id":"cmtjlldks0381rori2d5pzkbw","slug":"cmtjlldks0381rori2d5pzkbw","url":"https://www.aioga.com/news/cmtjlldks0381rori2d5pzkbw/","title":"在 M4 Pro Mac mini 上搭建本地 LLM 环境的完整方案","title_en":"","summary":"作者分享在 48GB 内存 M4 Pro Mac mini 上运行本地 LLM 的完整方案，主模型为 Qwen3.6-35B-A3B-OptiQ-4bit（约占用 20GB 内存），轻量模型为 Gemma-4-E4B，推理服务用 oMLX，通过 Tailscale 让 iPhone、MacBook 共用同一后端，并接入 Hermes、Pi、Apollo 和 Raycast。","source":"Hacker News 热门（buzzing.cc 中文翻译）","sourceUrl":"https://lws.io/blog/my-local-model-setup","aiHotUrl":"https://aihot.virxact.com/items/cmtjlldks0381rori2d5pzkbw","publishedAt":"2026-09-02T04:17:22.000Z","category":"行业动态","score":58,"selected":false,"articleBody":["I run a local LLM server on my M4 Pro Mac mini with 48 GB of RAM. It handles everything from my Hermes agent backend to quick chat queries on my phone. The whole thing takes about 30 minutes to set up.","Hermes runs as the agent backend on the Mac mini, with my MacBook running the desktop client and my phone running Telegram. For non-Hermes usage I use Apollo on iOS for quick chats (reads like Claude, good for throwaway questions), Pi as my coding agent (I already wrote about that setup：https://lws.io/blog/pi-harness-cold-start/), and Raycast AI on my Mac for random things.","The main reason to run local: cloud APIs are rented land. They can change their pricing, hit your usage limits, or swap the model being served behind the scenes whenever they feel like it. I was regularly maxing out two $200/month subscriptions and it felt like I was getting different things from them at different points. Sometimes a model was fine, sometimes it degraded with no notice.","Then there is AI sovereignty. I have been watching how the US government has limited the rollout of various models. That can happen at any point from any government, for any reason, and you have no control over it. If your workflow depends on a cloud model that gets restricted, you have to stop or scramble. The only way to avoid that is to own your compute.","The Mac mini is always on. It sits on my desk and I barely notice it except when I need it.","Hermes runs on the Mac mini as well, using a local model on the same machine. I access my agent through Telegram (on my phone) and the Hermes desktop app on my MacBook. The Hermes desktop app acts as a ‘shell’ and connects to a Hermes backend on another device (in this case the Mac mini). This means I share a backend, conversation history, and skillset across all my devices.","The point is not to replace API-based models. It is to handle the 80% of requests that do not need GPT-5 or Claude Opus. And when I do need those, they are already available. Local just covers more of my day-to-day for free.","Running a large model locally comes down to one thing: how much RAM it actually needs in memory. Most people look at the parameter count and get the wrong idea, because the difference between dense and mixture-of-experts (MoE) models matters a lot on consumer hardware.","Here is how to read the identifier:","The key difference is the A3B part. A dense 27B model has 27 billion parameters loaded in RAM at all times, for every single token. An MoE model like the Qwen3.6-35B-A3B has 35 billion total parameters spread across 256 experts, but only about 3 billion are actually activated per token. The other 32 billion sit in RAM doing nothing.","On my 48GB Mac mini, the Qwen3.6-35B-A3B in 4-bit takes about 20GB of RAM. That leaves 28GB for context windows, the operating system, and everything else running on the machine. The Gemma-4-E4B is roughly 2.4GB. Small enough to keep around for simple tasks where using the full 20GB model is overkill.","My friend’s MacBook Air had 16GB total. A dense 27B in 4-bit needs roughly 14GB. That is literally everything the machine has, minus room for the OS. So it works for a moment, and then when it does not, it swaps to SSD and becomes painful.","MoE changes this. The 35B model in my identifier would fit on the same MacBook because only 3B of weights are actually active per token, which means the GPU/Media Memory footprint is more like what a 6B dense model would need. The 35 billion total parameter weights all sit in unified memory.","How to check if a model will work on your hardware:","This is the part nobody talks about. You can swap out your local models every few weeks as new ones drop. It is literally a download and a restart.","The oMLX admin dashboard has a built-in HuggingFace model browser. Find a model, click download. Change the model in Hermes, Pi, Raycast, and Apollo, and I am all done.","A lot of this can be done via CLI too, so I can SSH into the Mac mini from any of my devices.","Why this matters: the gap between local models and API models is closing fast. What was “meh” quality a year ago is competitive for most real-world tasks now. Coding, reasoning, tool use are where it matters. And the 4-bit quantization from OptiQ keeps quality surprisingly high. The 35B-A3B at 4-bit only loses about 1-2 points on most benchmarks compared to BF16 (16-bit floating point, the uncompressed baseline). That is an acceptable tradeoff for 48GB of memory usage instead of 70.","Tailscale creates a mesh between all my devices. Mac mini, iPhone, MacBook, all on the same private network. Nothing exposed to the public internet.","The oMLX server listens on port 8000. Any device on the tailnet can connect. Raycast, Apollo iOS, Hermes desktop on my MacBook, they all hit the same endpoint. No configuration drift between devices.","oMLX’s KV cache persistence also matters on the tailnet setup. Coding agents repeatedly circle back through earlier context in a session. oMLX caches each block to SSD, so when the agent returns to a previous prefix, it is restored from disk in milliseconds instead of being recomputed. That makes the local setup actually practical for agent work, which is where Hermes lives.","Local models on Apple Silicon are not a side experiment anymore. The M4 Pro Mac mini handles it without breaking a sweat, the models are good enough for most tasks, and you can swap them out whenever you want. You are not paying per token. You are not routing sensitive data through third-party endpoints. And when a better model drops next week, you can try it with barely any effort for the cost of some hard drive space.","I have already ordered a 128GB M5 Max Mac Studio to be delivered later this year, but I am incredibly happy with the performance of this M4 Pro Mac mini so far. If you have other Apple Silicon devices, try it out - you may need to change the model based on your specs, but the general setup holds."],"articleImages":[],"mediaStatus":"none","articleBodyZh":["我在我的 M4 Pro Mac mini 上运行本地 LLM 服务器，配备 48 GB 内存。它处理从我的 Hermes 代理后台到手机上的快速聊天查询的一切。整个设置大约需要 30 分钟。","Hermes 作为 Mac mini 上的代理后台运行，我的 MacBook 运行桌面客户端，手机运行 Telegram。对于非 Hermes 的使用，我在 iOS 上使用 Apollo 进行快速聊天（类似 Claude，适合随问随答的问题），Pi 作为我的编程代理（我已经写过这个设置：https://lws.io/blog/pi-harness-cold-start/），以及在我的 Mac 上使用 Raycast AI 来处理随机的事情。","运行本地的主要原因：云 API 是租用的土地。它们可以修改价格、达到你的使用限制，或者在任何时候在后台更换所提供的模型。我经常用尽两个每月 200 美元的订阅，而且感觉在不同时间得到的东西也不同。有时候一个模型很好，有时候它会在没有通知的情况下退化。","还有 AI 主权。我一直在关注美国政府如何限制各种模型的推广。政府可以在任何时候、出于任何原因进行这种限制，而你无法控制。如果你的工作流程依赖于受到限制的云模型，你就必须停止或临时应对。避免这种情况的唯一方法是拥有自己的计算能力。","Mac mini 一直开着。它放在我的桌子上，除了我需要使用它时，我几乎不会注意到它。","Hermes 也运行在 Mac mini 上，使用同一台机器上的本地模型。我通过 Telegram（在手机上）和 MacBook 上的 Hermes 桌面应用访问我的代理。Hermes 桌面应用充当一个‘外壳’，连接到另一台设备上的 Hermes 后台（本例为 Mac mini）。这意味着我可以在所有设备间共享后台、对话历史和技能集。","重点不是替代基于 API 的模型。而是处理 80% 不需要 GPT-5 或 Claude Opus 的请求。当我确实需要这些模型时，它们已经可用。本地模型只是覆盖更多我日常使用的部分，且是免费的。","本地运行大型模型归结为一个问题：它实际在内存中需要多少 RAM。大多数人只看参数数量就会产生误解，因为稠密模型和专家混合（MoE）模型在消费级硬件上的差别非常大。","以下是读取该标识符的方法：","关键区别在于A3B部分。一个密集的27B模型，每个令牌都被加载在RAM中，始终有270亿个参数。像Qwen3.6-35B-A3B这样的MoE模型，总共有350亿个参数，分布在256位专家身上，但每个令牌实际激活的只有大约30亿个。另外320亿个则放在RAM中，什么都不做。","在我的48GB Mac mini上，Qwen3.6-35B-A3B的4位内存大约占用20GB。剩下的28GB用于上下文Windows、操作系统以及机器上运行的其他所有设备。Gemma-4-E4B大约是2.4GB。体积小，可以保留用于简单任务，而使用完整的20GB版本则显得过于繁琐。","我朋友的MacBook Air总共有16GB。4位密集的27B大约需要14GB。这几乎是机器所有的容量，除了操作系统空间。所以它能用一会儿，然后不行就切换到SSD变得很痛苦。","MoE改变了这一点。我标识符中的35B模型可以装在同一台MacBook上，因为每个令牌实际上只有3B的权重是激活的，这意味着GPU/媒体内存占用更接近6B密度模型所需的容量。350亿个总参数权重都放在统一内存中。","如何检查某个型号是否能在你的硬件上运行：","这是没人提的部分。你可以每隔几周更换一次本地模型，因为有新模型发布。这实际上就是下载和重启。","oMLX管理仪表盘内置了HuggingFace模型浏览器。找到模型，点击下载。在Hermes、Pi、Raycast和Apollo中更改模型，我就完成了。","很多操作也可以通过CLI完成，所以我可以从任何设备SSH连接到Mac mini。","为什么这很重要：本地模型和API模型之间的差距正在迅速缩小。一年前的“一般”质量现在在大多数实际任务中都具有竞争力。编码、推理、工具使用才是关键所在。而OptiQ的4位量化技术出乎意料地保持了高质量。35B-A3B在4位测试中相比BF16（16位浮点，未压缩基线）只损失大约1-2分。这是48GB内存使用而非70GB的合理权衡。","Tailscale 在我所有设备之间创建了一个网格。Mac mini、iPhone、MacBook 都在同一个私有网络中。没有任何东西暴露在公共互联网。","oMLX 服务器监听 8000 端口。任何在 tailnet 中的设备都可以连接。Raycast、Apollo iOS、Hermes 桌面客户端在我的 MacBook 上都连接同一个端点。设备之间没有配置漂移。","oMLX 的 KV 缓存持久化在 tailnet 环境下也很重要。编码代理会在会话中反复回到之前的上下文。oMLX 会将每个区块缓存到 SSD 上，所以当代理返回到之前的前缀时，数据可以从磁盘毫秒级恢复，而不是重新计算。这使得本地设置对于代理工作来说实际上是可行的，这也是 Hermes 存在的地方。","Apple Silicon 上的本地模型不再是一个次要实验。M4 Pro Mac mini 轻松应对，模型对于大多数任务已经足够，而且你可以随时更换模型。你不需要按 token 付费。你也不需要通过第三方端点路由敏感数据。当下周出现更好的模型时，你几乎不费力就可以尝试，成本仅是一些硬盘空间。","我已经预订了一台 128GB 的 M5 Max Mac Studio，将在今年晚些时候交付，但到目前为止，我对这台 M4 Pro Mac mini 的性能非常满意。如果你有其他 Apple Silicon 设备，可以试试——可能需要根据你的规格调整模型，但整体设置是一样的。"],"translationStatus":"translated","bodyOrigin":"source-page","editorial":{"summary":"作者介绍了一套运行在 48GB 内存 M4 Pro Mac mini 上的本地 LLM 环境，主模型为 Qwen3.6-35B-A3B-OptiQ-4bit，轻量模型为 Gemma-4-E4B，推理服务使用 oMLX，并通过 Tailscale 连接 iPhone 与 MacBook。","background":"该方案将 Hermes 后端部署在 Mac mini，MacBook 使用桌面客户端，手机通过 Telegram 访问；作者还使用 Apollo、Pi 和 Raycast 处理不同任务。作者称本地模型主要覆盖不需要 GPT-5 或 Claude Opus 的日常请求。","viewpoint":"Aioga 判断：这篇材料的核心价值在于展示本地模型、代理后端与多设备访问的组合方式，同时强调内存需求、稠密模型与 MoE 模型差异对消费级硬件部署的影响。","implications":"可能影响：本地部署可能减少部分云端模型调用，并让用户保有统一的后端、对话历史和技能配置；但材料不代表本地模型能够替代所有 API 模型，也不足以证明该方案适用于所有硬件或工作负载。","nextStep":"后续观察：需要关注该模型组合在不同任务中的实际效果、长期运行稳定性与资源占用，也应进一步核验 Tailscale、多设备客户端和各应用之间的配置成本。","evidenceRefs":["title","summary","articleBody","source"],"status":"published","aiGenerated":true,"autoApproved":true,"generatedBy":"aioga-editorial:gpt-5.6-sol","reviewedBy":"aioga-editorial-review:gpt-5.6-sol","generatedAt":"2026-09-02T04:45:18.893Z","sourceHash":"501f495ade4a21ce","review":{"approved":true,"groundedness":95,"clarity":93,"duplicationRisk":15,"blockingIssues":[],"notes":["“可能减少部分云端模型调用”属于基于材料的合理推断，使用“可能”已降低误导风险。","“Aioga 判断”明确标注为观点，不构成事实冒充。","可将“模型组合”进一步具体化为“主模型与轻量模型组合”，但属于可选措辞优化。"]},"validation":{"passed":true,"mode":"ai-auto","revisions":0,"checks":["schema","length","source-attribution","editorial-labels","inference-boundary","low-source-overlap","no-html","independent-ai-review"]}},"tags":["行业动态","Hacker News 热门（buzzing.cc 中文翻译）"],"translations":{"zh-CN":{"title":"在 M4 Pro Mac mini 上搭建本地 LLM 环境的完整方案","summary":"作者分享在 48GB 内存 M4 Pro Mac mini 上运行本地 LLM 的完整方案，主模型为 Qwen3.6-35B-A3B-OptiQ-4bit（约占用 20GB 内存），轻量模型为 Gemma-4-E4B，推理服务用 oMLX，通过 Tailscale 让 iPhone、MacBook 共用同一后端，并接入 Hermes、Pi、Apollo 和 Raycast。","category":"行业动态","source":"lws.io","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"在 M4 Pro Mac mini 上搭建本地 LLM 环境的完整方案 - Aioga AI资讯","description":"作者分享在 48GB 内存 M4 Pro Mac mini 上运行本地 LLM 的完整方案，主模型为 Qwen3.6-35B-A3B-OptiQ-4bit（约占用 20GB 内存），轻量模型为 Gemma-4-E4B，推理服务用 oMLX，通过 Tailscale 让 iPhone、MacBook 共用同一后端，并接入 Hermes、Pi、Apollo 和...","url":"https://www.aioga.com/news/cmtjlldks0381rori2d5pzkbw/","articleBody":["我在我的 M4 Pro Mac mini 上运行本地 LLM 服务器，配备 48 GB 内存。它处理从我的 Hermes 代理后台到手机上的快速聊天查询的一切。整个设置大约需要 30 分钟。","Hermes 作为 Mac mini 上的代理后台运行，我的 MacBook 运行桌面客户端，手机运行 Telegram。对于非 Hermes 的使用，我在 iOS 上使用 Apollo 进行快速聊天（类似 Claude，适合随问随答的问题），Pi 作为我的编程代理（我已经写过这个设置：https://lws.io/blog/pi-harness-cold-start/），以及在我的 Mac 上使用 Raycast AI 来处理随机的事情。","运行本地的主要原因：云 API 是租用的土地。它们可以修改价格、达到你的使用限制，或者在任何时候在后台更换所提供的模型。我经常用尽两个每月 200 美元的订阅，而且感觉在不同时间得到的东西也不同。有时候一个模型很好，有时候它会在没有通知的情况下退化。","还有 AI 主权。我一直在关注美国政府如何限制各种模型的推广。政府可以在任何时候、出于任何原因进行这种限制，而你无法控制。如果你的工作流程依赖于受到限制的云模型，你就必须停止或临时应对。避免这种情况的唯一方法是拥有自己的计算能力。","Mac mini 一直开着。它放在我的桌子上，除了我需要使用它时，我几乎不会注意到它。","Hermes 也运行在 Mac mini 上，使用同一台机器上的本地模型。我通过 Telegram（在手机上）和 MacBook 上的 Hermes 桌面应用访问我的代理。Hermes 桌面应用充当一个‘外壳’，连接到另一台设备上的 Hermes 后台（本例为 Mac mini）。这意味着我可以在所有设备间共享后台、对话历史和技能集。","重点不是替代基于 API 的模型。而是处理 80% 不需要 GPT-5 或 Claude Opus 的请求。当我确实需要这些模型时，它们已经可用。本地模型只是覆盖更多我日常使用的部分，且是免费的。","本地运行大型模型归结为一个问题：它实际在内存中需要多少 RAM。大多数人只看参数数量就会产生误解，因为稠密模型和专家混合（MoE）模型在消费级硬件上的差别非常大。","以下是读取该标识符的方法：","关键区别在于A3B部分。一个密集的27B模型，每个令牌都被加载在RAM中，始终有270亿个参数。像Qwen3.6-35B-A3B这样的MoE模型，总共有350亿个参数，分布在256位专家身上，但每个令牌实际激活的只有大约30亿个。另外320亿个则放在RAM中，什么都不做。","在我的48GB Mac mini上，Qwen3.6-35B-A3B的4位内存大约占用20GB。剩下的28GB用于上下文Windows、操作系统以及机器上运行的其他所有设备。Gemma-4-E4B大约是2.4GB。体积小，可以保留用于简单任务，而使用完整的20GB版本则显得过于繁琐。","我朋友的MacBook Air总共有16GB。4位密集的27B大约需要14GB。这几乎是机器所有的容量，除了操作系统空间。所以它能用一会儿，然后不行就切换到SSD变得很痛苦。","MoE改变了这一点。我标识符中的35B模型可以装在同一台MacBook上，因为每个令牌实际上只有3B的权重是激活的，这意味着GPU/媒体内存占用更接近6B密度模型所需的容量。350亿个总参数权重都放在统一内存中。","如何检查某个型号是否能在你的硬件上运行：","这是没人提的部分。你可以每隔几周更换一次本地模型，因为有新模型发布。这实际上就是下载和重启。","oMLX管理仪表盘内置了HuggingFace模型浏览器。找到模型，点击下载。在Hermes、Pi、Raycast和Apollo中更改模型，我就完成了。","很多操作也可以通过CLI完成，所以我可以从任何设备SSH连接到Mac mini。","为什么这很重要：本地模型和API模型之间的差距正在迅速缩小。一年前的“一般”质量现在在大多数实际任务中都具有竞争力。编码、推理、工具使用才是关键所在。而OptiQ的4位量化技术出乎意料地保持了高质量。35B-A3B在4位测试中相比BF16（16位浮点，未压缩基线）只损失大约1-2分。这是48GB内存使用而非70GB的合理权衡。","Tailscale 在我所有设备之间创建了一个网格。Mac mini、iPhone、MacBook 都在同一个私有网络中。没有任何东西暴露在公共互联网。","oMLX 服务器监听 8000 端口。任何在 tailnet 中的设备都可以连接。Raycast、Apollo iOS、Hermes 桌面客户端在我的 MacBook 上都连接同一个端点。设备之间没有配置漂移。","oMLX 的 KV 缓存持久化在 tailnet 环境下也很重要。编码代理会在会话中反复回到之前的上下文。oMLX 会将每个区块缓存到 SSD 上，所以当代理返回到之前的前缀时，数据可以从磁盘毫秒级恢复，而不是重新计算。这使得本地设置对于代理工作来说实际上是可行的，这也是 Hermes 存在的地方。","Apple Silicon 上的本地模型不再是一个次要实验。M4 Pro Mac mini 轻松应对，模型对于大多数任务已经足够，而且你可以随时更换模型。你不需要按 token 付费。你也不需要通过第三方端点路由敏感数据。当下周出现更好的模型时，你几乎不费力就可以尝试，成本仅是一些硬盘空间。","我已经预订了一台 128GB 的 M5 Max Mac Studio，将在今年晚些时候交付，但到目前为止，我对这台 M4 Pro Mac mini 的性能非常满意。如果你有其他 Apple Silicon 设备，可以试试——可能需要根据你的规格调整模型，但整体设置是一样的。"]},"en":{"title":"Complete Solution for Setting Up a Local LLM Environment on M4 Pro Mac mini","summary":"The author shares a complete solution for running a local LLM on a 48GB M4 Pro Mac mini, with the main model being Qwen3.6-35B-A3B-OptiQ-4bit (occupying about 20GB of memory) and the lightweight model being Gemma-4-E4B. The inference service uses oMLX, and Tailscale allows iPhone and MacBook to share the same backend, integrated with Hermes, Pi, Apollo, and Raycast.","category":"Industry","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Complete Solution for Setting Up a Local LLM Environment on M4 Pro Mac mini - Aioga AI News","description":"The author shares a complete solution for running a local LLM on a 48GB M4 Pro Mac mini, with the main model being Qwen3.6-35B-A3B-OptiQ-4bit (occupying about 20GB of memory) and t...","url":"https://www.aioga.com/en/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:41:37.506Z"},"ja":{"title":"M4 Pro Mac mini上でローカルLLM環境を構築するための完全なソリューション","summary":"著者は48GBメモリのM4 Pro Mac mini上でネイティブLLMを実行するための完全なソリューションを共有しています。メインモデルはQwen3.6-35B-A3B-OptiQ-4bit(約20GBメモリ)、軽量モデルはGemma-4-E4B、推論サービスoMLXが使用されています。Tailscaleを通じてiPhoneとMacBookは同じバックエンドを共有し、Hermes、Pi、Apollo、Raycastを接続しています。","category":"業界動向","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"M4 Pro Mac mini上でローカルLLM環境を構築するための完全なソリューション - Aioga AIニュース","description":"著者は48GBメモリのM4 Pro Mac mini上でネイティブLLMを実行するための完全なソリューションを共有しています。メインモデルはQwen3.6-35B-A3B-OptiQ-4bit(約20GBメモリ)、軽量モデルはGemma-4-E4B、推論サービスoMLXが使用されています。Tailscaleを通じてiPhoneとMacBookは同じバックエン...","url":"https://www.aioga.com/ja/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:41:40.637Z"},"ko":{"title":"M4 Pro Mac mini에서 로컬 LLM 환경을 구축하는 완전한 솔루션","summary":"저자는 48GB 메모리 M4 Pro Mac mini에서 네이티브 LLM을 실행하는 완전한 솔루션을 공유합니다. 주요 모델은 Qwen3.6-35B-A3B-OptiQ-4bit(약 20GB 메모리)이며, 경량 모델은 Gemma-4-E4B이며, 추론 서비스 oMLX가 사용됩니다. Tailscale을 통해 iPhone과 MacBook은 동일한 백엔드를 공유하며, Hermes, Pi, Apollo, Raycast를 연결합니다.","category":"업계 동향","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"M4 Pro Mac mini에서 로컬 LLM 환경을 구축하는 완전한 솔루션 - Aioga AI 뉴스","description":"저자는 48GB 메모리 M4 Pro Mac mini에서 네이티브 LLM을 실행하는 완전한 솔루션을 공유합니다. 주요 모델은 Qwen3.6-35B-A3B-OptiQ-4bit(약 20GB 메모리)이며, 경량 모델은 Gemma-4-E4B이며, 추론 서비스 oMLX가 사용됩니다. Tailscale을 통해 iPhone과 MacBo...","url":"https://www.aioga.com/ko/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:41:49.494Z"},"es":{"title":"Solución completa para configurar un entorno LLM local en M4 Pro Mac mini","summary":"El autor comparte la solución completa para ejecutar un LLM local en un Mac mini M4 Pro con 48GB de memoria, el modelo principal es Qwen3.6-35B-A3B-OptiQ-4bit (ocupando aproximadamente 20GB de memoria), el modelo ligero es Gemma-4-E4B, el servicio de inferencia usa oMLX, y mediante Tailscale permite que iPhone y MacBook compartan el mismo backend, además de integrarse con Hermes, Pi, Apollo y Raycast.","category":"Industria","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Solución completa para configurar un entorno LLM local en M4 Pro Mac mini - Aioga Noticias de IA","description":"El autor comparte la solución completa para ejecutar un LLM local en un Mac mini M4 Pro con 48GB de memoria, el modelo principal es Qwen3.6-35B-A3B-OptiQ-4bit (ocupando aproximadam...","url":"https://www.aioga.com/es/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:41:48.277Z"},"fr":{"title":"Solution complète pour configurer un environnement LLM local sur Mac mini M4 Pro","summary":"L'auteur partage la solution complète pour exécuter un LLM local sur un Mac mini M4 Pro avec 48 Go de RAM, le modèle principal étant Qwen3.6-35B-A3B-OptiQ-4bit (occupant environ 20 Go de RAM), le modèle léger étant Gemma-4-E4B. Le service d'inférence utilise oMLX et, grâce à Tailscale, l'iPhone et le MacBook partagent le même backend, avec intégration de Hermes, Pi, Apollo et Raycast.","category":"Industrie","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Solution complète pour configurer un environnement LLM local sur Mac mini M4 Pro - Aioga Actualités IA","description":"L'auteur partage la solution complète pour exécuter un LLM local sur un Mac mini M4 Pro avec 48 Go de RAM, le modèle principal étant Qwen3.6-35B-A3B-OptiQ-4bit (occupant environ 20...","url":"https://www.aioga.com/fr/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:41:55.111Z"},"de":{"title":"Eine vollständige Lösung zum Aufbau einer lokalen LLM-Umgebung auf dem M4 Pro Mac mini","summary":"Der Autor teilt eine vollständige Lösung zum Betrieb eines nativen LLM auf dem 48GB Speicher des M4 Pro Mac mini. Das Hauptmodell ist Qwen3.6-35B-A3B-OptiQ-4bit (etwa 20GB Speicher), das leichte Modell ist Gemma-4-E4B, und der Inferenzdienst oMLX wird verwendet. Über Tailscale teilen sich iPhone und MacBook dasselbe Backend, das Hermes, Pi, Apollo und Raycast verbindet.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Eine vollständige Lösung zum Aufbau einer lokalen LLM-Umgebung auf dem M4 Pro Mac mini - Aioga KI-News","description":"Der Autor teilt eine vollständige Lösung zum Betrieb eines nativen LLM auf dem 48GB Speicher des M4 Pro Mac mini. Das Hauptmodell ist Qwen3.6-35B-A3B-OptiQ-4bit (etwa 20GB Speicher...","url":"https://www.aioga.com/de/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:41:58.472Z"},"pt-BR":{"title":"Plano completo para configurar ambiente LLM local no M4 Pro Mac mini","summary":"O autor compartilha um plano completo para executar LLM local em um Mac mini M4 Pro com 48GB de memória, sendo o modelo principal Qwen3.6-35B-A3B-OptiQ-4bit (ocupando cerca de 20GB de memória), modelo leve Gemma-4-E4B, serviço de inferência usando o oMLX, compartilhamento de backend entre iPhone e MacBook via Tailscale, e integração com Hermes, Pi, Apollo e Raycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Plano completo para configurar ambiente LLM local no M4 Pro Mac mini - Aioga Notícias de IA","description":"O autor compartilha um plano completo para executar LLM local em um Mac mini M4 Pro com 48GB de memória, sendo o modelo principal Qwen3.6-35B-A3B-OptiQ-4bit (ocupando cerca de 20GB...","url":"https://www.aioga.com/pt-BR/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:03.806Z"},"ru":{"title":"Полное решение по созданию локальной среды LLM на M4 Pro Mac mini","summary":"Автор делится полным решением по запуску локального LLM на M4 Pro Mac mini с 48 ГБ оперативной памяти, основной моделью является Qwen3.6-35B-A3B-OptiQ-4bit (занимает около 20 ГБ памяти), легкая модель — Gemma-4-E4B, сервис для инференса использует oMLX, через Tailscale iPhone и MacBook используют один и тот же бекенд, а также интегрированы Hermes, Pi, Apollo и Raycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Полное решение по созданию локальной среды LLM на M4 Pro Mac mini - Aioga Новости ИИ","description":"Автор делится полным решением по запуску локального LLM на M4 Pro Mac mini с 48 ГБ оперативной памяти, основной моделью является Qwen3.6-35B-A3B-OptiQ-4bit (занимает около 20 ГБ па...","url":"https://www.aioga.com/ru/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:04.524Z"},"ar":{"title":"حل كامل لبناء بيئة LLM محلية على جهاز M4 Pro Mac mini","summary":"يشارك المؤلف حلا كاملا لتشغيل نموذج لغوي لغوي أصلي على ذاكرة M4 Pro Mac mini بسعة 48GB. النموذج الرئيسي هو Qwen3.6-35B-A3B-OptiQ-4bit (حوالي 20 جيجابايت من الذاكرة)، والطراز خفيف الوزن هو Gemma-4-E4B، ويستخدم خدمة الاستدلال oMLX. من خلال Tailscale، يشترك iPhone وMacBook في نفس الخلفية، ويربط بين Hermes وPi وأبولو وRaycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"حل كامل لبناء بيئة LLM محلية على جهاز M4 Pro Mac mini - Aioga أخبار الذكاء الاصطناعي","description":"يشارك المؤلف حلا كاملا لتشغيل نموذج لغوي لغوي أصلي على ذاكرة M4 Pro Mac mini بسعة 48GB. النموذج الرئيسي هو Qwen3.6-35B-A3B-OptiQ-4bit (حوالي 20 جيجابايت من الذاكرة)، والطراز خفيف ا...","url":"https://www.aioga.com/ar/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:13.501Z"},"hi":{"title":"M4 Pro Mac मिनी पर स्थानीय LLM वातावरण बनाने के लिए एक संपूर्ण समाधान","summary":"लेखक 48GB मेमोरी M4 Pro Mac मिनी पर देशी LLM चलाने के लिए एक संपूर्ण समाधान साझा करता है। मुख्य मॉडल Qwen3.6-35B-A3B-OptiQ-4 बिट (लगभग 20GB मेमोरी) है, हल्का मॉडल Gemma-4-E4B है, और अनुमान सेवा oMLX का उपयोग किया जाता है। टेलस्केल के माध्यम से, iPhone और MacBook एक ही बैकएंड साझा करते हैं, और यह हेमीज़, पाई, अपोलो और रेकास्ट को जोड़ता है।","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"M4 Pro Mac मिनी पर स्थानीय LLM वातावरण बनाने के लिए एक संपूर्ण समाधान - Aioga AI समाचार","description":"लेखक 48GB मेमोरी M4 Pro Mac मिनी पर देशी LLM चलाने के लिए एक संपूर्ण समाधान साझा करता है। मुख्य मॉडल Qwen3.6-35B-A3B-OptiQ-4 बिट (लगभग 20GB मेमोरी) है, हल्का मॉडल Gemma-4-E4B है, औ...","url":"https://www.aioga.com/hi/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:13.486Z"},"it":{"title":"Una soluzione completa per costruire un ambiente LLM locale sul Mac mini M4 Pro","summary":"L'autore condivide una soluzione completa per eseguire un LLM nativo sul Mac mini M4 Pro mini da 48GB di memoria. Il modello principale è Qwen3.6-35B-A3B-OptiQ-4bit (circa 20GB di memoria), il modello leggero è Gemma-4-E4B e viene utilizzato il servizio di inferenza oMLX. Attraverso Tailscale, iPhone e MacBook condividono lo stesso backend, che collega Hermes, Pi, Apollo e Raycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Una soluzione completa per costruire un ambiente LLM locale sul Mac mini M4 Pro - Aioga Notizie IA","description":"L'autore condivide una soluzione completa per eseguire un LLM nativo sul Mac mini M4 Pro mini da 48GB di memoria. Il modello principale è Qwen3.6-35B-A3B-OptiQ-4bit (circa 20GB di...","url":"https://www.aioga.com/it/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:22.351Z"},"nl":{"title":"Volledige oplossing voor het opzetten van een lokale LLM-omgeving op een M4 Pro Mac mini","summary":"De auteur deelt een volledige oplossing voor het draaien van een lokale LLM op een M4 Pro Mac mini met 48GB geheugen, met als hoofmodel Qwen3.6-35B-A3B-OptiQ-4bit (ongeveer 20GB geheugen), lichtgewichtmodel Gemma-4-E4B, inferentieservice oMLX en via Tailscale delen van dezelfde backend voor iPhone en MacBook, inclusief integratie met Hermes, Pi, Apollo en Raycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Volledige oplossing voor het opzetten van een lokale LLM-omgeving op een M4 Pro Mac mini - Aioga AI-nieuws","description":"De auteur deelt een volledige oplossing voor het draaien van een lokale LLM op een M4 Pro Mac mini met 48GB geheugen, met als hoofmodel Qwen3.6-35B-A3B-OptiQ-4bit (ongeveer 20GB ge...","url":"https://www.aioga.com/nl/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:18.869Z"},"tr":{"title":"M4 Pro Mac mini'de yerel bir LLM ortamı oluşturmak için tam bir çözüm","summary":"Yazar, 48GB belleğe sahip M4 Pro Mac mini'de yerel LLM çalıştırmak için tam bir çözüm paylaşıyor. Ana model Qwen3.6-35B-A3B-OptiQ-4bit (yaklaşık 20GB bellek), hafif model Gemma-4-E4B'dir ve çıkarım hizmeti oMLX kullanılmaktadır. Tailscale üzerinden iPhone ve MacBook aynı arka uçu paylaşır ve Hermes, Pi, Apollo ve Raycast'i birbirine bağlar.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"M4 Pro Mac mini'de yerel bir LLM ortamı oluşturmak için tam bir çözüm - Aioga AI Haberleri","description":"Yazar, 48GB belleğe sahip M4 Pro Mac mini'de yerel LLM çalıştırmak için tam bir çözüm paylaşıyor. Ana model Qwen3.6-35B-A3B-OptiQ-4bit (yaklaşık 20GB bellek), hafif model Gemma-4-E...","url":"https://www.aioga.com/tr/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:31.345Z"},"vi":{"title":"Giải pháp hoàn chỉnh để xây dựng môi trường LLM cục bộ trên M4 Pro Mac mini","summary":"Tác giả chia sẻ một giải pháp hoàn chỉnh để chạy LLM gốc trên bộ nhớ 48GB M4 Pro Mac mini. Mẫu chính là Qwen3.6-35B-A3B-OptiQ-4bit (khoảng 20GB bộ nhớ), mẫu nhẹ là Gemma-4-E4B, và dịch vụ suy luận oMLX được sử dụng. Thông qua Tailscale, iPhone và MacBook chia sẻ cùng một hệ thống backend, kết nối Hermes, Pi, Apollo và Raycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Giải pháp hoàn chỉnh để xây dựng môi trường LLM cục bộ trên M4 Pro Mac mini - Tin tức AI Aioga","description":"Tác giả chia sẻ một giải pháp hoàn chỉnh để chạy LLM gốc trên bộ nhớ 48GB M4 Pro Mac mini. Mẫu chính là Qwen3.6-35B-A3B-OptiQ-4bit (khoảng 20GB bộ nhớ), mẫu nhẹ là Gemma-4-E4B, và...","url":"https://www.aioga.com/vi/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:31.435Z"},"id":{"title":"Solusi lengkap membangun lingkungan LLM lokal pada M4 Pro Mac mini","summary":"Penulis membagikan solusi lengkap untuk menjalankan LLM lokal pada M4 Pro Mac mini dengan memori 48GB, model utama adalah Qwen3.6-35B-A3B-OptiQ-4bit (sekitar 20GB memori digunakan), model ringan adalah Gemma-4-E4B, layanan inferensi menggunakan oMLX, melalui Tailscale memungkinkan iPhone dan MacBook berbagi backend yang sama, sekaligus mengakses Hermes, Pi, Apollo, dan Raycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Solusi lengkap membangun lingkungan LLM lokal pada M4 Pro Mac mini - Berita AI Aioga","description":"Penulis membagikan solusi lengkap untuk menjalankan LLM lokal pada M4 Pro Mac mini dengan memori 48GB, model utama adalah Qwen3.6-35B-A3B-OptiQ-4bit (sekitar 20GB memori digunakan)...","url":"https://www.aioga.com/id/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:37.494Z"},"th":{"title":"โซลูชันครบวงจรสำหรับการสร้างสภาพแวดล้อม LLM บน M4 Pro Mac mini","summary":"ผู้เขียนแชร์โซลูชันครบวงจรสำหรับการรัน LLM ท้องถิ่นบน M4 Pro Mac mini ที่มี RAM 48GB โมเดลหลักคือ Qwen3.6-35B-A3B-OptiQ-4bit (ใช้ RAM ประมาณ 20GB) โมเดลน้ำหนักเบาคือ Gemma-4-E4B บริการ inference ใช้ oMLX ผ่าน Tailscale เพื่อให้ iPhone, MacBook ใช้ backend เดียวกัน และเชื่อมต่อกับ Hermes, Pi, Apollo และ Raycast","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"โซลูชันครบวงจรสำหรับการสร้างสภาพแวดล้อม LLM บน M4 Pro Mac mini - ข่าว AI Aioga","description":"ผู้เขียนแชร์โซลูชันครบวงจรสำหรับการรัน LLM ท้องถิ่นบน M4 Pro Mac mini ที่มี RAM 48GB โมเดลหลักคือ Qwen3.6-35B-A3B-OptiQ-4bit (ใช้ RAM ประมาณ 20GB) โมเดลน้ำหนักเบาคือ Gemma-4-E4B บร...","url":"https://www.aioga.com/th/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:38.290Z"},"pl":{"title":"Kompletny plan uruchomienia lokalnego środowiska LLM na M4 Pro Mac mini","summary":"Autor dzieli się kompletnym planem uruchomienia lokalnego LLM na Mac mini M4 Pro z 48GB pamięci RAM, głównym modelem jest Qwen3.6-35B-A3B-OptiQ-4bit (około 20GB pamięci), lekki model to Gemma-4-E4B, serwis inferencyjny używa oMLX, przez Tailscale iPhone i MacBook korzystają z tego samego backendu oraz integrują się z Hermes, Pi, Apollo i Raycast.","category":"行业动态","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Kompletny plan uruchomienia lokalnego środowiska LLM na M4 Pro Mac mini - Aioga Wiadomości AI","description":"Autor dzieli się kompletnym planem uruchomienia lokalnego LLM na Mac mini M4 Pro z 48GB pamięci RAM, głównym modelem jest Qwen3.6-35B-A3B-OptiQ-4bit (około 20GB pamięci), lekki mod...","url":"https://www.aioga.com/pl/news/cmtjlldks0381rori2d5pzkbw/","contentTranslated":true,"sourceHash":"71cc7fbcda15bbda","translatedAt":"2026-09-02T04:42:44.327Z"}},"evidenceTier":"verified-news","reviewStatus":"automated-ingest","indexable":true,"editorialCover":"/page-visuals/topic-timeline.png"}}