8/12/2026, 1:02:34 PM · foundation-models

Meta Releases Muse Glimmer 30B Multimodal Model Optimized for On-Device Agentic Deployment

Meta's Superintelligence Labs has published Muse Glimmer, a 30-billion-parameter open-weight multimodal agent model designed to run entirely on a single consumer Graphics Processing Unit without cloud infrastructure.

Overview

On August 10, 2026, Meta's Superintelligence Labs published Muse Glimmer, an open-weight, 30-billion-parameter multimodal Large Language Model (LLM) purpose-built for always-on agentic workflows running locally on consumer hardware. The weights are available on Hugging Face under the Apache 2.0 license, with accompanying developer documentation.

Architecture

Muse Glimmer is structured as a dense causal transformer paired with a dedicated perception encoder. According to the official Hugging Face model card, the release comprises approximately a 28-billion-parameter text decoder coupled with a roughly 1.8-billion-parameter Vision Transformer (ViT)-style perception encoder, bringing total parameters to around 30 billion. The perception encoder accepts interleaved text and image inputs, enabling agents to interpret screenshots, charts, and documents alongside conversational context. The architecture also employs grouped-query attention with 32 query heads and 2 key-value heads, and supports a sliding local-global attention pattern.

The model is distilled from a larger internal system called Muse Spark, making it representatively capable while remaining deployable at the edge.

On-Device Deployment

A central design constraint was fitting the full agent stack—weights, key-value cache, perception encoder, and speculative decoding drafter—inside consumer GPU memory envelopes. At full BFloat16 (BF16) precision, a 30-billion-parameter model would require over 55 GB of memory. Meta addresses this through 4-bit quantization, compressing the language model component to under 20 GB, leaving headroom for the remaining components to run simultaneously on a 24 GB or 32 GB consumer Graphics Processing Unit (GPU) or Apple Silicon Mac without any network dependency.

The Hugging Face collection ships four primary artifacts: BF16 weights for research and fine-tuning, GGUF k-quantized files for llama.cpp inference, ExecuTorch Precompiled Tensor Engine (PTE) builds for Metal and CUDA backends, and a 3-billion-parameter companion assistant model. Optimized integrations for llama.cpp and MLX are noted in the Meta AI Research blog as forthcoming at release time. A component called the DFlash block-diffusion drafter provides speculative decoding to sustain the token throughput required for live agent loops.

The ExecuTorch export strategy is notable: rather than reimplementing the model per backend, Meta uses `torch.export` to lower the full computation graph—including the multimodal input pipeline and speculative decoding strategy—once, targeting Triton on CUDA and custom Metal kernels on Apple Silicon.

Agentic Capabilities

The intended use cases, per the model card, span multi-step local agents capable of long-horizon planning, sequential tool invocation, failure recovery, and extended task execution. When a tool call fails or returns an unexpected result, the model is trained to diagnose the error and retry rather than halt. Additional applications include coding agents targeting SWE-Bench-style software engineering tasks, schema-based function calling, desktop screenshot agents, and document and chart understanding.

The model supports controllable reasoning effort—allowing developers to balance quality against latency—and is multilingual, trained on data from more than 100 languages. It is compatible with agentic orchestration frameworks including OpenClaw and Hermes Agent.

Benchmarks and Safety

Meta reports the following benchmark scores in launch materials: 75.5 on MCP Atlas, 51.2 on SWE-Bench Pro, 94.7 on AIME 2026, 77.0 on IFBench, and 78.8 on Charxiv Reasoning. On safety, the model's Siren AgentDojo prompt-injection attack success rate is reported at 28.4, with an agent utility score of 94.2. Meta states the model does not meet the Frontier AI definition under its Advanced AI Scaling Framework, rating chemical/biological, cyber, and loss-of-control risks at moderate or lower.

Significance

The release crystallizes a structural shift in the agent deployment calculus. A fully capable multimodal tool-using model that fits a single 24 GB card under a permissive open license puts serious agentic workflows within reach of privacy-sensitive organizations, independent developers, and teams operating in regions where hosted API equivalents carry latency, cost, or regulatory constraints. The agent stack—calls, log data, and per-token billing—can migrate from cloud Application Programming Interfaces (APIs) onto local hardware, altering the competitive dynamics between cloud inference providers and edge deployment.

Sources

  1. [1]
    GitHub - cobusgreyling/Muse-Glimmer: Introducing Muse Glimmer: open-weight 30B agentic multimodal model that runs on your device (Meta). Interactive local agent lab + guide. Apache 2.0 · on-device AI · function calling
  2. [2]
    Muse Glimmer - a meta-models Collection
  3. [3]
    Meta ships Muse Glimmer-30B as local agent model on consumer GPUs | AI Weekly
  4. [4]
    Meta AI Releases Muse Glimmer: A 30B Open-Weights Agentic Model That Runs on One Consumer GPU - MarkTechPost
  5. [5]
    meta-models/Muse-Glimmer-30B · Hugging Face
  6. [6]
    meta-models/Muse-Glimmer-30B-assistant · Hugging Face
  7. [7]
    meta-models/Muse-Glimmer-30B-ExecuTorch-PTE · Hugging Face
  8. [8]
    Meta open-sources Muse Glimmer, a 30B on-device agent model | AI Weekly
  9. [9]
    Introducing Muse Glimmer: An Open Agentic Model That Runs on Your Device | Meta AI Research
  10. [10]
    2026 LLM Trends: Multimodal Agents, On-Device Models, and the Death of Static Content | by Michael | Oct, 2025 | Medium
  11. [11]
    Generative AI Trends 2026: 8 Shifts Reshaping Builds & Buys
  12. [12]
    MECoBench: A Systematic Study of Multimodal Agent Collaboration in Embodied Environments
  13. [13]
    CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning
  14. [14]
    Meta AI Releases Muse Glimmer: A 30B Open-Weights Agentic Model That Runs on One Consumer GPU - MarkTechPost
  15. [15]
    Agentic on-device adaptation for increasing node efficiency by accommodating distribution shifts
  16. [16]
    Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agents
  17. [17]
    GUICourse: From General Vision Language Models to Versatile GUI Agents