Tag: Mixture of Experts

Google unveils DiffusionGemma open AI model with up to 4x faster text generation

Google has introduced DiffusionGemma, an experimental open-weight AI model that explores diffusion-based text generation. Released under the Apache 2.0 license, the 26-billion-parameter Mixture-of-Experts (MoE) model moves beyond the sequential token-by-token generation used by traditional autoregressive large language models, instead generating and refining entire blocks of text simultaneously. Continue reading “Google unveils DiffusionGemma open AI model with up to 4x faster text generation”

Google unveils Gemma 4 open AI models with advanced reasoning and agentic workflows

Google has introduced Gemma 4, an open model family designed for advanced reasoning and agentic workflows. The models are built to deliver high intelligence-per-parameter while remaining efficient across a wide range of hardware environments. Gemma 4 is positioned as part of Google’s broader AI ecosystem and complements its proprietary Gemini models. Continue reading “Google unveils Gemma 4 open AI models with advanced reasoning and agentic workflows”