Google expands AI music tools with Lyria 3 and Lyria 3 Pro

Google has expanded its AI music offerings with Lyria 3 and Lyria 3 Pro, now accessible through the Gemini API, Google AI Studio, and multiple Google products. These models provide high-fidelity, structurally coherent music generation for developers, creators, and organizations, supporting both professional-grade compositions and rapid prototyping.

Lyria 3: Studio-Quality Music with Granular Controls

Lyria 3 is designed to combine deep musical awareness with structural coherence, allowing developers to build apps that generate complete compositions with realistic vocals, verses, and choruses. The model supports multiple languages and musical genres, including pop, funk, and Motown.

Two model variants are available:

  • Lyria 3 Pro (lyria-3-pro-preview): Produces full-length tracks of up to three minutes. It offers professional-grade structural awareness and supports prompts for specific song elements such as intros, verses, choruses, and bridges.
  • Lyria 3 Clip (lyria-3-clip-preview): Optimized for speed, generating high-quality 30-second clips suited for rapid prototyping, background loops, or social media content.

Both variants support realistic vocals with expressive nuance and improved clarity for natural-sounding audio.

Precision Control and Multimodal Input

Lyria 3 introduces granular controls for precise direction via natural language:

  • Tempo conditioning: Specify tempo to align with the rhythm required.
  • Time-aligned lyrics: Control the timing of lyrics throughout a track.
  • Image-to-music input: Provide an image to influence the music’s mood, style, and atmosphere.
Lyria 3 Pro: Integration Across Google Products

Lyria 3 Pro is now integrated across multiple Google platforms:

  • Vertex AI: Supports scalable, high-fidelity music generation for businesses, including gaming soundtracks and creative tools.
  • Google AI Studio & Gemini API: Enables developers to build creative apps with enhanced musical awareness. Lyria 3 Pro is available alongside Lyria RealTime in AI Studio.
  • Google Vids: Offers custom music generation for personal or marketing videos, rolling out to Google Workspace and Google AI Pro & Ultra subscribers.
  • Gemini app: Paid subscribers can generate longer, more detailed tracks for vlogs, podcasts, or tutorial videos.
  • ProducerAI: Provides a collaborative music creation platform for musicians, producers, and songwriters, offering iterative AI-assisted song generation. Available globally for free and paid users.

Example Applications

Demonstrations in AI Studio showcase potential uses:

  • Background music for videos: Automatically generates synchronized instrumental tracks based on video content.
  • Alarm clock app: Produces personalized songs reflecting weather, location, time, date, and calendar events.
  • Composer mode: Build songs section by section, controlling timing, intensity, and description for each part.
  • Text mode: Generate music through natural language prompts specifying parameters such as tempo or key.
Responsible AI and Transparency

Google emphasizes responsible AI practices:

  • SynthID watermark: All outputs include a digital watermark to verify AI-generated content.
  • Legal compliance: Training uses materials authorized under YouTube and Google terms, partner agreements, and applicable law. Lyria 3 does not mimic specific artists and includes content filters to prevent intellectual property violations.
  • Creative collaboration: Grammy-winning producer Yung Spielburg and DJ François K have integrated Lyria 3 into professional projects, including film scoring and song production.
Availability
  • Public preview: Both Lyria 3 Clip and Lyria 3 Pro are available globally for developers.
  • AI Studio Playground: Offers text mode and composer mode for creative control.
  • Gemini API & integrated products: Accessible for app development and integration.
  • Google Vids: Rolling out to Google Workspace and Google AI Pro & Ultra subscribers.
  • ProducerAI: Available globally to free and paid users.
  • Documentation & Cookbook: Guides, API references, and code samples are provided to support developer integration.
  • Demo applications: Lyria Studio, Lyria Rhythm, Alarm Clock, and video background music demos are available for experimentation.


Related Post