Overview

MusicGen, part of Meta’s AudioCraft library, was introduced in June 2023. It is a single-stage transformer that generates music from text descriptions and can follow a reference melody. Meta reported training it on licensed music, and released several sizes for research.

Highlights

  • Text-to-music generation of instrumental tracks
  • Melody conditioning to follow an existing tune
  • Sizes from about 300 million to 3.3 billion parameters
  • Part of the open AudioCraft toolkit
  • Trained on licensed music data according to Meta

Typical uses

Research on music generation, prototyping background music and experimenting with AI composition.

Things to consider

  • Model weights are licensed for non-commercial use only.
  • Generates instrumental music; it does not produce sung lyrics.
  • Commercial music generators now offer higher quality and vocals.

Specifications are taken from the provider’s official announcement, documentation or model card. Benchmark results depend on evaluation settings; see how AI benchmarks work.