Dear Glenn

An A.I. system crafted by love.

GLENN GOULD AS A.I. GLENN GOULD AS A.I.

Project

This is a project dubbed Dear Glenn, a project inspired by his unique creative style and launched to explore the future of music through the use of artificial intelligence.
Glenn Gould was known for his devotion to recording with digital media and an interest in rethinking the relationship between performer and audience. The project to develop this system has been dubbed “Dear Glenn” as a tribute to the artist’s attitude, which was the inspiration for the idea behind the project.

Glenn Gould as A.I.

With the full support of the Glenn Gould Foundation, Yamaha analyzed over 100 hours of Gould’s performance recordings to develop an understanding of his playing style and employed deep learning algorithms based on the data collected to create the AI system. In addition to Gould’s audio recordings, AI learning data included human input in the form of performances by multiple pianists who were admirers of Gould and intimately familiar with his performance style, raising the quality of reproduction to new levels. Near-instant performance analysis of fellow human players enables the AI to play predictively while interacting with human musicians. More than simply an automated performance, the AI reproduces the masterful touch of Glenn Gould to provide an inspiring and interactive experience of co-creation between an AI pianist and human musicians.

The profile of Glenn Gould

Born in Toronto, Canada in 1932, Glenn Gould was a legendary pianist who passed away in 1982 at the young age of 50. Gould has received extraordinary praise and is known for his masterful performances of J.S. Bach’s music, beginning with his debut album Bach: The Goldberg Variations, which was released in 1956. In 1964, Gould announced the end of his concert career and began to concentrate on recording, devoting himself to digital media releases. Gould was also known for his unconventional and unique performance habits, which included sitting on a low chair and leaning over the piano keyboard, as well as humming while playing, even during recordings. In his later years, Gould recorded three albums, including Bach: The Goldberg Variations, on a Yamaha concert piano.

Event

GLENN GOULD AS A.I.

Keynote Session

Date Saturday, 7 September 2019 19:00 - 19:30
Venue Altomonte Saal, St. Florian Monastery (Linz, Austria)
Speakers Francesco Tristano (Pianist), Brian M. Levine (Glenn Gould Foundation), Norbert Trawöger(Bruckner Orchestra Linz), Akira Maezawa (R&D, Yamaha Corporation)
Theme Possibilities of Co-Creation Between Artists and AI

Concert (AI Unveiling)

Date Saturday, 7 September 2019 20:30 - 21:00
Venue Basilika, St. Florian Monastery (Linz, Austria)
Performers Piano:Glenn Gould, Francesco Tristano
Flute,Violin:Norbert Trawöger, Maria Elisabeth Köstler(Bruckner Orchestra Linz)
Program J.S. Bach’s Goldberg Variations (BWV 988), Fuga inversa a 2 Clavicembali from The Art of the Fugue (BWV 1080/18)*, Trio Sonata G Major (BWV 1038)* *Never performed by Glenn Gould

About the Ars Electronica Festival

ARS ELECTRONICA Image

The Ars Electronica Festival is a festival that centers on the latest in art, technology, and science and is held by Ars Electronica, a media art research institute based in Linz, Austria. First held in 1979, the festival has since become one of the largest media art events in the world. During the festival, experts gather from around the world at exhibitions, performances, events, and international conferences in venues around Linz to engage in discussion and foster new connections.

ARS ELECTRONICA Image

Research and Development

Training of the AI

STEP 01. Analysis

Extract music performance data from music audio recordings by Glenn Gould, such as the velocity and the timing fluctuations of key depression.

STEP 02. Training

Use an AI (deep neural network) to train a mapping between the music score and the performance data, so that the AI could generate performance data to any music score data. For the performance data, we use (1) the analyzed results from step 01 and (2) performances by Glenn Gould experts who were asked to play in the style of Glenn Gould.

STEP 03. Performance

For a given music score data, the trained AI from step 02 generates a corresponding music performance in the style of Glenn Gould.

Dear Glenn - TRAINING OF THE AI

Training of the AI

Dear Glenn - TRAINING OF THE AI
STEP 01. Analysis

Extract music performance data from music audio recordings by Glenn Gould, such as the velocity and the timing fluctuations of key depression.

STEP 02. Training

Use an AI (deep neural network) to train a mapping between the music score and the performance data, so that the AI could generate performance data to any music score data. For the performance data, we use (1) the analyzed results from step 01 and (2) performances by Glenn Gould experts who were asked to play in the style of Glenn Gould.

STEP 03. Performance

For a given music score data, the trained AI from step 02 generates a corresponding music performance in the style of Glenn Gould.

Music ensemble with AI and human musicians

Dear Glenn - Music ensemble with AI and human musicians Dear Glenn - Music ensemble with AI and human musicians

This system also allows a Disklavier player piano to play in the style of Glenn Gould while synchronizing with human musicians. This capability is achieved by controlling the playback based on the analysis of the sound and the motion generated by human musicians.

Contact

For technical inquiries, please access to the inquiry form page.

For press inquiries, please access to the inquiry form page.

THE GLENN GOULD FOUNDATION JAPAN-AUSTRIA 1869-2019