Global Internship:Research & Development Division
The Summer 2023 internship application period is closed. If you have already submitted your application, you will be notified by the end of December 2022.
Outline (2023 Season)Closed
Term | Approximately three months, Summer to Autumn 2023 |
---|---|
Division | Research & Development Division |
Location | (1) On-site Program: Hamamatsu, Japan (only 90 minutes from Tokyo/Osaka). (2) Online Program: From home via the Internet. We have only on-site programs in 2023. |
Application | Send a message via this contact form, with your desired field and a list of your research interests, with the subject “Internship”. |
Education | Doctoral or master's students in engineering, computer science, and/or mathematics |
Condition | Paid internship |
Benefits | Stipend. For the on-site program, we also provide you with: ・ Visa application support ・ Transportation costs ・ Furnished accommodation |
Process | Application submission followed by an online interview |
Due date | 16 December 2022 (The contact form will be closed at 11:59 pm on 16 December 2022, SST (UTC -1100).) |
Notes | *Term and Location are flexible, depending on changing national/international regulations against COVID-19. |
Ear-shape and machine learning based acoustic simulation HRTF
Location: Hamamatsu, Japan
Currently, spatial audio is growing in many areas. On the other hand, HRTF
personalization is a developing technology worldwide. Yamaha has presented
shape-based average HRTF at previous AES conferences. We are now conducting
HRTF acoustic simulation research that uses a combination of ear shape data
and machine learning. In addition, auditory spatial perception should be
investigated for personalized HRTFs. In this internship, you will be a
member of a team tasked with developing personalized spatial audio
technology.
We would like you to clarify the challenges and advantages caused by combining ear shape data with machine learning for personalized HRTF.
We would like you to clarify the challenges and advantages caused by combining ear shape data with machine learning for personalized HRTF.
SKILL
- Required: Expertise in programming (C/C++, Python), signal processing, machine learning, image processing (including 2D and/or 3D images)
- Welcomed: Experience in the evaluation of auditory spatial perception
Sound field reproduction of musical instruments when performing
Location: Hamamatsu, Japan
Even in a virtual space, unique radiation characteristics might be required when performing musical instruments. This could contribute to the "reality of the musical performance".
In this internship, as a member of a team dealing with audio signal processing and spatial audio, the intern will be expected to use multiple ViReal Mics (https://www.yamaha.com/en/about/research/technologies/vireal/) to develop a method for the measurement of the radiation characteristics of musical instruments when performing, and to evaluate the developed method in a real environment. The intern will also be expected to model the recorded source as objects with directivity to auralize through binaural reproduction.
In this internship, as a member of a team dealing with audio signal processing and spatial audio, the intern will be expected to use multiple ViReal Mics (https://www.yamaha.com/en/about/research/technologies/vireal/) to develop a method for the measurement of the radiation characteristics of musical instruments when performing, and to evaluate the developed method in a real environment. The intern will also be expected to model the recorded source as objects with directivity to auralize through binaural reproduction.
SKILL
- Required: Expertise in sound field theory in the spherical harmonic domain, array signal processing, and programming (Python, MATLAB)
- Welcomed: Experience in sound field recording and the measurement of radiation characteristics
Immersive Virtual Backgrounds for Enhanced Remote Communication with 3D audio production
Virtual background technologies are implemented in remote communication applications, such as Teams or Zoom. However, traditional virtual backgrounds lack naturalness, remaining static even when there is camera movement. Additionally, the acoustic characteristics of various environments are not simulated accurately. In this internship, you will have the opportunity to develop 3D rendering techniques for dynamically adapting virtual backgrounds to camera movements. Furthermore, the task includes context-driven virtual room acoustics such as the speaker's voice enhancement. Our goal is to create software that revolutionizes remote communication by delivering more realistic virtual backgrounds and immersive audio experiences, raising the bar for industry standards.
SKILL
- Required: Proficiency in programming languages such as Python and C++
- Welcomed: Experience in audio signal processing, computer vision, and image processing
AI-powered agent for music ensemble
Understanding and generating a music performance by a computer enables a
wide variety of applications that add value to the experience of playing a
musical instrument.
In this internship, we will work on machine learning techniques related to
music performance and/or motion generation or recognition, for the purpose
of providing an interactive music performance agent.
We will provide two tracks for this internship:
(1) The intern will be expected to apply machine learning to create an interactive virtual musician.
(2) The intern will be expected to create an interactive virtual musician system for a music ensemble.
(1) The intern will be expected to apply machine learning to create an interactive virtual musician.
(2) The intern will be expected to create an interactive virtual musician system for a music ensemble.
SKILL
(1)
- Required: Expertise in programming (Python,C++), music information retrieval, and machine learning
- Welcomed: Expertise in human-computer interaction, experience in handling human motion data (e.g. BVH data)
(2)
- Required: Experience in creating interactive systems (experience in programming languages e.g., Max/MSP/Jitter, TouchDesigner, Unity, UE, HTML+JS), experience with machine learning frameworks (e.g. torch, TF, CoreML)
- Welcomed: Expertise in human-computer interaction or music informatics research, knowledge of character animation, experience in creating VR/XR systems
Psychophysical modeling of the auditory spatial impression in the context of musical instruments and audio equipment
At Yamaha, we consider two factors when seeking to achieve high-quality sound through the research and development of musical instruments and audio equipment: tone quality or timbre, and the spatial features of sound. The way humans form an "auditory spatial impression" from such spatial features is an active topic of research with many open questions. During this internship, you will formulate new psychophysical models of the auditory spatial impression of musical instruments and audio equipment. To this end, you will gather sensory data from psychophysical experiments, and apply data analysis techniques to identify the physical features of sound sources and fields that can best explain the experimental results.
SKILL
- Required: Expertise in Python programming, knowledge of statistics and data analysis
- Welcomed: Knowledge of physical acoustics, psychophysics and array signal processing
Internship applications for Summer 2024 are now closed.