Multi-Channel to Multi-Channel Noise Reduction and Reverberant Speech Preservation in Time-Varying Acoustic Scenes for Binaural Reproduction

Moti Lugasi, Jacob Donley, Anjali Menon, Vladimir Tourbabin, Boaz Rafaely

Research output: Contribution to journalArticlepeer-review

Abstract

Real-life acoustic scenes may be recorded with microphone arrays for spatial audio applications, especially for the purpose of reproducing binaural signals for headphone listening. However, the presence of noise and interference may necessitate preprocessing to enhance the desired signal and improve the listener experience. Various methods have been developed to reduce noise while preserving the desired signal component with minimal distortion. The additional challenges posed by time-varying acoustic scenes are commonly addressed by segmenting the recorded signals into short time frames. Then, the short-time Fourier transform (STFT) is employed with multichannel Wiener filter (MWF) and assuming the multiplicative transfer function(MTF) approximation.This approximation may not apply in the presence of long reverberation times and/or short STFT frames, so alternative techniques are required. This paper explores MWF-based enhancement in time-varying acoustic scenes where the MTF approximation is inapplicable, both analytically and experimentally with normal-hearing listeners. The investigated scene comprises a single desired source in a reverberant environment, and the impact of frame length and acoustic parameters on the rank of the spatial covariance matrix is studied. It is revealed that superior results in terms of reduced distortion and improved listener experience are achieved when using a full-rank spatial covariance matrix.

Original languageAmerican English
Pages (from-to)1-12
Number of pages12
JournalIEEE/ACM Transactions on Audio Speech and Language Processing
DOIs
StateAccepted/In press - 1 Jan 2024

Keywords

  • Acoustic distortion
  • array processing
  • binaural reproduction
  • Covariance matrices
  • covariance matrix estimation
  • Indexes
  • Microphone arrays
  • moving source
  • multi-channel Wiener filter
  • Noise
  • noise reduction
  • Spatial audio
  • Spatial audio enhancement
  • Transfer functions

All Science Journal Classification (ASJC) codes

  • Computer Science (miscellaneous)
  • Acoustics and Ultrasonics
  • Computational Mathematics
  • Electrical and Electronic Engineering

Cite this