Automatic detection of prosodic boundaries in spontaneous speech

Daniel Baum, Dominik Freche, Nadav Matalon, Netanel Ehrmann, Eyal Weinreb, David Biron, Elisha Moses

Research output: Contribution to journalArticlepeer-review

Abstract

Automatic speech recognition (ASR) and natural language processing (NLP) are expected to benefit from an effective, simple, and reliable method to automatically parse conversational speech. The ability to parse conversational speech depends crucially on the ability to identify boundaries between prosodic phrases. This is done naturally by the human ear, yet has proved surprisingly difficult to achieve reliably and simply in an automatic manner. Efforts to date have focused on detecting phrase boundaries using a variety of linguistic and acoustic cues. We propose a method which does not require model training and utilizes two prosodic cues that are based on ASR output. Boundaries are identified using discontinuities in speech rate (pre-boundary lengthening and phrase-initial acceleration) and silent pauses. The resulting phrases preserve syntactic validity, exhibit pitch reset, and compare well with manual tagging of prosodic boundaries. Collectively, our findings support the notion of prosodic phrases that represent coherent patterns across textual and acoustic parameters.
Original languageEnglish
Article numbere0250969
Number of pages21
JournalPLoS ONE
Volume16
Issue number5
DOIs
StatePublished - 3 May 2021
Externally publishedYes

Fingerprint

Dive into the research topics of 'Automatic detection of prosodic boundaries in spontaneous speech'. Together they form a unique fingerprint.

Cite this