Unsupervised Voice Activity Detection by Modeling Source and System Information using Zero Frequency Filtering

Voices Powered byElevenlabs logo


What's the main idea of this paper?

AI: The main idea of this paper is to propose a novel, unsupervised, time-domain technique for voice activity detection using zero-frequency filtering signals, which models voice source and vocal tract system information, and performs well on noisy and degraded audio signals. The paper presents two approaches for VAD based on zero-frequency filtering, compares them with other supervised and unsupervised VAD methods, and provides a detailed description of the dataset, baseline methods, and evaluation metrics used in the experiments. The proposed ZFF-based methods are effective in detecting voice activity and produce more refined boundary demarcations compared to other methods in the literature.


Eklavya Sarkar, RaviShankar Prasad, Mathew Magimai. -Doss


Voice activity detection (VAD) is an important pre-processing step for speech technology applications. The task consists of deriving segment boundaries of audio signals which contain voicing information. In recent years, it has been shown that voice source and vocal tract system information can be extracted using zero-frequency filtering (ZFF) without making any explicit model assumptions about the speech signal. This paper investigates the potential of zero-frequency filtering for jointly modeling voice source and vocal tract system information, and proposes two approaches for VAD. The first approach demarcates voiced regions using a composite signal composed of different zero-frequency filtered signals. The second approach feeds the composite signal as input to the rVAD algorithm. These approaches are compared with other supervised and unsupervised VAD methods in the literature, and are evaluated on the Aurora-2 database, across a range of SNRs (20 to -5 dB). Our studies show that the proposed ZFF-based methods perform comparable to state-of-art VAD methods and are more invariant to added degradation and different channel characteristics.

Follow Us on


Add comment
Recommended SciCasts