New methods of securing the distribution of audio content have been widely deployed in the last twenty years. Their impact on perceptive quality has, however, only been seldomly the subject of recent extensive research. We review digital speech watermarking state of the art and provide subjective testing of watermarked speech samples. Latest speech watermarking techniques are listed, with their specifics and potential for further development. Their current and possible applications are evaluated. Open-source software designed to embed watermarking patterns in audio files is used to produce a set of samples that satisfies the requirements of modern speech-quality subjective assessments. The patchwork algorithm that is coded in the application is mainly considered in this analysis. Different watermark robustness levels are used, which allow determining the threshold of detection to human listeners. The subjective listening tests are conducted following ITU-T P.800 Recommendation, which precisely defines the conditions and requirements for subjective testing. Further analysis tries to determine the effects of noise and various disturbances on watermarked speech's perceived quality. A threshold of intelligibility is estimated to allow further openings on speech compression techniques with watermarking. The impact of language or social background is evaluated through an additional experiment involving two groups of listeners. Results show significant robustness of the watermarking implementation, retaining both a reasonable net subjective audio quality and security attributes, despite mild levels of distortion and noise. Extended experiments with Chinese listeners open the door to formulate a hypothesis on perception variations with geographical and social backgrounds.

Department of Measurement Faculty of Electrical Engineering Czech Technical University Prague Technická 2 Prague 166 27 Czech Republic

See more in PubMed

Zmudzinski S. Digital Watermarking for Verification of Perception-based Integrity of Audio Data. Technical University; 2017.

Cvejic N, Seppanen T. Digital audio watermarking techniques and technologies: Applications and benchmarks. IGI Glob. 2007;1:229–247.

Al-Haj A. An imperceptible and robust audio watermarking algorithm. EURASIP J. Audio Speech Music Process. 2014;2014(1):1–12. doi: 10.1186/s13636-014-0037-2. DOI

Lalitha, N., Rao, C. S. & Sree, P. J. A review of digital audio watermarking schemes. J. Crit. Rev.7(7), 870–880. http://www.jcreview.com/?mno=108957 (2020).

Akanksha JN, Dhiraj D, Reddy H, Tripathi S. Robust and imperceptible digital speech watermarking. Proceeding. 2021;1:11719.

Wu Q, Wu M. A novel robust audio watermarking algorithm by modifying the average amplitude in transform domain. MDPI Appl. Sci. 2018;8(5):723. doi: 10.3390/app8050723. DOI

Best C. The diversity of tone languages and the roles of pitch variation in non-tone languages: Considerations for tone perception research. Front. Psychol. 2019;10:364. doi: 10.3389/fpsyg.2019.00364. PubMed DOI PMC

Ortega-Llebaria M, Nemogá M, Presson N. Long-term experience with a tonal language shapes the perception of intonation in English words: How Chinese-English bilinguals perceive Rose? vs Rose. Bilingual. Lang. Cogn. 2017;20(2):367–383. doi: 10.1017/S1366728915000723. DOI

Ryan EB, Sebastian RJ. The effects of speech style and social class background on social judgements of speakers. Br. J. Soc. Clin. Psychol. 1980;19(3):229–233. doi: 10.1111/j.2044-8260.1980.tb00348.x. DOI

ETSI. Speech and multimedia transmission quality (STQ); Methods for objective assessment of listening effort. ETSI TS 103 558 V1.2.1 (2020-08) (2020).

Westerfeld, S. Audiowmark: Audio Watermarking. https://uplex.de/audiowmark (2020).

Chincholkar YD, Ganorkarmm SR. A patchwork-based audio watermarking: Review. Int. J. Sci. Technol. Res. 2019;25(11):2176–2187.