Fusing linguistic and acoustic information for automated forensic speaker comparison
Jazyk angličtina Země Velká Británie, Anglie Médium print-electronic
Typ dokumentu časopisecké články
PubMed
39277331
DOI
10.1016/j.scijus.2024.07.001
PII: S1355-0306(24)00056-X
Knihovny.cz E-zdroje
- Klíčová slova
- Forensic speaker comparison, Frequent-word analysis, Information fusion, Likelihood ratio framework, Multi-modal analysis,
- MeSH
- akustika řeči MeSH
- algoritmy MeSH
- lidé MeSH
- lingvistika MeSH
- pravděpodobnostní funkce MeSH
- řeč MeSH
- soudní vědy * metody MeSH
- support vector machine MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
Verifying the speaker of a speech fragment can be crucial in attributing a crime to a suspect. The question can be addressed given disputed and reference speech material, adopting the recommended and scientifically accepted likelihood ratio framework for reporting evidential strength in court. In forensic practice, usually, auditory and acoustic analyses are performed to carry out such a verification task considering a diversity of features, such as language competence, pronunciation, or other linguistic features. Automated speaker comparison systems can also be used alongside those manual analyses. State-of-the-art automatic speaker comparison systems are based on deep neural networks that take acoustic features as input. Additional information, though, may be obtained from linguistic analysis. In this paper, we aim to answer if, when and how modern acoustic-based systems can be complemented by an authorship technique based on frequent words, within the likelihood ratio framework. We consider three different approaches to derive a combined likelihood ratio: using a support vector machine algorithm, fitting bivariate normal distributions, and passing the score of the acoustic system as additional input to the frequent-word analysis. We apply our method to the forensically relevant dataset FRIDA and the FISHER corpus, and we explore under which conditions fusion is valuable. We evaluate our results in terms of log likelihood ratio cost (Cllr) and equal error rate (EER). We show that fusion can be beneficial, especially in the case of intercepted phone calls with noise in the background.
Brno University of Technology Boˇzetˇechova 2 Brno 61266 Czech Republic
Netherlands Forensic Institute PO Box 24044 2490 AA The Hague the Netherlands
University of Amsterdam Science Park 904 1098 XH Amsterdam the Netherlands
Citace poskytuje Crossref.org