IJITEE (International Journal of Information Technology and Electrical Engineering)
Vol 4, No 1 (2020): March 2020

Improving Phoneme to Viseme Mapping for Indonesian Language

Anung Rachman (Universitas Gadjah Mada Institut Seni Indonesia (ISI) Surakarta)
Risanuri Hidayat (Universitas Gadjah Mada)
Hanung Adi Nugroho (Universitas Gadjah Mada)



Article Info

Publish Date
09 Sep 2020

Abstract

The lip synchronization technology of animation can run automatically through the phoneme-to-viseme map. Since the complexity of facial muscles causes the shape of the mouth to vary greatly, phoneme-to-viseme mapping always has challenging problems. One of them is the allophone vowel problem. The resemblance makes many researchers clustering them into one class. This paper discusses the certainty of allophone vowels as a variable of the phoneme-to-viseme map. Vowel allophones pre-processing as a proposed method is carried out through formant frequency feature extraction methods and then compared by t-test to find out the significance of the difference. The results of pre-processing are then used to reference the initial data when building phoneme-to-viseme maps. This research was conducted on maps and allophones of the Indonesian language. Maps that have been built are then compared with other maps using the HMM method in the value of word correctness and accuracy. The results show that viseme mapping preceded by allophonic pre-processing makes map performance more accurate when compared to other maps.

Copyrights © 2020






Journal Info

Abbrev

ijitee

Publisher

Subject

Electrical & Electronics Engineering

Description

IJITEE (International Journal of Information Technology and Electrical Engineering), with registered number ISSN 2550-0554 (Online), is a peer-reviewed journal published four times a year (March, June, September, December) by Department of Electrical engineering and Information Technology, Faculty ...