Jurnal Infra
Vol 5, No 1 (2017)

Pembuatan Aplikasi Mobile Augmented Reality dengan Scene Recognition Memanfaatkan Convolutional Neural Network

Joseph Nathanael Witanto (Program Studi Teknik Informatika)
Gregorius Satia Budhi (Program Studi Teknik Informatika)
Liliana Liliana (Program Studi Teknik Informatika)



Article Info

Publish Date
31 Jan 2017

Abstract

The development of smartphone technology and the need of people to gather information of places open chance to utilize augmented reality to help people get the information of a scene and see the scene through camera at the same time. The sensor-based AR system depends on GPS which is not always available. This research uses AR system using convolutional neural network for scene recognition.There are 45 network variations that will be tested to find the best combination. The different parameters that will be used are architecture, initialization method, and activation function that will be used. The architectures used are GoogLeNet and 2 variations of simplified GoogLeNet. The initialization methods used are random-based (Xavier and MSRA) and pretrained weights. The activation functions used are ReLU, PReLU, and ELU. The data augmentations used during training are random cropping, color balance, rotation, blur, sharpen, and brightness-contrast manipulation.Out of 1649 photos from 12 scene categories, 321 photos will be used for testing with variations on rotation (30 degrees interval), blur, sharpen, brightness, and contrast. Network with initialization method using finetuning on all areas of network and PReLU activation function has better average accuration.

Copyrights © 2017