jurnal teknik informatika dan sistem informasi
Vol 8 No 1 (2022): JuTISI

BESKlus : BERT Extractive Summarization with K-Means Clustering in Scientific Paper

Samosir, Feliks Victor Parningotan (Unknown)
Toba, Hapnes (Unknown)
Ayub, Mewati (Unknown)



Article Info

Publish Date
29 Apr 2022

Abstract

This study aims to propose methods and models for extractive text summarization with contextual embedding. To build this model, a combination of traditional machine learning algorithms such as K-Means Clustering and the latest BERT-based architectures such as Sentence-BERT (SBERT) is carried out. The contextual embedding process will be carried out at the sentence level by SBERT. Embedded sentences will be clustered and the distance calculated from the centroid. The top sentences from each cluster will be used as summary candidates. The dataset used in this study is a collection of scientific journals from NeurIPS. Performance evaluation carried out with ROUGE-L gave a result of 15.52% and a BERTScore of 85.55%. This result surpasses several previous models such as PyTextRank and BERT Extractive Summarizer. The results of these measurements prove that the use of contextual embedding is very good if applied to extractive text summarization which is generally done at the sentence level.

Copyrights © 2022






Journal Info

Abbrev

jutisi

Publisher

Subject

Computer Science & IT

Description

Jurnal Teknik Informatika dan Sistem Informasi (JuTISI) menerima topik-topik sebagai berikut, namun tidak terbatas pada : Artificial Intelligence • Business Intelligence • Cloud & Grid Computing • Computer Networking & Security • Datawarehouse & Datamining • Decision Support System • ...