Analysis of Public Sentiment Towards Goverment Efforts to Break the Chain of Covid-19 Transmission in Indonesia Using CNN and Bidirectional LSTM
Abstract
COVID-19 is a new disease that has a negatively impacts in Indonesia, so the government is taking several measures to suppress the spread of COVID-19, such as new normal, social distancing, health protocols fines, and COVID-19 vaccination. The government's handling efforts have reaped a variety of negative to positive responses from the public on social media, so this study aims to determine the effectiveness of the government's efforts by analyzing public sentiment using the Deep Learning method with 1,875 training datasets consisting of four types government efforts and taken from various media social. The use of Deep Learning begins with testing several Deep Learning architectures to determine the best architecture for predicting data. The architectures tested include CNN and Bi-LSTM, where from these tests, Bi-LSTM outperforms CNN with the best performance achieving the accuracy of 97.34% and 97.33% for precision, recall, and F1-score. The results of public sentiment analysis show that social distancing efforts are considered the most effective by obtaining the most positive sentiments by 33.93%, while the effort to health protocol fines is considered lacking because it obtains the most negative sentiment of 35.64%, so the government must continue to enforce social distancing and optimize other efforts that are still considered ineffective.
Downloads
References
F. He, Y. Deng, dan W. Li, “Coronavirus disease 2019: What we know?,” J. Med. Virol., vol. 92, no. 7, hal. 719–725, 2020, doi: 10.1002/jmv.25766.
A. Susilo et al., “Coronavirus Disease 2019: Tinjauan Literatur Terkini,” J. Penyakit Dalam Indones., vol. 7, no. 1, hal. 45, 2020, doi: 10.7454/jpdi.v7i1.415.
B. Laurensz dan Eko Sediyono, “Analisis Sentimen Masyarakat terhadap Tindakan Vaksinasi dalam Upaya Mengatasi Pandemi Covid-19,” J. Nas. Tek. Elektro dan Teknol. Inf., vol. 10, no. 2, hal. 118–123, 2021, doi: 10.22146/jnteti.v10i2.1421.
A. Sari, F. V., & Wibowo, “Analisis Sentimen Pelanggan Toko Online Jd. Id Menggunakan Metode Naïve Bayes Classifier Berbasis Konversi Ikon Emosi,” Simetris J. Tek. Mesin, Elektro dan Ilmu Komput., vol. 2, no. 2, hal. 681–686, 2019, [Daring]. Tersedia pada: https://jurnal.umk.ac.id/index.php/simet/article/view/3487.
M. Z. Rahman, Y. A. Sari, dan N. Yudistira, “Analisis Sentimen Tweet COVID-19 menggunakan Word Embedding dan Metode Long Short-Term Memory ( LSTM ),” vol. 5, no. 11, hal. 5120–5127, 2021.
T. T. Mengistie dan D. Kumar, “Deep Learning Based Sentiment Analysis on COVID-19 Public Reviews,” 3rd Int. Conf. Artif. Intell. Inf. Commun. ICAIIC 2021, no. May, hal. 444–449, 2021, doi: 10.1109/ICAIIC51459.2021.9415191.
Merinda Lestandy, Abdurrahim Abdurrahim, dan Lailis Syafa’ah, “Analisis Sentimen Tweet Vaksin COVID-19 Menggunakan Recurrent Neural Network dan Naïve Bayes,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 5, no. 4, hal. 802–808, 2021, doi: 10.29207/resti.v5i4.3308.
K. N. Alam et al., “Deep Learning-Based Sentiment Analysis of COVID-19 Vaccination Responses from Twitter Data,” Comput. Math. Methods Med., vol. 2021, 2021, doi: 10.1155/2021/4321131.
M. J. Denny dan A. Spirling, “Text Preprocessing For Unsupervised Learning: Why It Matters, When It Misleads, And What To Do About It,” Polit. Anal., vol. 26, no. 2, hal. 168–189, Apr 2018, doi: 10.1017/pan.2017.44.
F. Ridzuan dan W. M. N. Wan Zainon, “A Review on Data Cleansing Methods for Big Data,” Procedia Comput. Sci., vol. 161, hal. 731–738, 2019, doi: 10.1016/j.procs.2019.11.177.
I. C. Sari dan Y. Ruldeviyani, “Sentiment Analysis of the Covid-19 Virus Infection in Indonesian Public Transportation on Twitter Data: A Case Study of Commuter Line Passengers,” 2020 Int. Work. Big Data Inf. Secur. IWBIS 2020, hal. 23–28, 2020, doi: 10.1109/IWBIS50925.2020.9255531.
A. H. Dyo fatra, N. H. Hayatin, dan C. S. K. Aditya, “Analisa Sentimen Tweet Berbahasa Indonesia Dengan Menggunakan Metode Lexicon Pada Topik Perpindahan Ibu Kota Indonesia,” J. Repos., vol. 2, no. 7, hal. 977, 2020, doi: 10.22219/repositor.v2i7.937.
Y. A. Alhaj, J. Xiang, D. Zhao, M. A. A. Al-Qaness, M. Abd Elaziz, dan A. Dahou, “A Study of the Effects of Stemming Strategies on Arabic Document Classification,” IEEE Access, vol. 7, hal. 32664–32671, 2019, doi: 10.1109/ACCESS.2019.2903331.
D. T. Hermanto, A. Setyanto, dan E. T. Luthfi, “Algoritma LSTM-CNN untuk Binary Klasifikasi dengan Word2vec pada Media Online,” Creat. Inf. Technol. J., vol. 8, no. 1, hal. 64, 2021, doi: 10.24076/citec.2021v8i1.264.
A. Perwira, J. Dwitama, dan K. Kunci, “Deteksi Ujaran Kebencian Pada Twitter Bahasa Indonesia Menggunakan Machine Learning : Reviu Literatur,” vol. 1, hal. 31–39, 2021.
N. A. Salsabila, Y. Ardhito, W. Ali, A. Septiandri, dan A. Jamal, “Colloquial Indonesian Lexicon,” 2018 Int. Conf. Asian Lang. Process., hal. 226–229, 2018.
A. W. Pradana dan M. Hayaty, “The Effect of Stemming and Removal of Stopwords on the Accuracy of Sentiment Analysis on Indonesian-language Texts,” Kinet. Game Technol. Inf. Syst. Comput. Network, Comput. Electron. Control, vol. 4, no. 3, hal. 375–380, 2019, doi: 10.22219/kinetik.v4i4.912.
M. D. Purbolaksono, F. D. Reskyadita, dan A. A. Suryani, “Indonesian-text-classification-using-back-propagation-and-sastrawi-stemming-analysis-with-information-gain-for-selection-feature2020International-Journal-on-Advanced-Science-Engineering-and-Information-TechnologyOp.pdf,” vol. 10, no. 1, hal. 234–238, 2020.
Rianto, A. B. Mutiara, E. P. Wibowo, dan P. I. Santosa, “Improving the accuracy of text classification using stemming method, a case of non-formal Indonesian conversation,” J. Big Data, vol. 8, no. 1, hal. 1–17, 2021, doi: 10.1186/s40537-021-00413-1.
G. Mayun, “COVID-19 Dataset,” vol. 1, 2022, doi: 10.17632/W88VRHRFP7.1.
T. Shaikhina dan N. A. Khovanova, “Handling limited datasets with neural networks in medical applications: A small-data approach,” Artif. Intell. Med., vol. 75, hal. 51–63, 2017, doi: 10.1016/j.artmed.2016.12.003.
I.-C. Yeh, “MODELING OF STRENGTH OF HIGH-PERFORMANCE CONCRETE USING ARTIFICIAL NEURAL NETWORKS,” Cem. Concr. Res. Vol. 28, No. 12, pp. 1797–1808, 1998, vol. 43, no. March, hal. 1–9, 1998.
I. M. Mika Parwita dan D. Siahaan, “Classification of Mobile Application Reviews using Word Embedding and Convolutional Neural Network,” Lontar Komput. J. Ilm. Teknol. Inf., vol. 10, no. 1, hal. 1, 2019, doi: 10.24843/lkjiti.2019.v10.i01.p01.
I. M. M. Parwita dan D. Siahaan, “Classification of Mobile Application Reviews using Word Embedding and Convolutional Neural Network,” vol. 10, no. 1, hal. 1–8, 2019.
W. López, J. Merlino, dan P. Rodríguez-Bocca, “Learning semantic information from Internet Domain Names using word embeddings,” Eng. Appl. Artif. Intell., vol. 94, no. July, hal. 103823, Sep 2020, doi: 10.1016/j.engappai.2020.103823.
X. Yang, C. Macdonald, dan I. Ounis, “Using word embeddings in Twitter election classification,” Inf. Retr. J., vol. 21, no. 2–3, hal. 183–207, 2018, doi: 10.1007/s10791-017-9319-5.
R. A. Stein, P. A. Jaques, dan J. F. Valiati, “An analysis of hierarchical text classification using word embeddings,” Inf. Sci. (Ny)., vol. 471, hal. 216–232, 2019, doi: 10.1016/j.ins.2018.09.001.
Z. H. Kilimci, “Sentiment analysis based direction prediction in bitcoin using deep learning algorithms and word embedding models,” Int. J. Intell. Syst. Appl. Eng., vol. 8, no. 2, hal. 60–65, 2020, doi: 10.18201/ijisae.2020261585.
B. Wang, A. Wang, F. Chen, Y. Wang, dan C. C. J. Kuo, “Evaluating word embedding models: Methods and experimental results,” APSIPA Trans. Signal Inf. Process., vol. 8, no. 2019, 2019, doi: 10.1017/ATSIP.2019.12.
I. K. Sastrawan, I. P. A. Bayupati, D. Made, dan S. Arsa, “Detection of fake news using deep learning CNN – RNN based methods,” ICT Express, no. xxxx, 2021, doi: 10.1016/j.icte.2021.10.003.
O. Sudana, I. P. A. Bayupati, dan D. G. Yudiana, “Classification of Maturity Level of the Mangosteen using the Convolutional Neural Network (CNN) Method,” Int. J. Adv. Sci. Technol., vol. 135, hal. 37–48, 2020, doi: 10.33832/ijast.2020.135.04.
X. Zhang, L. Wang, dan Y. Su, “Visual place recognition: A survey from deep learning perspective,” Pattern Recognit., hal. 107760, Nov 2020, doi: 10.1016/j.patcog.2020.107760.
E. W. Prasetyo, N. Hidetaka, D. A. Prasetya, W. Dirgantara, dan H. F. Windi, “Spatial Based Deep Learning Autonomous Wheel Robot Using CNN,” Lontar Komput. J. Ilm. Teknol. Inf., vol. 11, no. 3, hal. 167, 2020, doi: 10.24843/lkjiti.2020.v11.i03.p05.
N. P. Sutramiani, N. Suciati, dan D. Siahaan, “MAT-AGCA: Multi Augmentation Technique on small dataset for Balinese character recognition using Convolutional Neural Network,” ICT Express, no. xxxx, 2021, doi: 10.1016/j.icte.2021.04.005.
G. Rao, W. Huang, Z. Feng, dan Q. Cong, “LSTM with sentence representations for document-level sentiment classification,” Neurocomputing, vol. 308, hal. 49–57, Sep 2018, doi: 10.1016/j.neucom.2018.04.045.
G. Liu dan J. Guo, “Bidirectional LSTM with attention mechanism and convolutional layer for text classification,” Neurocomputing, vol. 337, hal. 325–338, Apr 2019, doi: 10.1016/j.neucom.2019.01.078.
M. Hasan, M. M. Islam, M. I. I. Zarif, dan M. M. A. Hashem, “Attack and anomaly detection in IoT sensors in IoT sites using machine learning approaches,” Internet of Things (Netherlands), vol. 7, hal. 100059, 2019, doi: 10.1016/j.iot.2019.100059.
Ž. Vujović, “Classification Model Evaluation Metrics,” Int. J. Adv. Comput. Sci. Appl., vol. 12, no. 6, hal. 599–606, 2021, doi: 10.14569/IJACSA.2021.0120670.
Kontan.co.id, “Data penerima bansos Juli 2021 bisa dicek di laman cekbansos.kemensos.go.id,” 2021. https://nasional.kontan.co.id/news/data-penerima-bansos-juli-2021-bisa-dicek-di-laman-cekbansoskemensosgoid (diakses Mar 23, 2022).
Samsir, Kusmanto, Abdul Hakim Dalimunthe, Rahmad Aditiya, and Ronal Watrianthos, “Implementation Naïve Bayes Classification for Sentiment Analysis on Internet Movie Database,” Building of Informatics, Technology and Science (BITS), vol. 4, no. 1, pp. 1–6, Jun. 2022
R. Watrianthos, M. Giatman, W. Simatupang, R. Syafriyeti, and N. K. Daulay, “Analisis Sentimen Pembelajaran Campuran Pada Twitter Data Menggunakan Algoritma Naïve Bayes,” Analisis Sentimen Pembelajaran Campuran Pada Twitter Data Menggunakan Algoritma Naïve Bayes, vol. 6, no. 1, pp. 166–170, 2022, doi: http://dx.doi.org/10.30865/mib.v6i1.3383
liputan6, “Vaksinasi COVID-19 per 30 Maret 2021: Penerima Dosis Pertama 7.729.582, Kedua 3.500.264 - Health Liputan6.com,” 2021. https://www.liputan6.com/health/read/4519570/vaksinasi-covid-19-per-30-maret-2021-penerima-dosis-pertama-7729582-kedua-3500264 (diakses Mar 23, 2022).
Samsir, Ambiyar, U. Verawardina, F. Edi, and R. Watrianthos, “Analisis Sentimen Pembelajaran Daring Pada Twitter di Masa Pandemi COVID-19,” JURNAL MEDIA INFORMATIKA BUDIDARMAJURNAL MEDIA INFORMATIKA BUDIDARMA, vol. 5, no. 10, pp. 174–179, 2021, doi: 10.30865/mib.v4i4.2293.
Kementerian Komunikasi dan Informatika Republik Indonesia, “Mulai 3 Juli, Pemerintah Berlakukan PPKM Darurat di Jawa-Bali,” 2021. https://www.kominfo.go.id/content/detail/35388/mulai-3-juli-pemerintah-berlakukan-ppkm-darurat-di-jawa-bali/0/berita (diakses Mar 23, 2022).
covid19.go.id, “[SALAH] Video ‘Potensi Bahaya Vaksin COVID-19’ - Hoax Buster | Covid19.go.id,” 2021. https://covid19.go.id/p/hoax-buster/salah-video-potensi-bahaya-vaksin-covid-19 (diakses Mar 23, 2022).
A. Arif, “Kasus Covid-19 Global Turun, Indonesia Justru Naik - Kompas.id,” 2021. https://www.kompas.id/baca/ilmu-pengetahuan-teknologi/2021/02/04/kasus-covid-19-global-turun-indonesia-justru-naik (diakses Jun 24, 2022).
Copyright (c) 2022 Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
