Implementasi Vision Transformer (ViT) untuk Klasifikasi Citra Wajah Asli dan Hasil Manipulasi Artificial Intelligence

Main Article Content

Winesti Widasari
Alun Sujjada
Ivana Lucia Kharisma

Abstract

The rapid advancement of Artificial Intelligence (AI) has enabled the creation of highly realistic manipulated facial images, making it increasingly difficult to distinguish them from authentic images. This study aims to implement the Vision Transformer (ViT) model for classifying real and AI-generated facial images. An experimental research approach was employed using a publicly available dataset consisting of real and fake face images. The preprocessing stage included image resizing, normalization, and data augmentation to improve model generalization. The dataset was divided into training, validation, and testing subsets before the training process. The Vision Transformer Base Patch16-224 model was fine-tuned to learn the global visual features of facial images. Model performance was evaluated using accuracy, precision, recall, F1-score, confusion matrix, and ROC curve. The experimental results demonstrate that the Vision Transformer model effectively distinguishes authentic facial images from AI-generated manipulated images with high classification performance. These findings indicate that Vision Transformer is a promising approach for supporting digital image authenticity verification and enhancing digital security systems against AI-generated image manipulation.

Article Details

Section
Articles

References

Y. Lecun, Y. Bengio, and G. Hinton, “Deep learning,” May 27, 2015, Nature Publishing Group. doi: 10.1038/nature14539.

H. Sharma, “Detection of AI-Generated Images Using Deep Learning.”

F. Badri, M. Taqijuddin Alawiy, and E. M. Yuniarno, “DEEP LEARNING ARCHITECTURE BASED ON CONVOLUTIONAL NEURAL NETWORK (CNN) ON ANIMAL IMAGE CLASSIFICATION,” vol. 12, no. 2, 2023.

F. Folorunsho and B. F. Boamah, “DEEPFAKE TECHNOLOGY AND ITS IMPACT: ETHICAL CONSIDERATIONS, SOCIETAL DISRUPTIONS, AND SECURITY THREATS IN AI-GENERATED MEDIA,” INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY AND MANAGEMENT INFORMATION SYSTEMS, vol. 16, no. 1, pp. 1060–1080, Feb. 2025, doi: 10.34218/ijitmis_16_01_076.

B. Chesney and D. Citron, “Deep fakes: A looming challenge for privacy, democracy, and national security,” Calif. Law Rev., vol. 107, no. 6, pp. 1753–1820, 2019, doi: 10.15779/Z38RV0D15J.

H. Dang, F. Liu, J. Stehouwer, X. Liu, and A. Jain, “On the Detection of Digital Face Manipulation.”

Hao Lin Wenmin Huang Weiqi Luo Wei Lu, “DeepFake detection with multi-scale convolution and vision transformer,” Digit. Signal Process., vol. 134, 2023.

D. Das, M. Yahan, T. Zaman, and M. R. Bayesh, “Edge-Enhanced Vision Transformer Framework for Accurate AI-Generated Image Detection A R T I C L E I N F O.” [Online]. Available: https://ssrn.com/abstract=5556795

A. Dosovitskiy et al., “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale,” Jun. 2021, [Online]. Available: http://arxiv.org/abs/2010.11929

B. Ghita, I. Kuzminykh, A. Usama, T. Bakhshi, and J. Marchang, “Deepfake Image Detection using Vision Transformer Models,” IEEE. [Online]. Available: http://shura.shu.ac.uk/information.html

E. M. Dharma, N. M. S. Iswari, and I. P. R. A. Arimbawa, “DeepFake Image Detection Using Convolutional Neural Network with EfficientNet Architecture,” G-Tech: Jurnal Teknologi Terapan, vol. 9, no. 4, pp. 1829–1838, Oct. 2025, doi: 10.70609/g-tech.v9i4.7727.

M. S. A. Aria, C. Slamet, and M. D. Firdaus, “Klasifikasi Fake dan Real Menggunakan Vision Transformer dan EfficientNet-B0 pada Gambar Asli dan Generatif AI,” SMATIKA JURNAL, vol. 15, no. 01, pp. 179–192, Jun. 2025, doi: 10.32664/smatika.v15i01.1531.

H. Rumapea, “Evaluasi Kinerja CNN dan Vision Transformer pada Klasifikasi Citra Resolusi Tinggi Berbasis Deep Learning,” METHOMIKA Jurnal Manajemen Informatika dan Komputerisasi Akuntansi, vol. 9, no. 2, pp. 372–379, Oct. 2025, doi: 10.46880/jmika.Vol9No2.pp372-379.

L. El Mouna, M. Cheikh Tourad, M. Farouk Nanne, H. Silkan, and Y. Hanyf, “AI-Generated Fake Image Detection using Pre-trained CNN Models.”

C. Shorten and T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,” J. Big Data, vol. 6, no. 1, Dec. 2019, doi: 10.1186/s40537-019-0197-0.