Automated Detection of Container-based Audio Forgery Using Crowdsourcing for Dataset Building

Authors

  • Homin Son
  • Sung Won Baek
  • Jae Wan Park Soongsil University

DOI:

https://doi.org/10.34306/att.v6i1.383

Keywords:

Digital Audio Forensics, Forgery Detection, Mobile Crowdsourcing, Audio Dataset, Container-Based Methods

Abstract

This research paper introduces a new approach for detecting digital audio file forgeries, highlighting entrepreneurship spirit through innovation and market adaptability. It utilizes a cyclical system aided by mobile crowdsourcing to collect a comprehensive dataset of smartphone recordings, demonstrating an entrepreneurship approach to leveraging technology for scalable solutions. Digital forgery, an area ripe for entrepreneurship investment, is becoming increasingly accessible, making it challenging to detect manipulated audio files. This new method emphasizes the utility of metadata and file structure analysis and is scalable, reflecting an entrepreneurship mindset in creating adaptable and sustainable solutions. The researchers developed a mobile web-based prototype system to collect diverse audio data and automatically detect forgeries, showcasing their initiative and innovative thinking. They also conducted scenario-based testing to validate the effectiveness of their methodology, a step that underscores the entrepreneurship value of practical validation. This approach has the potential to significantly advance digital forensic practices by enabling broader detection of manipulated audio files, opening avenues for entrepreneurship ventures in digital security. The collected dataset will be made publicly available and serve as a valuable resource for future forensic investigations, encouraging entrepreneurship collaboration and knowledge sharing. The paper lays the groundwork for future research in expanding the scope of digital forensics, fostering technological innovation, and enhancing participatory models for data collection, all of which are essential elements in entrepreneurship ecosystems.

References

Q. L. Huynh and V. K. NGUYEN, “Managerial accounting system between corporate governance and knowledge management,” Access Journal, vol. 5, no. 2, pp. 306–320, 2024.

D. S. S. Wuisan, R. A. Sunardjo, Q. Aini, N. A. Yusuf, and U. Rahardja, “Integrating artificial intelligence in human resource management A smartpls approach for entrepreneurial success,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 3, pp. 334–345, 2023.

B. Ustubioglu, G. Tahaoglu, and G. Ulutas, “Detection of audio copy move forgery with novel feature matching on mel spectrogram,” Expert Systems with Applications, vol. 213, p. 118963, 2023.

A. Ustubioglu, B. Ustubioglu, and G. Ulutas, “Mel spectrogram based audio forgery detection using cnn,” Signal, Image and Video Processing, vol. 17, pp. 2211–2219, 2023.

Y. Son and J. W. Park, “Detecting forged audio files using “mixed paste” command A deep learning approach based on korean phonemic features,” Sensors, vol. 24, p. 1872, 3 2024.

O. Candra, A. Chammam, U. Rahardja, A. A. Ramirez-Coronel, A. A. Al-Jaleel, I. H. Al-Kharsan, I. Muda, G. B. Derakhshani, and M. M. Rezai, “Optimal participation of the renewable energy in microgrids with load management strategy,” Environmental and Climate Technologies, vol. 27, no. 1, pp. 56–66, 2023.

K.W. Kim, “A study on the forensic application of smartphone recording database,” Journal of Digital Forensics, vol. 15, pp. 26–42, 2021. [Online]. Available: https://kdfs.jams.or.kr,

P. R. Bevinamarad and M. S. Shirldonkar, “Audio forgery detection techniques Present and past review,” in Proceedings of the 4th International Conference on Trends in Electronics and Informatics, ICOEI 2020, 2020, pp. 613–618.

Q. Aini, U. Rahardja, D. Manongga, I. Sembiring, M. Hardini, and H. Agustian, “Iot based indoor air quality using esp32,” in 2022 IEEE Creative Communication and Innovative Technology (ICCIT). IEEE, 2022, pp. 1–5.

M. A. Qamhan, H. Altaheri, A. H. Meftah, G. Muhammad, and Y. A. Alotaibi, “Digital audio forensics Microphone and environment classification using deep learning,” IEEE Access, vol. 9, pp. 62 719–62 733, 2021.

D. U. Leonzio, L. Cuccovillo, P. Bestagini, M. Marcon, P. Aichroth, and S. Tubaro, “Audio splicing detection and localization based on acquisition device traces,” IEEE Transactions on Information Forensics and Security, vol. 18, pp. 4157–4172, 2023.

C. Zeng, S. Kong, Z. Wang, K. Li, and Y. Zhao, “Digital audio tampering detection based on deep temporal spatial features of electrical network frequency,” Information (Switzerland), vol. 14, p. 253, 2023.

D. Apriani, V. T. Devana, A. P. Sagala, P. A. Sunarya, U. Rahardja, and E. P. Harahap, “Security using blockchain based otp with the concept of iot publish/subscribe,” in AIP Conference Proceedings, vol. 2808, no. 1. AIP Publishing, 2023.

U. Rahardja, A. Sari, A. H. Alsalamy, S. Askar, A. H. R. Alawadi, and B. Abdullaeva, “Tribological properties assessment of metallic glasses through a genetic algorithm optimized machine learning model,” Metals and Materials International, pp. 1–11, 2023.

C. Grigoras and J. M. Smith, “Large scale test of digital audio file structure and format for forensic analysis,” in Proceedings of the AES International Conference, vol. 2017-June, 2017, pp. 1–6.

D. P. Gangwar and A. Pathania, “Authentication of digital audio recording using files signature and metadata properties” International Journal of Engineering Applied Sciences and Technology, vol. 5, pp. 162–165, 2020.

J. Zeng, Q. Lian, and S. Shi, “Forensic originality identification of iphone s voice memos,” in Journal of Physics: Conference Series, vol. 1345, 2019, pp. 52–53.

B. E. Koenig and D. S. Lacey, “Forensic authenticity analyses of the metadata in reencoded m4a iphone ios 12.1.2 voice memos files,” in Proceedings of the AES International Conference, vol. 2019-June, 2019, pp. 1–8.

N. I. Park, J. W. Lee, K. S. Shim, J. S. Byun, and O. Y. Jeon, “A method of forensic authentication of audio recordings generated using the voice memos application in the iphone,” Forensic Science International, vol. 320, p. 110702, 2021.

M. Michalek, “The characteristics of popular audio recording applications installed on smartphones with an android operating system in relation to forensic audio analyses” Z Zagadnien Nauk Sadowych, vol. 120, pp. 335–361, 2019.

J. W. Park, W. J. Kwak, and J. S. Lee, “A study on forgery techniques of smartphone voice recording file structure and metadata,” The Journal of the Convergence on Culture Technology (JCCT), vol. 8, pp. 807–812, 2022. [Online]. Available: http://dx.doi.org/10.17703/JCCT.2022.8.6.807

S. W. Baek, H. Son, and J. W. Park, “Limitations of analyzing metadata and file structure of audio files for legal evidence Focusing on samsung smartphones” The Journal of the Convergence on Culture Technology (JCCT), vol. 9, pp. 1103–1109, 2023. [Online]. Available: http://dx.doi.org/10.17703/JCCT.2023.9.6.1103

T. Hariguna, B. B. Madon, and U. Rahardja, “User intention to adopt blockchain certificate authentication technology towards education” in AIP Conference Proceedings, vol. 2808, no. 1. AIP Publishing, 2023.

T. Holwerda. (2023) Nearly 500 brands exited smartphone market during 2017-2023. https://www.osnews.com/story/137210/nearly-500-brands-exited-smartphone-market-during-2017- 2023/. Accessed:(30 March 2024).

S. I. Al-Hawary, J. R. N. Alvarez, A. Ali, A. K. Tripathi, U. Rahardja, I. H. Al-Kharsan, R. M. RomeroParra, H. A. Marhoon, V. John, and W. Hussian, “Multiobjective optimization of a hybrid electricity generation system based on waste energy of internal combustion engine and solar system for sustainable environment,” Chemosphere, vol. 336, p. 139269, 2023.

Y. Son, W. J. Kwak, and J. W. Park, “Spectrogram dataset of korean smartphone audio files forged using the “mix paste” command,” Data, vol. 8, p. 183, 12 2023.

R. Widayanti, M. H. R. Chakim, C. Lukita, U. Rahardja, and N. Lutfiani, “Improving recommender systems using hybrid techniques of collaborative filtering and content based filtering,” Journal of Applied Data Sciences, vol. 4, no. 3, pp. 289–302, 2023.

M. Zakariah, M. K. Khan, and H. Malik, “Digital multimedia audio forensics past, present and future,” Multimedia Tools and Applications, vol. 77, pp. 1009–1040, 2018.

C. Lukita, N. Lutfiani, A. R. S. Panjaitan, U. Rahardja, M. L. Huzaifah et al., “Harnessing the power of random forest in predicting startup partnership success,” in 2023 Eighth International Conference on Informatics and Computing (ICIC). IEEE, 2023, pp. 1–6.

U. Rahardja, P. A. Sunarya, N. Lutfiani, M. Hardini, and H. R. Dananjaya, “Analysis of renewable energy utilization using solar power technology in eliminating microplastic emissions,” in 2022 IEEE Creative Communication and Innovative Technology (ICCIT). IEEE, 2022, pp. 1–6.

E. P. Harahap, E. Sediyono, Z. A. Hasibuan, U. Rahardja, and I. N. Hikam, “Artificial intelligence in tourism environments A systematic literature review,” 2022 IEEE Creative Communication and Innovative Technology (ICCIT), pp. 1–7, 2022.

H. Chen and J. Ren, “The effect of influencer persona on consumer decision making towards short-form video ads from the angle of narrative persuasion,” in International Conference on Human-Computer Interaction. Springer, 2022, pp. 223–234.

J. Feldkamp, “The rise of tiktok The evolution of a social media platform during covid 19,” Digital responses to Covid-19: Digital innovation, transformation, and entrepreneurship during pandemic outbreaks, pp. 73–85, 2021.

R. Z. Rasyad, R. M. Mayasari, and M. N. Madani, “New era normal Manajemen pemasaran hotel untuk penjagaan pelanggan dalam,” ADI Bisnis Digital Interdisiplin Jurnal, vol. 4, no. 2, pp. 94–98, 2023.

O. Bazaluk, M. A. Rahman, N. M. Zayed, M. Faisal-E-Alam, V. Nitsenko, and L. Kucher, “Crowdsourcing review the crowd workers perspective,” Journal of Industrial and Business Economics, pp. 1–20, 2024.

U. Kustiawan et al., “Pengaruh kepemimpinan autentik dan kepercayaan kepemimpinan terhadap perilaku kewarganegaraan organisasi (ocb) dan kinerja karyawan Indonesia,” ADI Bisnis Digital Interdisiplin Jurnal, vol. 4, no. 2, pp. 64–69, 2023.

F. Serafini and S. F. Reid, “Multimodal content analysis expanding analytical approaches to content analysis,” Visual Communication, vol. 22, no. 4, pp. 623–649, 2023.

L. Nassar and F. Karray, “Overview of the crowdsourcing process,” Knowledge and Information Systems, vol. 60, pp. 1–24, 2019.

I. Khong, “The circular economy s performance and the impact of digitalization,” International Transactions on Education Technology, vol. 2, no. 1, pp. 18–23, 2023.

R. Simpson, K. R. Page, and D. D. Roure, “Zooniverse Observing the worlds largest citizen science platform,” in WWW 2014 Companion - Proceedings of the 23rd International Conference on World Wide Web, 2014, pp. 1049–1054.

R. F. Sari, A. F. Rochim, E. Tangkudung, A. Tan, and T. Marciano, “Location based mobile application software development Review of waze and other apps,” Advanced Science Letters, vol. 23, pp. 2028– 2032, 2017.

J. Nugent. (2019) Migrate to mobile with ebird breadcrumb. https://www.nsta.org/scienceteacher/science-teacher novemberdecember-2019/migrate-mobile-ebird/. Accessed:(30 March 2024).

R. Widayanti and L. Meria, “Business modeling innovation using artificial intelligence technology,” International Transactions on Education Technology, vol. 1, no. 2, pp. 95–104, 2023.

A. Dudhat and V. Agarwal, “Indonesias digital economys development,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 4, no. 2, pp. 109–118, 2023.

T. A. D. Lael and D. A. Pramudito, “Use of data mining for the analysis of consumer purchase patterns with the fpgrowth algorithm on motor spare part sales transactions data,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 4, no. 2, pp. 128–136, 2023.

E. D. Safitri, S. R. P. Junaedi, and A. Priono, “Swot analysis is used in the startup business development strategy,” Startupreneur Business Digital (SABDA Journal), vol. 2, no. 2, pp. 136–142, 2023.

Y. Wu and G. Cao, “Videomec A metadata enhanced crowdsourcing system for mobile videos,” in Proceedings - 2017 16th ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2017, 2017, pp. 143–154.

Z. Cheng and Y. Li, “Like, comment, and share on tiktok Exploring the effect of sentiment and secondperson view on the user engagement with tiktok news videos,” Social Science Computer Review, vol. 42, no. 1, pp. 201–223, 2024.

Y. Wang, X. Jia, Q. Jin, and J. Ma, “Mobile crowdsourcing Architecture, applications, and challenges,” in 2015 IEEE 12th Intl Conf on Ubiquitous Intelligence and Computing and 2015 IEEE 12th Intl Conf on Autonomic and Trusted Computing and 2015 IEEE 15th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom), 2015, pp. 1127–1132.

M. Allahbakhsh, B. Benatallah, A. Ignjatovic, H. R. Motahari-Nezhad, E. Bertino, and S. Dustdar, “Quality control in crowdsourcing systems Issues and directions,” IEEE Internet Computing, vol. 17, pp. 76–81, 2013.

R. Nakatsu and E. Grossman, “Designing effective user interfaces for crowdsourcing An exploratory study,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8016 LNCS, 2013, pp. 221–229.

G. Ravi, M. F. Nur, and A. Kiswara, “Analyzing changes in traditional industries Challenges and opportunities in the e commerce era,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 5, no. 1, pp. 39–49, 2023.

E. Dollan, B. D. K. Ramadhan et al., “Assessing the outcomes of circular economy and waste management partnerships between indonesia and denmark,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 5, no. 1, pp. 76–83, 2023.

U. Rusilowati, F. P. Oganda, R. Rahardja, T. Nurtino, and E. Aimee, “Innovation in smart marketing The role of technopreneurs in driving educational improvement,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 3, pp. 305–318, 2023.

Wondershare, “Democreator.” [Online]. Available: https://dc.wondershare.kr/

N. Sutisna et al., “Implementasikan sistem informasi dalam mendukung perilaku pembelian terhadap keputusan pembelian ecommerce,” Jurnal MENTARI: Manajemen, Pendidikan dan Teknologi Informasi, vol. 2, no. 1, pp. 20–30, 2023.

Mediaarea, “Mediainfo.” [Online]. Available: https://mediaarea.net/en/MediaInfo

A. E. Widjaja, S. Yumna, A. Ashar et al., “Model manajemen pemasaran strategis baru untuk kekhususan ecommerce dalam rantai pasokan,” Jurnal MENTARI: Manajemen, Pendidikan dan Teknologi Informasi, vol. 2, no. 1, pp. 65–72, 2023.

M. H. R. Chakim, P. A. Sunarya, V. Agarwal, I. N. Hikam et al., “Village tourism empowerment against innovation, economy creative, and social environmental,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 2sp, pp. 162–174, 2023.

Q. Aini, D. Manongga, U. Rahardja, I. Sembiring, and R. Efendy, “Innovation and key benefits of business models in blockchain companies,” Blockchain Frontier Technology, vol. 2, no. 2, pp. 24–35, 2023.

D. Kundana et al., “Data driven analysis of borobudur ticket sentiment using naive bayes.” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 2sp, pp. 221–233, 2023.

M. Purno, F. Nurbaiti, S. Bakhri, and A. A. Yusuf, “Factors affecting stock prices in jakarta islamic index (jii) for the period 2018-2020,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 1Sp, pp. 84–96, 2023.

I. C. Kawi and W. Pontjoharyo, “Integrating buddhist principles into management control systems A cattari ariya saccani approach,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 2sp, pp. 146–161, 2023.

L. Aliyah, C. Lukita, G. Pangilinan, M. Chakim, and D. Saputra, “Examining the impact of artificial intelligence and internet of things on smart tourism destinations A comprehensive study.” Aptisi Transactions on Technopreneurship, vol. 5, pp. 135–145, 2023.

S. Pranata, K. Hadi, M. H. R. Chakim, Y. Shino, and I. N. Hikam, “Business relationship in business process management and management with the literature review method,” ADI Journal on Recent Innovation, vol. 5, no. 1Sp, pp. 45–53, 2023.

Codeine Wong, “Mp4 inspector.” [Online]. Available: https://sourceforge.net/projects/mp4-inspector/

Mael H ¨ orz, “Hxd.” [Online]. Available: https://mh-nexus.de/en/downloads.php?product=HxD20 ¨

M. Hardini, R. A. Sunarjo, M. Asfi, M. H. R. Chakim, and Y. P. A. Sanjaya, “Predicting air quality index using ensemble machine learning,” ADI Journal on Recent Innovation, vol. 5, no. 1Sp, pp. 78–86, 2023.

K. Symons, I. Vanwesenbeeck, M. Walrave, J. Van Ouytsel, and K. Ponnet, “Parents concerns over internet use, their engagement in interaction restrictions, and adolescents’ behavior on social networking sites,” Youth & Society, vol. 52, no. 8, pp. 1569–1581, 2020.

M. H. R. Chakim, A. Kho, N. P. L. Santoso, and H. Agustian, “Quality factors of intention to use in artificial intelligence based aiku applications,” ADI Journal on Recent Innovation, vol. 5, no. 1, pp. 72– 85, 2023.

N. Lutfiani, S. Wijono, U. Rahardja, A. Iriani, Q. Aini, and R. A. D. Septian, “A bibliometric study Recommendation based on artificial intelligence for ilearning education,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 2, pp. 109–117, 2023.

M. A. A. Faruq, M. R. Bassalamah, D. Sudaryanti, and N. N. Azizah, “Hedonic values and utilitarian values to improve behavioral intentions and consumer satisfaction on product,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 3, pp. 319–333, 2023.

Louis Sautier, “pymediainfo.” [Online]. Available: https://pypi.org/project/pymediainfo/

Arkadiusz Bulski and Tomer Filiba and Corbin Simpson, “construct.” [Online]. Available: https://pypi.org/project/construct/

Digipom, “Easy voice recorder.” [Online]. Available: https://www.digipom.com/portfolio-items/ easy-voice-recorder/

Downloads

Published

2024-03-31

How to Cite

Son, H., Baek , S. W., & Park, J. W. (2024). Automated Detection of Container-based Audio Forgery Using Crowdsourcing for Dataset Building. Aptisi Transactions on Technopreneurship (ATT), 6(1), 119–135. https://doi.org/10.34306/att.v6i1.383

Issue

Section

Articles