• Akarsh G
• K Janaki

In the era of global information exchange, journalists face challenges in accessing and understanding video content in various languages. Accurate and reliable translations are critical for disseminating information across borders and overcoming language barriers. This paper presents a comprehensive translation and summarization tool specifically designed for journalists that leverages OpenAI's Whisper Automatic Speech Recognition (ASR), GPT-3.5-Turbo models, and the 'facebook/xm_transformer_sm_all-en' speech-to-speech translation model. The tool addresses the prevalent issues of biased translations, cultural nuances, time pressure, and resource inaccessibility by translating, transcribing, summarizing, and overlaying speech on video content while also incorporating a Q&A functionality based on the transcriptions. The system architecture involves downloading YouTube videos, processing them through the Whisper, GPT-3.5-Turbo, and HuggingFace APIs, and hosting the results on Streamlit, providing an accessible and user-friendly interface. We evaluate the tool's performance in real-world scenarios, demonstrating its potential to significantly improve the accessibility and reliability of information for journalists by providing accurate translations, maintaining cultural nuances, and offering rapid response times. This research offers insights into the practical application of advanced ASR and language models to address translation and summarization challenges in journalism, enriched by the addition of the 'facebook/xm_transformer_sm_all-en' speech-to-speech translation model.

Global information exchange, Whisper ASR, GPT-3.5-Turbo, Cultural nuances, Translation and summarization tool, Journalism challenges,

"Overcoming Language Barriers in Journalism: A Translation and Summarization Tool Utilizing Advanced AI ModelsOvercoming Language Barriers in Journalism: A Translation and Summarization Tool Utilizing Advanced AI Models", International Journal of Emerging Technologies and Innovative Research (www.jetir.org), ISSN:2349-5162, Vol.10, Issue 5, page no.i804-i809, May-2023, Available :http://www.jetir.org/papers/JETIR2305929.pdf

"Overcoming Language Barriers in Journalism: A Translation and Summarization Tool Utilizing Advanced AI ModelsOvercoming Language Barriers in Journalism: A Translation and Summarization Tool Utilizing Advanced AI Models", International Journal of Emerging Technologies and Innovative Research (www.jetir.org | UGC and issn Approved), ISSN:2349-5162, Vol.10, Issue 5, page no. ppi804-i809, May-2023, Available at : http://www.jetir.org/papers/JETIR2305929.pdf