Multilingual Tourist Assistance using ChatGPT: Comparing Capabilities in
  Hindi, Telugu, and Kannada
Sanjana Kolar Rohit Kumar
This research investigates the effectiveness of ChatGPT, an AI language model
by OpenAI, in translating English into Hindi, Telugu, and Kannada languages,
aimed at assisting tourists in India's linguistically diverse environment. To
measure the translation quality, a test set of 50 questions from diverse fields
such as general knowledge, food, and travel was used. These were assessed by
five volunteers for accuracy and fluency, and the scores were subsequently
converted into a BLEU score. The BLEU score evaluates the closeness of a
machine-generated translation to a human translation, with a higher score
indicating better translation quality. The Hindi translations outperformed
others, showcasing superior accuracy and fluency, whereas Telugu translations
lagged behind. Human evaluators rated both the accuracy and fluency of
translations, offering a comprehensive perspective on the language model's
performance.