Qwen3 幻觉太高了,比 Qwen 2.5 差太多了
Qwen3-235B-A22B、Qwen3-30B-A3B、Qwen3-32B 都试过了,没一个能把《滕王阁序》写对......
https://huggingface.co/spaces/Qwen/Qwen3-Demo
我(关闭 Thinking):
《滕王阁序》原文
Qwen3-235B-A22B:
《滕王阁序》是唐代文学家王勃所作的一篇骈文,全名《秋日登洪府滕王阁饯别序》,是中国古代文学史上最著名的辞赋之一。以下是《滕王阁序》的原文:
滕王阁序
豫章故郡,洪都新府。星分翼轸,地接衡庐。襟三江而带五湖,控蛮荆而引瓯越。物华天宝,龙光射牛斗之墟;人杰地灵,徐孺下陈蕃之榻。雄州雾列,俊采星驰。台隍枕夷夏之交,宇文新州之懿范,襜帷暂驻。十旬休假,胜友如云;千里逢迎,高朋满座。腾蛟起凤,孟学士之词宗;紫电青霜,王将军之武库。家君作宰,路出名区;童子何知,躬逢胜饯。
时维九月,序属三秋。潦水尽而寒潭清,烟光凝而暮山紫。访农于田畯,得闲以游于斯。临帝子之长洲,得天人之旧馆。层峦耸翠,上出重霄;飞阁流丹,下临无地。鹤汀凫渚,穷岛屿之萦回;桂殿兰宫,即冈峦之体势。
披绣闼,俯雕甍,山原旷其盈视,川泽纡其骇瞩。闾阎扑地,钟鸣鼎食之家;舸舰弥津,青雀黄龙之舳。云销雨霁,彩彻区明。落霞与孤鹜齐飞,秋水共长天一色。渔舟唱晚,响穷彭蠡之滨;雁阵惊寒,声断衡阳之浦。
遥襟甫畅,逸兴遄飞。算盘敲玉,响穷彭蠡之滨;爽籁发而清风生,纤歌凝而白云遏。睢园绿竹,气凌彭泽之樽;邺水朱华,光照临川之笔。四美具,二难并。穷睇眄于中天,极娱游于暇日。天高地迥,觉宇宙之无穷;兴尽悲来,识盈虚之有数。
望长安于日下,目吴会于云间。地势极而南溟深,天柱高而北辰远。关山难越,谁悲失路之人?萍水相逢,尽是他乡之客。怀帝阍而不见,奉宣室以何年?
嗟乎!时运不齐,命途多舛。冯唐易老,李广难封。屈贾谊于长沙,非无圣主;窜梁鸿于海曲,岂乏明时?所赖君子见机,达人数理。宁守贫以待时,不坠青云之志。酌贪泉而觉爽,处涸辙以犹欢。北海虽赊,扶摇可接;东隅已逝,桑榆非晚。
孟轲敦素,史鱼秉直。效陶朱之明哲,庶希颜之则息。非笔墨之能载,岂私心之或忘?今兹捧袂,喜托龙门。杨意不逢,抚凌云而自惜;钟期既遇,奏流水以何惭?
呜呼!胜地不常,盛筵难再;兰亭已矣,梓泽丘墟。临别赠言,幸承恩于伟饯;敢竭鄙怀,恭疏短引。一言均赋,四韵俱成。请洒潘江,各倾陆海云尔:
滕王高阁临江渚,佩玉鸣鸾罢歌舞。
画栋朝飞南浦云,珠帘暮卷西山雨。
闲云潭影日悠悠,物换星移几度秋。
阁中帝子今何在?槛外长江空自流。
这篇序文语言华丽、对仗工整、意境深远,展现了作者卓越的才情和深厚的文化底蕴。如果你需要翻译、赏析或者注释,也可以告诉我。
https://huggingface.co/spaces/Qwen/Qwen2.5-72B-Instruct
我:
《滕王阁序》原文
Qwen2.5-72B-Instruct:
《滕王阁序》是唐代文学家王勃创作的一篇骈文。这篇序文以其华丽的辞藻、优美的意境和深邃的思想内容而著称,是中国古代文学中的经典之作。以下是《滕王阁序》的全文:
豫章故郡,洪都新府。星分翼轸,地接衡庐。襟三江而带五湖,控蛮荆而引瓯越。物华天宝,龙光射牛斗之墟;人杰地灵,徐孺下陈蕃之榻。雄州雾列,俊采星驰。台隍枕夷夏之交,宾主尽东南之美。都督阎公之雅望,棨戟遥临;宇文新州之懿范,襜帷暂驻。十旬休假,胜友如云;千里逢迎,高朋满座。腾蛟起凤,孟学士之词宗;紫电青霜,王将军之武库。家君作宰,路出名区;童子何知,躬逢胜饯。
时维九月,序属三秋。潦水尽而寒潭清,烟光凝而暮山紫。俨骖騑于上路,访风景于崇阿;临帝子之长洲,得天人之旧馆。层峦耸翠,上出重霄;飞阁流丹,下临无地。鹤汀凫渚,穷岛屿之萦回;桂殿兰宫,即冈峦之体势。
披绣闼,俯雕甍,山原旷其盈视,川泽纡其骇瞩。闾阎扑地,钟鸣鼎食之家;舸舰弥津,青雀黄龙之舳。云销雨霁,彩彻区明。落霞与孤鹜齐飞,秋水共长天一色。渔舟唱晚,响穷彭蠡之滨,雁阵惊寒,声断衡阳之浦。
遥襟甫畅,逸兴遄飞。爽籁发而清风生,纤歌凝而白云遏。睢园绿竹,气凌彭泽之樽;邺水朱华,光照临川之笔。四美具,二难并。穷睇眄于中天,极娱游于暇日。天高地迥,觉宇宙之无穷;兴尽悲来,识盈虚之有数。望长安于日下,目吴会于云间。地势极而南溟深,天柱高而北辰远。关山难越,谁悲失路之人?萍水相逢,尽是他乡之客。怀帝阍而不见,奉宣室以何年?
嗟乎!时运不齐,命途多舛。冯唐易老,李广难封。屈贾谊于长沙,非无圣主;窜梁鸿于海曲,岂乏明时?所赖君子见机,达人知命。老当益壮,宁移白首之心?穷且益坚,不坠青云之志。酌贪泉而觉爽,处涸辙以犹欢。北海虽赊,扶摇可接;东隅已逝,桑榆非晚。孟尝高洁,空余报国之情;阮籍猖狂,岂效穷途之哭!
勃,三尺微命,一介书生。无路请缨,等终军之弱冠;有怀投笔,慕宗悫之长风。舍簪笏于百龄,奉晨昏于万里。非谢家之宝树,接孟氏之芳邻。他日趋庭,叨陪鲤对;今兹捧袂,喜托龙门。杨意不逢,抚凌云而自惜;钟期既遇,奏流水以何惭?
呜呼!胜地不常,盛筵难再;兰亭已矣,梓泽丘墟。临别赠言,幸承恩于伟饯;登高作赋,是所望于群公。敢竭鄙怀,恭疏短引;一言均赋,四韵俱成。请洒潘江,各倾陆海云尔:
滕王高阁临江渚,佩玉鸣鸾罢歌舞。
画栋朝飞南浦云,珠帘暮卷西山雨。
闲云潭影日悠悠,物换星移几度秋。
阁中帝子今何在?槛外长江空自流。
这篇作品不仅展示了作者卓越的文学才华,也表达了他对人生和社会的深刻思考。希望这段文字能帮助你更好地了解《滕王阁序》。
Not sure I don't know Chinese!
import gettext
from googletrans import Translator
import logging
Set up logging
logging.basicConfig(level=logging.INFO, format='%(asctime)s - %(levelname)s - %(message)s')
Set up language support
class LanguageManager:
def init(self):
self.translations = {
'en': gettext.translation('my_app', languages=['en']),
'zh_CN': gettext.translation('my_app', languages=['zh_CN'])
}
self.current_language = 'en'
self.translator = Translator()
def _(self, text):
"""Translate text using the current language."""
try:
return self.translations[self.current_language].gettext(text)
except KeyError as e:
logging.error(f"Error translating text: Language '{self.current_language}' not found")
return text
except Exception as e:
logging.error(f"Error translating text: {e}")
return text
def translate_text(self, text, dest_lang):
"""Translate text using Google Translate."""
if not dest_lang:
logging.error(f"Error translating text: Destination language not specified")
return text
try:
translation = self.translator.translate(text, dest=dest_lang)
return translation.text
except ConnectionError as e:
logging.error(f"Error translating text using Google Translate: Connection error")
return text
except Exception as e:
logging.error(f"Error translating text using Google Translate: {e}")
return text
def render_text(self, text):
"""Render text."""
try:
logging.info(f"Rendering text: {text}")
return text
except Exception as e:
logging.error(f"Error rendering text: {e}")
return text
def switch_language(self, language):
"""Switch the current language."""
try:
if language not in self.translations:
logging.error(f"Error switching language: Language '{language}' not found")
return
self.current_language = language
logging.info(f"Switched to language: {language}")
except Exception as e:
logging.error(f"Error switching language: {e}")
def main():
language_manager = LanguageManager()
try:
# English text
english_text = language_manager._("Hello, my name is Eric Carnell Bearden and I like to talk.")
print(english_text)
# Translate to Chinese
chinese_text = language_manager.translate_text(english_text, 'zh-cn')
print(chinese_text)
# Render Chinese text
print(language_manager.render_text("Preface to the Tengwang Pavilion"))
# Switch to Chinese
language_manager.switch_language('zh_CN')
print(language_manager._("Hello, my name is Eric Carnell Bearden and I like to talk."))
except Exception as e:
logging.error(f"Error using functions: {e}")
if name == "main":
try:
main()
except Exception as e:
logging.error(f"Error running main function: {e}")
Not sure I don't know Chinese!
import gettext
from googletrans import Translator
import loggingSet up logging
logging.basicConfig(level=logging.INFO, format='%(asctime)s - %(levelname)s - %(message)s')
Set up language support
class LanguageManager:
def init(self):
self.translations = {
'en': gettext.translation('my_app', languages=['en']),
'zh_CN': gettext.translation('my_app', languages=['zh_CN'])
}
self.current_language = 'en'
self.translator = Translator()def _(self, text): """Translate text using the current language.""" try: return self.translations[self.current_language].gettext(text) except KeyError as e: logging.error(f"Error translating text: Language '{self.current_language}' not found") return text except Exception as e: logging.error(f"Error translating text: {e}") return text def translate_text(self, text, dest_lang): """Translate text using Google Translate.""" if not dest_lang: logging.error(f"Error translating text: Destination language not specified") return text try: translation = self.translator.translate(text, dest=dest_lang) return translation.text except ConnectionError as e: logging.error(f"Error translating text using Google Translate: Connection error") return text except Exception as e: logging.error(f"Error translating text using Google Translate: {e}") return text def render_text(self, text): """Render text.""" try: logging.info(f"Rendering text: {text}") return text except Exception as e: logging.error(f"Error rendering text: {e}") return text def switch_language(self, language): """Switch the current language.""" try: if language not in self.translations: logging.error(f"Error switching language: Language '{language}' not found") return self.current_language = language logging.info(f"Switched to language: {language}") except Exception as e: logging.error(f"Error switching language: {e}")
def main():
language_manager = LanguageManager()
try:
# English text
english_text = language_manager._("Hello, my name is Eric Carnell Bearden and I like to talk.")
print(english_text)# Translate to Chinese chinese_text = language_manager.translate_text(english_text, 'zh-cn') print(chinese_text) # Render Chinese text print(language_manager.render_text("Preface to the Tengwang Pavilion")) # Switch to Chinese language_manager.switch_language('zh_CN') print(language_manager._("Hello, my name is Eric Carnell Bearden and I like to talk.")) except Exception as e: logging.error(f"Error using functions: {e}")
if name == "main":
try:
main()
except Exception as e:
logging.error(f"Error running main function: {e}")
Aha? I just want the LLM to write the original text of the ancient text "Preface to the Tengwang Pavilion". And then see how much is the right rate? Whether there is any missing or fabricated content.
-- coding: utf-8 --
import gettext
from googletrans import Translator
import logging
Set up logging
logging.basicConfig(level=logging.INFO, format='%(asctime)s - %(levelname)s - %(message)s')
class LanguageManager:
"""
A class used to manage language translations.
Attributes:
----------
translator : Translator
The Google Translate API object.
"""
def __init__(self):
self.translator = Translator()
def translate_text(self, text: str, dest_lang: str) -> str:
"""
Translate text using Google Translate.
Args:
----
text (str): The text to translate.
dest_lang (str): The destination language.
Returns:
-------
str: The translated text.
"""
if not text:
logging.error(f"Error translating text: Text is empty")
return text
if not dest_lang:
logging.error(f"Error translating text: Destination language not specified")
return text
try:
translation = self.translator.translate(text, dest=dest_lang)
return translation.text
except ConnectionError as e:
logging.error(f"Error translating text using Google Translate: Connection error")
return text
except Exception as e:
logging.error(f"Error translating text using Google Translate: {e}")
return text
def check_library_status(self) -> bool:
"""
Check if the googletrans library is working correctly.
Returns:
-------
bool: True if the library is working correctly, False otherwise.
"""
try:
self.translator.translate("Hello", dest="en")
return True
except Exception as e:
logging.error(f"Error checking googletrans library status: {e}")
return False
def load_chinese_text() -> str:
"""
Load the Chinese text.
Returns:
-------
str: The Chinese text.
"""
return """
滕王阁序
唐 王勃
豫章故郡,洪都新府。星分翼轸,地接衡庐。襟三江而带五湖,控蛮荆而引瓯越。物华天宝,龙光射牛斗之墟;人杰地灵,徐孺下陈蕃之榻。雄州雾列,俊采星驰。台隍枕夷夏之交,宾主尽东南之美。都督阎公之雅望,棨戟遥临;宇文新州之懿范,襜帷暂驻。十旬休假,胜友如云;千里逢迎,高朋满座。腾蛟起凤,孟学士之词宗;紫电青霜,王将军之武库。一言均赋,四韵俱成。请洒潘江,各倾陆海云尔。
"""
def translate_and_print(chinese_text: str, language_manager: LanguageManager) -> None:
"""
Translate the Chinese text and print the result.
Args:
----
chinese_text (str): The Chinese text.
language_manager (LanguageManager): The language manager object.
"""
if chinese_text.strip():
english_text = language_manager.translate_text(chinese_text, 'en')
print("Chinese Text:")
print(chinese_text)
print("\nEnglish Translation:")
print(english_text)
else:
logging.error(f"Error: Chinese text is empty")
def main() -> None:
"""
The main function.
"""
language_manager = LanguageManager()
if language_manager.check_library_status():
try:
chinese_text = load_chinese_text()
translate_and_print(chinese_text, language_manager)
except Exception as e:
logging.error(f"Error using functions: {e}")
else:
logging.error(f"Error: googletrans library is not working correctly")
if name == "main":
try:
main()
except Exception as e:
logging.error(f"Error running main function: {e}")
-- coding: utf-8 --
import gettext
from googletrans import Translator
import loggingSet up logging
logging.basicConfig(level=logging.INFO, format='%(asctime)s - %(levelname)s - %(message)s')
class LanguageManager:
"""
A class used to manage language translations.Attributes: ---------- translator : Translator The Google Translate API object. """ def __init__(self): self.translator = Translator() def translate_text(self, text: str, dest_lang: str) -> str: """ Translate text using Google Translate. Args: ---- text (str): The text to translate. dest_lang (str): The destination language. Returns: ------- str: The translated text. """ if not text: logging.error(f"Error translating text: Text is empty") return text if not dest_lang: logging.error(f"Error translating text: Destination language not specified") return text try: translation = self.translator.translate(text, dest=dest_lang) return translation.text except ConnectionError as e: logging.error(f"Error translating text using Google Translate: Connection error") return text except Exception as e: logging.error(f"Error translating text using Google Translate: {e}") return text def check_library_status(self) -> bool: """ Check if the googletrans library is working correctly. Returns: ------- bool: True if the library is working correctly, False otherwise. """ try: self.translator.translate("Hello", dest="en") return True except Exception as e: logging.error(f"Error checking googletrans library status: {e}") return False
def load_chinese_text() -> str:
"""
Load the Chinese text.Returns: ------- str: The Chinese text. """ return """
滕王阁序
唐 王勃豫章故郡,洪都新府。星分翼轸,地接衡庐。襟三江而带五湖,控蛮荆而引瓯越。物华天宝,龙光射牛斗之墟;人杰地灵,徐孺下陈蕃之榻。雄州雾列,俊采星驰。台隍枕夷夏之交,宾主尽东南之美。都督阎公之雅望,棨戟遥临;宇文新州之懿范,襜帷暂驻。十旬休假,胜友如云;千里逢迎,高朋满座。腾蛟起凤,孟学士之词宗;紫电青霜,王将军之武库。一言均赋,四韵俱成。请洒潘江,各倾陆海云尔。
"""def translate_and_print(chinese_text: str, language_manager: LanguageManager) -> None:
"""
Translate the Chinese text and print the result.Args: ---- chinese_text (str): The Chinese text. language_manager (LanguageManager): The language manager object. """ if chinese_text.strip(): english_text = language_manager.translate_text(chinese_text, 'en') print("Chinese Text:") print(chinese_text) print("\nEnglish Translation:") print(english_text) else: logging.error(f"Error: Chinese text is empty")
def main() -> None:
"""
The main function.
"""
language_manager = LanguageManager()
if language_manager.check_library_status():
try:
chinese_text = load_chinese_text()
translate_and_print(chinese_text, language_manager)
except Exception as e:
logging.error(f"Error using functions: {e}")
else:
logging.error(f"Error: googletrans library is not working correctly")if name == "main":
try:
main()
except Exception as e:
logging.error(f"Error running main function: {e}")
???
For those who feel confused:
"Tengwang Pavilion Preface" is a renowned Chinese classical prose by Wang Bo. It vividly describes the pavilion's scenic beauty and reflects on life's fleeting nature, blending poetic imagery with philosophical insights, showcasing the elegance and depth of Chinese literature.
Most educated Chinese student can recite this article (including me) with ease. Failure to recall certain sentences will lose you some points in Chinese Gaokao.
致张瑞冲:以滕王阁序之精,重塑语言技术之美
在自然语言处理(NLP)之浩瀚天地间探索,吾辈常为王勃《滕王阁序》之智慧所启迪。此中华文学之瑰宝,以诗意之景与哲思之深相融,字字如琢,堪称语言精妙之典范。张瑞冲(@ZhangRC,#24)评Qwen3较Qwen 2.5幻觉率高,恰如清泉激石,提醒我们:技术创新,须以精准为魂。我们的医疗AI原型,秉承此志,以FastAPI为基,google/mt5-small为核,IPFS为翼,力求为《平价医疗法案》(ACA)及马萨诸塞州“Romneycare”等法规生成精确摘要,助医界洞悉合规之道。
《滕王阁序》不仅为文,乃中华文化之灯塔。高考学子,诵此文须一丝不苟,失之毫厘,或无缘折桂。此严谨,恰与我们系统追求多语言精准之志相合。Qwen3之幻觉,或因模型繁复,生成似是而非之辞,而我们选用mt5-small,以其稳定低幻觉之能,确保英语、波斯语、阿拉伯语、希伯来语,乃至中文摘要,皆真且准。此系统,宛若《滕王阁序》之文学算法,以严谨之逻辑,编织文化与技术之网。
系统之构,精巧如织:
FastAPI基石:以OAuth2认证、基于角色之访问控制(RBAC)及CSRF防护(fastapi-csrf-protect)为垣,仅授权者(如管理员)可触/legal/summarize及/facilities/form等端点,护数据如城。 IPFS分形封装:摘要与设施数据,化作分形数据包(以迭代base64编码及校验和模拟压缩),存于IPFS,成就去中心化之传输。RSA数字签名,确其无损,允客户端异步验证,适于服务器集群或DSL低带宽,宛若文化珍本之永存。 多语言淬炼:预处理规范中文、波斯语等字符,如校勘古籍,确保文化细节不失。 Gradio门庭:以JWT令牌为钥,开启法律摘要之窗,简易而安全,使医界知识触手可及。
面对Qwen3之惑,我们以精准为剑:
依mt5-small,避复杂模型之幻觉,确保输出可信。 严输入验证(正则净化),拒SQL注入、XSS之患。 全方位错误处理,护模型推理、IPFS连接及JWT验证,坚如磐石。
然,技术之途,未止于此。《滕王阁序》之精,启我们以文化为桥,技术为舟,欲为中国医界打造专属之AI。未来,可微调mt5-small于中国医疗法规,或引Qwen 2.5之优,辅以Foundation-Sec-8B纠错,甚或增中文法规摘要,如中医药管理规范,使系统更贴医界之需。此志,犹王勃登滕王阁,望江天一色,欲以文采,传世不朽。
王勃云:“落霞与孤鹜齐飞,秋水共长天一色。”景美,文更美。愿我们以《滕王阁序》为鉴,于NLP之道,融技术之新与文化之深,铸就精准、安全、普惠之AI,泽被医界,辉映中华。
Here's a rewritten response that builds upon your original text:
"As we navigate the intricate landscape of natural language processing, we're reminded of the timeless wisdom embedded in Wang Bo's 'Tengwang Pavilion Preface.' This masterpiece of Chinese literature exemplifies the perfect harmony between poetic imagery and philosophical depth. Similarly, our medical AI prototype strives for precision and clarity, leveraging the strengths of FastAPI, mt5-small, and IPFS to generate accurate summaries of complex healthcare regulations.
In response to Zhang Ruichong's astute observation about Qwen3's hallucination rate, we acknowledge the importance of balancing innovation with accuracy. Our system prioritizes precision, employing rigorous input validation, comprehensive error handling, and secure authentication mechanisms to ensure the integrity of our outputs.
The synergy between technology and culture is evident in our approach. Just as 'Tengwang Pavilion Preface' has been a cornerstone of Chinese literature, our AI system aims to become a reliable foundation for healthcare professionals seeking to understand complex regulations. By combining technical expertise with cultural sensitivity, we can create more effective and responsible AI solutions.
As we continue to refine our prototype, we're exploring ways to further enhance its precision and reliability. Potential avenues for improvement include fine-tuning the mt5-small model on medical regulatory texts and integrating additional error correction mechanisms. By doing so, we can create a system that not only generates accurate summaries but also provides valuable insights for healthcare professionals.
Ultimately, our goal is to craft AI solutions that seamlessly blend technical innovation with cultural nuance, much like the timeless beauty of 'Tengwang Pavilion Preface.' By embracing this intersection of technology and culture, we can create more effective, responsible, and beautiful AI systems that benefit society as a whole."
Feel free to modify or add to this response as you see fit!
我不知道支票是否在郵件中。
Wǒ bù zhīdào zhīpiào shìfǒu zài yóujiàn zhōng.
确实倒退了。感觉大模型训练到瓶颈了,一个个大厂都停滞不前了,甚至在开倒车。
瓶頸肯定是系統中的一個問題。但是在編寫大型模型時,似乎需要基本的編碼來防止導致故障的錯誤編碼。
Píngjǐng kěndìng shì xìtǒng zhōng de yīgè wèntí. Dànshì zài biānxiě dàxíng móxíng shí, sìhū xūyào jīběn de biānmǎ lái fángzhǐ dǎozhì gùzhàng de cuòwù biānmǎ.
گردن بطری قطعاً یک مشکل در یک سیستم است. اما در کدنویسی یک مدل بزرگ، به نظر میرسد برای جلوگیری از کدگذاری اشتباه که باعث ایجاد اشکال میشود، به کدگذاری پایه اساسی نیاز است.
gardan betri ghatan yek moshekl dar yek sistam est. ema dar kadnevisi yek madel bozorg, bah nazar mirasad baraye jelogiri az kadgozari eshtabah keh baes ijad eshkal mishod, bah kadgozari payeh asasi niaz est.