AI 与写作2021unite.ai编辑精选
AI 生成的垃圾内容开始污染科学文献
AI-Generated Garbage Is Beginning to Pollute Scientific Literature
导读
这篇文章讨论科学文献中开始出现疑似 AI 生成的低质文本,并尝试从措辞怪异、逻辑不连贯等迹象判断其来源。对写作者来说,它提醒我们:词汇替换和表面流畅不能代替准确表达与逻辑;判断文本质量要看具体证据,而不是把所有坏文字都归咎于 AI。
可以直接用的写作要点
- 01
别为了避重就用生僻同义词替换专业术语;准确、自然的用词比“看起来高级”更重要。
- 02
涉及语言分析时把“语义”和“句法”分清,术语误用会让读者怀疑整篇文章的专业性。
- 03
判断文本是否可信,要看逻辑连贯、用词自然和证据充分,而不是只看它读起来是否流畅。
- 04
如果文字读起来像来回翻译或逐词替换,先删掉这些“临床化”表达,回到清楚、具体的说法。
HN 评论精选
作者对“这些论文由 GPT 生成”的说法持怀疑态度,认为例子更像同义词硬替或老旧机翻,且缺乏可验证的 AI 文体证据。
作者推测这些论文的文本多由 GPT 式生成模型产生,但生成模型对来源的抽象方式让这一点很难证明;主要证据只是常识判断——糟糕且不必要的同义词,以及对投稿逻辑连贯性的细致检查。我觉得这极不可能。首先,科学造假者通常很懒,不会用生成模型伪造数据之类的花哨方法,更不会用神经网络;难道有人会费劲搭 GPT 生成假论文,然后满足于“profound neural organization”这种结果?手写这种垃圾更容易。其次,文章给的例子太差,简直是在侮辱 GPT:“profound neural organization”更像用同义词词典逐词硬译,或特别老旧的机器翻译(“伏特加好,但肉坏了”那种),不涉及当代 AI;GPT 不会生成这种垃圾。第三,如果真是 GPT 生成,用 top-k 特征、GPT 分类器(准确率 >90%)或 GPT 文体特征很容易检测;文章没给出任何具体的 GPT 式特征,说明可能根本没有。
gwern查看英文原文
"The researchers hypothesize that GPT-style generative models, and similar types of language generation frameworks, have been used to produce much of the text in the flagged papers; however, the way that a generative model abstracts its sources makes this difficult to prove, and the chief evidence lies in a common-sense evaluation of poor and unnecessary synonyms, and a meticulous examination of the submission’s logical coherence." This sounds extremely unlikely. First, scientific fraudsters are typically extremely lazy; they do not use fancy methods like writing generative models of fake data to ensure the numbers, say, add up to 100%, much less neural nets. (Do we believe that someone would go to the effort of setting up GPT to generate fake papers and then be satisfied with results like 'profound neural organization'? Easier to write such garbage by hand!) Second, the given examples are so bad I'm insulted on behalf of GPT: 'profound neural organization' looks like a word-by-word calque using a thesaurus or particularly antiquated machine translation (in a "the vodka is good, but the meat is rotten" way), no contemporary AI involved; GPT would not generate such garbage. Third, if GPT was generating these papers, it would be easy to detect by looking for top-k signatures, using GPT-targeted classifiers (they get >90% accuracy), or looking for stylistic tics of GPT; that they don't provide any specific GPT-like aspects of the text suggests there are none.
讨论语言问题时要把“语义”和“句法”分清,术语误用会削弱专业性。
这篇文章很有意思,但我忍不住说一句:有一节标题叫“不只是语义”,其实他们想说的是“句法”。语义才关注意义!
iainmerrick查看英文原文
This is a really interesting article, but I can’t ignore my pet peeve: It has a section titled “Not Just Semantics,” but of course they really mean “syntax.” Semantics is meaning!
机械替换同义词会把表达变得临床、字面甚至怪异,适合特定风格,但不能代替自然写作。
我特别喜欢 GPT-3 改写常见短语的方式。文章里的例子:artificial intelligence (AI) 变成“(counterfeit | human-made) consciousness”;ant colony 变成“subterranean insect (state | province | area | region | settlement)”。这种改写非常临床、字面,让我想起《半条命2》里 Overwatch 的措辞。比如你用蚁狮群越狱时,Overwatch 说:“Overwatch acknowledges critical exogen breach. Airwatch augmentation force dispatched and inbound. Hold for reinforcement.”“airwatch augmentation”听起来比“air support”阴森得多。我很好奇,如果明确让 GPT-3 做这种改写会怎样;让它假装成外星智能会怎样。
ryankrage77查看英文原文
I absolutely love the way GPT-3 re-words common phrases. Examples from the article: artificial intelligence (AI): ‘(counterfeit | human-made) consciousness’ ant colony: ‘subterranean insect (state | province | area | region | settlement)’ It's so clinical and literal. It reminds me a lot of the way Overwatch phrases things in Half-Life 2. For example, when you use a swarm of antlions (giant alien insects) to stage a prison break, Overwatch says "Overwatch acknowledges critical exogen breach. Airwatch augmentation force dispatched and inbound. Hold for reinforcement" "airwatch augmentation" sounds much more ominous than "air support". I would be interested to see what GPT-3 could come up with if explicity tasked to do this type of re-phrasing. What happens if you ask it to pretend to be an alien intelligence?
同类还值得读
我是肯尼亚人:不是我把 ChatGPT 写成了我,而是它写起来像我
I'm Kenyan. I don't write like ChatGPT, ChatGPT writes like me
一位肯尼亚作者反驳“我写得太像 AI”的指责:不是他写得像 ChatGPT,而是 ChatGPT 写得像他——那种平滑、无地域色彩、貌似中立的英语,本来就是殖民教育与精英阶层塑造…
AI 与写作2025 · 799 分 · 504 评4 条写作要点编辑精选使用 AI 助手完成论文写作任务会累积认知债务
Accumulation of cognitive debt when using an AI assistant for essay writing task
这篇论文研究的是:在完成议论文写作任务时使用 AI 助手,是否会让写作者积累"认知债"——也就是把本应由自己承担的思考外包出去,短期省力、长期削弱写作与思考能力。
AI 与写作2025 · 391 分 · 426 评4 条写作要点编辑精选学生使用 ChatGPT 写作指南
A Student's Guide to Writing with ChatGPT
这是 OpenAI 面向学生的一份写作指南,讲的是如何把 ChatGPT 用作写作过程中的辅助工具,而不是替你写完作业的"枪手"。
AI 与写作2024 · 323 分 · 309 评4 条写作要点编辑精选Grammarly,你也背叛了我?
Et Tu, Grammarly?
本次输入里只给了标题和链接,正文和评论都是空的,所以没法据实写出导读。
AI 与写作2025 · 279 分 · 74 评编辑精选用 GPT-3 进行创意小说写作
GPT-3 Creative Fiction
Gwern 的长文系统考察 GPT-3 在创意小说写作上的能力与边界:它能维持人设、写出讽刺腔调,也会整段复述训练数据里的歌词。
AI 与写作2020 · 234 分 · 97 评4 条写作要点编辑精选