跳到正文
Hacker News:AI 熱帖·· 5 小時前AI 評分30

殭屍統計數字:AI 引用的數字從何而來

Zombie stats: Where the numbers AI quotes come from

AI 導讀

Hacker News 用戶討論 AI 引用的統計數字從何而來、是否有研究支持,以及引用能否核實。留言提醒,附有引用標記不代表來源可靠,讀者仍需查證 AI 和人工撰寫內容中的資訊。

正文

Image 1Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Zombie stats: Where the numbers AI quotes come from (trakkr.ai) 53 points by mektrik1 hour ago | hide | past | favorite | 16 comments help Image 2toddmorey15 minutes ago | next[–] I can't decide if the report's writing ("One number, followed" & "Quoted by all five. Sourced by none.") is being lazy or ironic? reply Image 3alberth42 minutes ago | prev | next[–] I know Perplexity isn't often talked about anymore but their design of every sentence needing to be able to be referenced back to an actual source (like an academic peer reviewed paper) seems like a super power for trust. reply Image 4tmpz2221 minutes ago | parent | next[–] My initial experience with Perplexity was it citing AI blog spam as a primary source so consistently I immediately dropped my subscription. (this was over a year ago, I haven't re-evaluated them since) reply Image 5dubcanada11 minutes ago | root | parent | next[–] Is it up to Perplexity to determine what is AI blog spam & what is correct. Versus what exists online? reply Image 6degamad37 minutes ago | parent | prev | next[–] How do they ensure that? reply Image 7marcosdumay28 minutes ago | root | parent | next[–] They fine tune for that, they don't ensure anything. (Or at least they used to, I think they changed everything recently, but I've mostly stopped using them.) reply Image 8rozal36 minutes ago | root | parent | prev | next[–] No one ensures what it does but it’s proactive, it gets the people buying reply Image 9Creamsicle4733 minutes ago | root | parent | next[–] Agents in Paris? reply Image 10armcat13 minutes ago | prev | next[–] There is a human/user element here as well - will the users check the citations, if they are provided inline? I recall in the early ChatGPT web search and Perplexity days, most of the citations didn't work (made up, or 404). You get a false sense of security by having a "[1]" next to the stat or a claim. Maybe labs companies should have some additional quality ranking/checks on these, if it's in their interest of course. reply Image 11falcor8449 minutes ago | prev | next[–] A full 40% of AI stats actually have a specific study behind them? Knowing how the human baseline is that 73.6%* of all statistics are made up on the spot, this is really encouraging. *That particular stat was of course made up, but not by me. reply Image 12jrflo29 minutes ago | prev | next[–] Just an thinly veiled ad for something called trakkr. Not to mention that none of these "stats" actually matter aside from being the type of thing that a consultant would put in a pitch deck, at which point their accuracy doesn't matter anyways reply Image 13mfld28 minutes ago | prev | next[–] Never trust a statistic you haven't sneaked into the training corpus yourself. reply Image 14brendong20 minutes ago | prev | next[–] Better to be on the 40% or the 60%? Seems like both sides will bite you in the ass to an extent reply Image 15ieie336611 minutes ago | prev | next[–] Ah yes. The AI slop blogpost calling out AI slop statistics. We must go deeper reply Image 16zzzeek29 minutes ago | prev[–] when people say "there should be no AI taught in schools ever. prompting? what skill is there in talking to a liar bot?" this is where they are dead wrong. Being correctly critical of LLM output is a huge skill and news flash it applies to people and human-written things too. reply Image 17add-sub-mul-div12 minutes ago | parent[–] Being skeptical/critical isn't a skill, it's an attitude, a state of mind. An education that requires you to find your own information and sources manually breeds that state of mind. Giving LLMs to kids (or even adults) nurtures the opposite. It's like taking them to McDonald's every day and telling them to eat healthy. Yes there's a salad on the menu, but it's rarely going to be chosen. Of course the reality that adults do trust AI uncritically because it's the path of least resistance means the traditional education I mentioned above wasn't sufficient. But that's all the more reason not to introduce a variable that makes things worse. reply Image 18 Consider applying for YC's Winter 2027 batch! Applications are open till November 2. Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact Search:

來源:Hacker News:AI 熱帖 · news.ycombinator.com