257 points by cwwc 2 days ago | 171 comments on HN
| Mild positive Editorial · v3.7· 2026-02-28 11:22:25 0
Summary State Surveillance & Coercion Acknowledges
CNN investigates a Chinese state operation involving coercive intimidation tactics discovered through ChatGPT misuse. The article exercises freedom of expression (Article 19) by reporting on activities that threaten personal security (Article 3), liberty, and freedom of assembly/association (Article 20). The investigation implicitly acknowledges human rights concerns without explicitly advocating for protections.
I was in Shanghai recently and while casually testing one of their AI chat bots I typed "What do you think of the situation in Taiwan?".
It started discussing like a Western bot would - "it's complicated, etc. etc." and around 5s it abruptly stopped and regurgitated the same line the CCP uses "... it's an unalienable part of China etc. etc.".
After printing the line, a popup opened and my camera was activated. The app wanted me to submit my information, presumably to decide what to do with me next time I enter China.
1) All the lights and modern buildings cannot hide that China is a creepy authoritarian state underneath.
2) Given the bot started printing the Western consensus first, I bet $10 it was trained by distilling ChatGPT or Gemini.
> “This is what Chinese modern transnational repression looks like,” Ben Nimmo, principal investigator at OpenAI, told reporters ahead of the report’s release. “It’s not just digital. It’s not just about trolling. It’s industrialized. [...]
There's something poetic about OpenAI being asked to comment on mis-use of their slop generator, and their answer is composed entirely of AI slop.
> “It’s not just digital. It’s not just about trolling. It’s industrialized. It’s about trying to hit critics of the CCP [Chinese Communist Party] with everything, everywhere, all at once.”
The amount of information about everything that people are giving OpenAI is astronomical, information that was previously kept closely guarded is now just freely flowing through foreign servers.
Truly a paradise for american intelligence. Would have expected that the chinese officials be briefed on not using us tech companies, but opsec is hard to teach, and even harder to always follow.
i kinda get the impression this was from 2023 and also it is not clear what this dissident did, hard to evaluate whether i should care without knowing that
Does this level of detail seem strange to anybody else? Shining such a strong light on OpenAI's moderation/manual review efforts seems like it would draw unwanted attention to the fact that ChatGPT conversations are anything but private, and seems somewhat at odds with their recent outrage about the subpoena for user chats in the NYT case.
Manual reviews of sensitive data are ok as long as their own employees are the reviewers, I suppose?
I think one of the reasons why AI companies are valued this high is you can actually inspect what user inputs & outputs are.
It's basically an OSINT siphon.
In this Chinese case, the tokens are leaked at least twice since ChatGPT offer no direct access, you have to use some kind of Openrouter-like service, and they are also have to be in clear-text during transmission.
> After printing the line, a popup opened and my camera was activated. The app wanted me to submit my information, presumably to decide what to do with me next time I enter China.
Was this on your personal device? I'm just wondering how it activated your camera. I would love more details!
If this were true, why didn’t the chatbot immediately recognize that the word “Taiwan” should trigger the response? Detecting the word “Taiwan” has been possible since before most of us were born.
China has more restrictions on what you can say than the U.S. but what you are describing is not reality. Some westerner asking Deepseek about Taiwan is completely uninteresting. Just as the government do not chase people over VPN usage.
China doesn’t try to hide that they are an authoritarian state. They don’t need to. Most people in China are no less happy with their government than westerners are with their governments. Governments reflect culture. And as for foreigners, our view of China is far worse than it actually is, China doesn’t need to hide anything, people who visit China will come away with a more positive view of the country than those who do not visit.
I'm pretty sure they can just prompt any convo in the background and ask "is this conversation sensitive ?" and the model can answer without this being added to the context of the convo.
One hopes the CIA/Secret service would be willing to provide the human to do the reviewing but sadly I've worked for European telco's and I know better.
that creepy feeling of "being watched" has mostly kept me from taking advantage of any SOTA models, i only dabble in a few local ones.
The level of detail does not seem surprising. they're both charged with maintaining a facade of privacy while eliminating any and all miss-use. Certainly they heavily analyze basically everything given to them.
And generally as a society we've been ok with basically zero privacy as long as the data we send stays inside the company we sent it too. Google reads all your emails? Sure thing, read away, just don't send them to the popo. Apple knows when you're ovulating? no problem, just don't tell Amazon. etc
If I were doing this sort of thing, I would make certain to ban accounts that were too obvious while leaving ones that are subtle enough, so that the other side has less reason to suspect I am tracking their inputs and feeding them disinformation.
Low P: investigative journalism exercises and exemplifies free expression A: CNN commits platform resources to free expression
Editorial
+0.60
SETL
+0.30
The article itself is an exercise of freedom of opinion and expression. Investigative reporting that exposes wrongdoing is direct exercise of Article 19 rights.
FW Ratio: 50%
Observable Facts
Article is investigative journalism investigating state operation—direct exercise of expression/press freedom.
Published by major news organization with editorial independence.
Headline presents findings as newsworthy without apparent censorship or editorial constraint.
Inferences
Publication of investigation on sensitive geopolitical topic demonstrates commitment to Article 19 rights.
CNN's platform structurally enables such reporting despite potential state pressure.
Investigation serves watchdog function essential to free expression ecosystem.
Low P: investigative journalism exercises and exemplifies free expression A: CNN commits platform resources to free expression
Structural
+0.45
Context Modifier
ND
SETL
+0.30
CNN structure enables and protects publication of investigative journalism on politically sensitive topics. Platform commits infrastructure to free expression.
How accessible is this content to a general audience?
moderatelow jargongeneral
Longitudinal
875 HN snapshots· 26 evals
Audit Trail
46 entries
2026-03-02 02:29
rater_validation_fail
Parse failure for model deepseek-v3.2: Error: Failed to parse OpenRouter JSON: SyntaxError: Expected ',' or '}' after property value in JSON at position 17322 (line 402 column 4). Extracted text starts with: {
"schema_version": "3.7",
build 1ad9551+j7zs · deployed 2026-03-02 09:09 UTC · evaluated 2026-03-02 10:41:39 UTC
Support HN HRCB
Each evaluation uses real API credits. HN HRCB runs on donations — no ads, no paywalls.
If you find it useful, please consider helping keep it running.