首页 500强 活动 榜单 商业 科技 领导力 专题 品牌中心
杂志订阅

高中老师用人工智能伪造校长声音

人工智能变得越来越强大,但检测人工智能的能力可能滞后。

文本设置
小号
默认
大号
Plus(0条)

马里兰州当局在4月25日表示,该地一所高中的体育总监被指控利用人工智能,在一段包含种族主义和反犹太主义言论的录音中冒充校长。

当局称,这似乎是美国第一起类似的案件,并呼吁制定新法律来防范这种技术。专家还警告称,人工智能变得越来越强大,但检测人工智能的能力可能滞后,需要更多资源。

巴尔的摩县警方表示,达佛恩·达里恩模仿派克斯维尔高中(Pikesville High School)校长的声音,回应两人有关达里恩工作表现不佳以及是否会续约合同的谈话。

警方表示,事情的起因包括达里恩被指控谎称为女子足球队担任教练,从学校资金中支付了1,900美元给他的室友。

警方的指控文件显示,达里恩伪造了一段音频,听起来似乎是校长在对黑人学生和他们的考试能力表达不满。警方称,这段录音还声称录到了校长贬低犹太人和两名教师的言论。

法庭文件指出,这段音频迅速在社交媒体上传播,产生了“深远影响”,导致校长被暂时休假。当局称,这段录音导致校长及其家人面临 “严重风险”,警方甚至在他家安排了警卫。

警方表示,这段录音还导致社交媒体上出现了大量充满仇恨的信息,并使学校的电话被打爆。学校的教学活动一度受到了干扰,一些员工感到不安。

指控文件称:“老师们担心,学校内录音设备可能无处不在。”

法庭文件显示,31岁的达里恩面临的指控包括盗窃、干扰学校活动、跟踪和报复证人等。

巴尔的摩县的州检察官斯科特·舍伦伯格表示,本案似乎是他的办公室能够找到的全美首起涉及人工智能的案件。他表示,马里兰州的立法机构可能需要更新本州法律,以及时防范这种新技术被恶意利用的可能性。

例如,舍伦伯格表示,干扰学校活动的指控“只有6个月的刑期”。

这位检察官表示:“但我们也需要从更广泛的视角,去研究这项技术可能如何被利用和滥用,从而伤害他人。”

对达里恩的指控文件显示,巴尔的摩县的警探已邀请专家对达里恩伪造的录音进行分析。

法庭记录显示,科罗拉多大学丹佛分校(University of Colorado-Denver)的一名教授告诉警方,录音“包含了由人工智能生成内容,然后经过人类编辑的痕迹,为达到逼真效果增加了背景噪音”。

法庭记录称,加州大学伯克利分校(University of California-Berkley)的另一位教授告诉警方,这段音频“由多个录音拼接而成”。

法庭文件称,一名巴尔的摩县的警探发现,达里恩使用了OpenAI和Bingchat等大语言模型,这些模型可以“告诉用户应采取哪些步骤来创建合成媒体文件”。

关于达里恩的在线法庭记录显示,他于周四缴纳了5,000美元保释金。法庭记录中并未列明他的代理律师。

巴尔的摩县警察局局长罗伯特·麦卡洛称,达里恩于4月24日晚上在巴尔的摩/华盛顿瑟古德·马歇尔国际机场登机前被捕。麦卡洛表示,达里恩之所以被拦截,是因为他在乘坐飞机时携带了枪支,然后警方才了解到有一份关于他的逮捕令。

麦卡洛表示,当局于24日晚上在系统中登记了对达里恩的逮捕令,并计划于25日早上执行。他表示,不清楚达里恩为什么要搭乘飞机前往休斯顿,而且他并没有暗示他试图逃跑。

巴尔的摩县学校系统的主管米利亚姆·罗杰斯周四表示,该系统建议解雇达里恩。

与此同时,纽约州立大学水牛城分校(University at Buffalo)媒体取证实验室主任吕思伟表示,人工智能变得越来越强大,同时“非常容易使用”。

吕思伟告诉美联社:“你基本上可以将任何主体的声音上传到这个平台,然后给它提供文本,就可以生成那个人的声音。”

他表示,可以从社交媒体上提取某个人一两分钟的谈话录音,然后用来重现他的声音,当然它做不到始终完美无瑕。

吕思伟的研究重点是识别由人工智能生成的声音和图像。他表示,大语言模型变得更加强大,而检测方法仍在努力跟进。

他说道:“这就像是一场永无止境的猫鼠游戏。但如果按照当前的发展速度来预测,检测手段将严重滞后,因为相比生成式人工智能,我们缺少资源,而且没有获得足够多的关注。”(财富中文网)

翻译:刘进龙

审校:汪皓

马里兰州当局在4月25日表示,该地一所高中的体育总监被指控利用人工智能,在一段包含种族主义和反犹太主义言论的录音中冒充校长。

当局称,这似乎是美国第一起类似的案件,并呼吁制定新法律来防范这种技术。专家还警告称,人工智能变得越来越强大,但检测人工智能的能力可能滞后,需要更多资源。

巴尔的摩县警方表示,达佛恩·达里恩模仿派克斯维尔高中(Pikesville High School)校长的声音,回应两人有关达里恩工作表现不佳以及是否会续约合同的谈话。

警方表示,事情的起因包括达里恩被指控谎称为女子足球队担任教练,从学校资金中支付了1,900美元给他的室友。

警方的指控文件显示,达里恩伪造了一段音频,听起来似乎是校长在对黑人学生和他们的考试能力表达不满。警方称,这段录音还声称录到了校长贬低犹太人和两名教师的言论。

法庭文件指出,这段音频迅速在社交媒体上传播,产生了“深远影响”,导致校长被暂时休假。当局称,这段录音导致校长及其家人面临 “严重风险”,警方甚至在他家安排了警卫。

警方表示,这段录音还导致社交媒体上出现了大量充满仇恨的信息,并使学校的电话被打爆。学校的教学活动一度受到了干扰,一些员工感到不安。

指控文件称:“老师们担心,学校内录音设备可能无处不在。”

法庭文件显示,31岁的达里恩面临的指控包括盗窃、干扰学校活动、跟踪和报复证人等。

巴尔的摩县的州检察官斯科特·舍伦伯格表示,本案似乎是他的办公室能够找到的全美首起涉及人工智能的案件。他表示,马里兰州的立法机构可能需要更新本州法律,以及时防范这种新技术被恶意利用的可能性。

例如,舍伦伯格表示,干扰学校活动的指控“只有6个月的刑期”。

这位检察官表示:“但我们也需要从更广泛的视角,去研究这项技术可能如何被利用和滥用,从而伤害他人。”

对达里恩的指控文件显示,巴尔的摩县的警探已邀请专家对达里恩伪造的录音进行分析。

法庭记录显示,科罗拉多大学丹佛分校(University of Colorado-Denver)的一名教授告诉警方,录音“包含了由人工智能生成内容,然后经过人类编辑的痕迹,为达到逼真效果增加了背景噪音”。

法庭记录称,加州大学伯克利分校(University of California-Berkley)的另一位教授告诉警方,这段音频“由多个录音拼接而成”。

法庭文件称,一名巴尔的摩县的警探发现,达里恩使用了OpenAI和Bingchat等大语言模型,这些模型可以“告诉用户应采取哪些步骤来创建合成媒体文件”。

关于达里恩的在线法庭记录显示,他于周四缴纳了5,000美元保释金。法庭记录中并未列明他的代理律师。

巴尔的摩县警察局局长罗伯特·麦卡洛称,达里恩于4月24日晚上在巴尔的摩/华盛顿瑟古德·马歇尔国际机场登机前被捕。麦卡洛表示,达里恩之所以被拦截,是因为他在乘坐飞机时携带了枪支,然后警方才了解到有一份关于他的逮捕令。

麦卡洛表示,当局于24日晚上在系统中登记了对达里恩的逮捕令,并计划于25日早上执行。他表示,不清楚达里恩为什么要搭乘飞机前往休斯顿,而且他并没有暗示他试图逃跑。

巴尔的摩县学校系统的主管米利亚姆·罗杰斯周四表示,该系统建议解雇达里恩。

与此同时,纽约州立大学水牛城分校(University at Buffalo)媒体取证实验室主任吕思伟表示,人工智能变得越来越强大,同时“非常容易使用”。

吕思伟告诉美联社:“你基本上可以将任何主体的声音上传到这个平台,然后给它提供文本,就可以生成那个人的声音。”

他表示,可以从社交媒体上提取某个人一两分钟的谈话录音,然后用来重现他的声音,当然它做不到始终完美无瑕。

吕思伟的研究重点是识别由人工智能生成的声音和图像。他表示,大语言模型变得更加强大,而检测方法仍在努力跟进。

他说道:“这就像是一场永无止境的猫鼠游戏。但如果按照当前的发展速度来预测,检测手段将严重滞后,因为相比生成式人工智能,我们缺少资源,而且没有获得足够多的关注。”(财富中文网)

翻译:刘进龙

审校:汪皓

A high school athletic director in Maryland has been accused of using artificial intelligence to impersonate a principal on an audio recording that included racist and antisemitic comments, authorities said Thursday.

Authorities said the case appears to be among the first of its kind in the country and called for new laws to guard against the technology. Experts also warned that artificial intelligence is becoming increasingly powerful, while the ability to detect it may lag behind without more resources.

Dazhon Darien faked the voice of Pikesville High School’s principal in response to conversations the men had about Darien’s poor work performance and whether his contract would be renewed, Baltimore County police said.

Concerns included allegations that Darien paid his roommate $1,900 in school funds under the false pretense of coaching the girls soccer team, police said.

Darien forged an audio clip in which it sounded as if the principal was frustrated with Black students and their test-taking abilities, police wrote in charging documents. They said the recording also purported to capture the principal disparaging Jewish individuals and two teachers.

The audio clip quickly spread on social media and had “profound repercussions,” the court documents stated, with the principal being placed on leave. The recording put the principal and his family at “significant risk,” while police officers provided security at his house, according to authorities.

The recording also triggered a wave of hate-filled messages on social media and an inundation of phone calls to the school, police said. Activities were disrupted for a time, and some staff felt unsafe.

“Teachers have expressed fears that recording devices could have been planted in various places in the school,” the charging documents stated.

Darien, 31, faces charges that include theft, disrupting school activities, stalking and retaliating against a witness, according to court documents.

Scott Shellenberger, the Baltimore County state’s attorney, said the case appears to be one of the first of its kind nationwide involving artificial intelligence that his office was able to find. He said Maryland’s Legislature may need to update state laws to catch up with the nefarious possibilities of the new technology.

For example, the charge of disrupting school activities “only carries a 6-month sentence,” Shellenberger said.

“But we also need to take a broader look at how this technology can be used and abused to harm other people,” the prosecutor said.

Baltimore County detectives had asked experts to analyze the recording made by Darien, according to the charges against him.

A professor from the University of Colorado-Denver told police that it “contained traces of AI-generated content with human editing after the fact, which added background noises for realism,” court records stated.

A second opinion from a professor at the University of California-Berkley told police that “multiple recordings were spliced together,” according to the records.

A Baltimore County detective found that Darien had used Large Language Models, such as OpenAI and Bingchat, which can “tell users what steps to take to create synthetic media,” court documents stated.

Online court records for Darien show that he posted $5,000 bond on Thursday. The records did not list an attorney who might be able to speak on his behalf.

Darien was arrested Wednesday evening before he was to board a plane at Baltimore/Washington International Thurgood Marshall Airport, Baltimore County Police Chief Robert McCullough said. Darien was stopped because of how he had packaged his firearm for the flight, leading officers to learn he had a warrant for his arrest, according to McCullough.

McCullough said authorities had entered the warrant for Darien’s arrest into the system on Wednesday night with plans to serve it Thursday morning. The chief said he didn’t know why Darien was catching a flight to Houston and did not suggest that he was trying to escape.

The Baltimore County school system is recommending Darien’s termination, superintendent Myriam Rogers said Thursday.

Meanwhile, artificial intelligence is becoming increasingly powerful and yet “very easy to use,” said Siwei Lyu, director of a media forensics lab at the University at Buffalo.

“You can basically upload any subject’s voice up to this platform,” Lyu told The Associated Press on Thursday. “And then you can give it text and you can start creating voices of that person.”

A recording of someone talking for a minute or two can be gleaned from social media and used to recreate someone’s voice, Lyu said, noting that it’s not always perfect.

Lyu’s research focuses on identifying AI-generated voices and images. He said the models are becoming more powerful, while detection methods are trying to catch up.

“It’s kind of like a perpetual cat-and-mouse game,” Lyu said. “But if I project the speed of development based on today’s situation, detection will lag behind because we have less resources and are not getting as much attention as the generative side.”

财富中文网所刊载内容之知识产权为财富媒体知识产权有限公司及/或相关权利人专属所有或持有。未经许可,禁止进行转载、摘编、复制及建立镜像等任何使用。
0条Plus
精彩评论
评论

撰写或查看更多评论

请打开财富Plus APP

前往打开