Anthropic urges AI labs to pause development, warns humans risk losing control

Bloomberg

Jun 05

Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to ...

Source Link

Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.

Most Discussed

{"basename":"","ssrTDKData":{"titleTemplate":"%s - Tiger Brokers","title":"Tiger Brokers | Global Stocks, Options & Futures Trading App","description":"Tiger Brokers, one-stop investment in US stocks, SGX stocks, HK stocks, A-shares & other global assets. One of the best stock trading platforms in Singapore.","keywords":"tiger brokers,tiger trade,tiger brokers singapore,broker online,stock trading in singapore,share trading singapore,brokerage firm singapore,trading app,stock broker singapore,stock trading platforms,trading account","social":{"ogDescription":"Tiger Brokers, one-stop investment in US stocks, SGX stocks, HK stocks, A-shares & other global assets. One of the best stock trading platforms in Singapore.","ogImage":"https://c1.itigergrowtha.com/portal5/static/media/og-logo.be62fbe1.png","ogUrl":"https://www-web.itiger.com/news/2641146043"},"companyName":"Tiger Brokers"},"pageData":{"isMobile":false,"isTiger":false,"isTTM":true,"region":"SGP","license":"TBSG","edition":"fundamental"},"isCrawlerRequest":true,"__swrFallback__":{"@#url:\"https://stock-news.skytigris.cn/v3/news\",params:#id:\"2641146043\",edition:\"fundamental\",auth_exemption:1,,,undefined,":{"share":"https://ttm.financial/m/news/2641146043?lang=en_US&edition=fundamental","thumbnail":"https://www.bnnbloomberg.ca/resizer/v2/T4YR36GNLU4HEKLZRSKSSJ5EUY.jpg?smart=true&auth=2817a690ab8b4e96187b12bbb6ded7bc0cd836e612fda67905a619adce441d9f&width=800&height=450","is_english":true,"pubTime":"2026-06-05 22:47","share_image_url":"https://static.laohu8.com/e9f99090a1c2ed51c021029395664489","id":"2641146043","market":"nz","top_or_hot":-1,"title":"Anthropic urges AI labs to pause development, warns humans risk losing control","media":"Bloomberg","content":"<div>\n<p>Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to ...</p>\n\n<a href=\"https://www.bnnbloomberg.ca/business/artificial-intelligence/2026/06/05/anthropic-urges-ai-labs-to-pause-development-warns-humans-risk-losing-control/\">Source Link</a>\n\n</div>\n","source":"bnn_bloomberg_highlight","html":"<!DOCTYPE html>\n<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\" />\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1.0,minimum-scale=1.0,maximum-scale=1.0,user-scalable=no\"/>\n<meta name=\"format-detection\" content=\"telephone=no,email=no,address=no\" />\n<title>Anthropic urges AI labs to pause development, warns humans risk losing control</title>\n<style type=\"text/css\">\na,abbr,acronym,address,applet,article,aside,audio,b,big,blockquote,body,canvas,caption,center,cite,code,dd,del,details,dfn,div,dl,dt,\nem,embed,fieldset,figcaption,figure,footer,form,h1,h2,h3,h4,h5,h6,header,hgroup,html,i,iframe,img,ins,kbd,label,legend,li,mark,menu,nav,\nobject,ol,output,p,pre,q,ruby,s,samp,section,small,span,strike,strong,sub,summary,sup,table,tbody,td,tfoot,th,thead,time,tr,tt,u,ul,var,video{ font:inherit;margin:0;padding:0;vertical-align:baseline;border:0 }\nbody{ font-size:16px; line-height:1.5; color:#999; background:transparent; }\n.wrapper{ overflow:hidden;word-break:break-all;padding:10px; }\nh1,h2{ font-weight:normal; line-height:1.35; margin-bottom:.6em; }\nh3,h4,h5,h6{ line-height:1.35; margin-bottom:1em; }\nh1{ font-size:24px; }\nh2{ font-size:20px; }\nh3{ font-size:18px; }\nh4{ font-size:16px; }\nh5{ font-size:14px; }\nh6{ font-size:12px; }\np,ul,ol,blockquote,dl,table{ margin:1.2em 0; }\nul,ol{ margin-left:2em; }\nul{ list-style:disc; }\nol{ list-style:decimal; }\nli,li p{ margin:10px 0;}\nimg{ max-width:100%;display:block;margin:0 auto 1em; }\nblockquote{ color:#B5B2B1; border-left:3px solid #aaa; padding:1em; }\nstrong,b{font-weight:bold;}\nem,i{font-style:italic;}\ntable{ width:100%;border-collapse:collapse;border-spacing:1px;margin:1em 0;font-size:.9em; }\nth,td{ padding:5px;text-align:left;border:1px solid #aaa; }\nth{ font-weight:bold;background:#5d5d5d; }\n.symbol-link{font-weight:bold;}\n/* header{ border-bottom:1px solid #494756; } */\n.title{ margin:0 0 8px;line-height:1.3;color:#ddd; }\n.meta {color:#5e5c6d;font-size:13px;margin:0 0 .5em; }\na{text-decoration:none; color:#2a4b87;}\n.meta .head { display: inline-block; overflow: hidden}\n.head .h-thumb { width: 30px; height: 30px; margin: 0; padding: 0; border-radius: 50%; float: left;}\n.head .h-content { margin: 0; padding: 0 0 0 9px; float: left;}\n.head .h-name {font-size: 13px; color: #eee; margin: 0;}\n.head .h-time {font-size: 11px; color: #7E829C; margin: 0;line-height: 11px;}\n.small {font-size: 12.5px; display: inline-block; transform: scale(0.9); -webkit-transform: scale(0.9); transform-origin: left; -webkit-transform-origin: left;}\n.smaller {font-size: 12.5px; display: inline-block; transform: scale(0.8); -webkit-transform: scale(0.8); transform-origin: left; -webkit-transform-origin: left;}\n.bt-text {font-size: 12px;margin: 1.5em 0 0 0}\n.bt-text p {margin: 0}\n</style>\n</head>\n<body>\n<div class=\"wrapper\">\n<header>\n<h2 class=\"title\">\nAnthropic urges AI labs to pause development, warns humans risk losing control\n</h2>\n\n<h4 class=\"meta\">\n\n\n2026-06-05 22:47 GMT+8&nbsp;&nbsp;&nbsp;<a href=https://www.bnnbloomberg.ca/business/artificial-intelligence/2026/06/05/anthropic-urges-ai-labs-to-pause-development-warns-humans-risk-losing-control/><strong>Bloomberg</strong></a>\n\n\n</h4>\n\n</header>\n<article>\n<div>\n<p>Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to ...</p>\n\n<a href=\"https://www.bnnbloomberg.ca/business/artificial-intelligence/2026/06/05/anthropic-urges-ai-labs-to-pause-development-warns-humans-risk-losing-control/\">Source Link</a>\n\n</div>\n\n\n</article>\n</div>\n</body>\n</html>\n","isBrief":false,"type":0,"news_type":1,"symbol":"ARTY","symbol_name":"ISHARES FUTURE AI & TECH ETF","start_time":0,"source_url":"https://www.bnnbloomberg.ca/business/artificial-intelligence/2026/06/05/anthropic-urges-ai-labs-to-pause-development-warns-humans-risk-losing-control/","article_id":"2641146043","we_media_id":null,"thumbnails":["https://www.bnnbloomberg.ca/resizer/v2/T4YR36GNLU4HEKLZRSKSSJ5EUY.jpg?smart=true&auth=2817a690ab8b4e96187b12bbb6ded7bc0cd836e612fda67905a619adce441d9f&width=800&height=450"],"rights":{"source":"bnn_bloomberg_highlight","url":"https://www.bnnbloomberg.ca/business/artificial-intelligence/2026/06/05/anthropic-urges-ai-labs-to-pause-development-warns-humans-risk-losing-control/","rn_cache_url":null,"directOrigin":true},"url":"https://stock-news.laohu8.com/highlight/detail?id=2641146043","pubTimestamp":1780670820,"columns":[],"sourceInfo":{"source_id":"bnn_bloomberg_highlight","name":"Bloomberg"},"weMediaInfo":null,"summary":"Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to improve themselves faster than society can manage the risks.","collect":0,"end_time":0,"defaultTopTitle":"bnnbloomberg.ca","property":[],"viewcount":null,"language":"en","relate_stocks":{"ARTY":"ISHARES FUTURE AI & TECH ETF","BK4587":"ChatGPT概念","AGIX":"通用人工智能 ETF-AGIX","BK4528":"SaaS概念","BK4588":"碎股","AIPO":"Defiance AI and Power Infrastructure ETF","BK4023":"应用软件","BK4585":"ETF&股票定投概念","CHAT":"ROUNDHILL GENERATIVE AI & TECHNOLOGY ETF","BK4543":"AI","AI":"C3.ai, Inc.","AIYY":"YIELDMAX AI OPTION INCOME STRATEGY ETF","BK4551":"寇图资本持仓"},"translate_title":"Anthropic敦促人工智能实验室暂停开发，警告人类有失去控制的风险","themeId":null,"isJumpTheme":false,"ttsUrl":null,"symbols_score_info":{"AIYY":0.6,"AGIX":1.5,"AIPO":1.5,"ARTY":1.5,"AI":0.9,"CHAT":1.5},"content_text":"Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to improve themselves faster than society can manage the risks.The Claude creator said AI’s ability to complete tasks on its own has been doubling roughly every four months and it was headed for “recursive self-improvement,” the point at which the technology can improve without human intervention.“If systems are capable of fully building their own successors, the ways we secure them, monitor them, and shape their behavior all grow much more important,” the startup said in a lengthy blog post on Thursday, adding that a pause would allow society to “deal with its immense implications.”“We are not there yet, and recursive self-improvement is not inevitable. But it could come sooner than most institutions are prepared for,” Anthropic co-founder Jack Clark and Anthropic Institute lead Marina Favaro wrote in the post.Fears that advanced AI systems may get out of human control and cause societal harm have risen as the technology becomes increasingly capable. Anthropic’s own Mythos model sent shockwaves through industries including banking and software earlier this year with its ability to find vulnerabilities in existing code.Latest updates on artificial intelligence news hereBut regulation has been slow, especially in the U.S. where most leading AI labs are based. A Trump administration executive order earlier this week put the onus on the labs themselves, asking them to voluntarily submit their most capable models for government cybersecurity testing before public release.AI researchers have also urged a pause before but had little success. Elon Musk, who owns AI lab xAI, was among backers of a 2023 push by the non-profit Future of Life Institute to halt AI development for six months to allow time for safety guardrails.Anthropic has long positioned itself as a safety-focused AI lab. Earlier this year, it refused to let the U.S. military use its models for domestic surveillance and fully autonomous weapons, prompting backlash from the government which put it on a national security blacklist, set to take effect later in 2026.Reuters reported on Friday the dispute was showing signs of easing across parts of the U.S. government.Still, Anthropic has continued to release increasingly powerful models and in February walked back a key safety pledge, saying that it would no longer hold back potentially dangerous AI if rivals were close to matching its capabilities.It was recently valued at $965 billion in a massive funding round and confidentially filed for a U.S. initial public offering on Monday, putting it ahead of rival OpenAI in both valuation and the race to secure crucial funding.COORDINATED ACTIONAnthropic’s Thursday post cautioned that unilateral or poorly coordinated slowdowns could backfire if less cautious actors continue advancing, potentially reducing overall safety.It said that a meaningful pause would require agreement among “multiple well-resourced labs” operating at the technological frontier, as well as rules on what conditions would trigger or lift such a pause and who would oversee it.“A unilateral pause by one lab, by contrast, is achievable immediately, but accomplishes much less: it would change who the front-runner is, but it would not create the wider deliberative process that is currently missing,” the startup said.Its research arm, Anthropic Institute, plans to study systems needed to support a slowdown and in the coming months will convene policymakers, researchers, civil society groups and rival AI firms to discuss managing risks such as recursive self-improvement.OpenAI, xAI, Alphabet, Meta Platforms and France’s Mistral did not immediately respond to requests for comment on whether they would join the call.(Reporting by Aditya Soni in Bengaluru and Juby Babu in Mexico City; Editing by Shreya Biswas and Saumyadeb Chakrabarty)RELATED ARTICLES:Anthropic Mythos access to grow four-fold to about 200 Glasswing partnersAI giant Anthropic confidentially files for U.S. IPO as investors bet big on AI future","kind":"highlight","is_publish_news":true,"is_publish_highlight":false,"is_publish_live":false,"is_publish_wemedia":null,"editions":null,"column":"","sentiment":"0","news_tag":"","news_rank":0,"isVideo":false,"video":null,"symbols":[],"gpt_button":0,"need_auth":false,"need_login_tip":false,"code":"91000000","status":"200"}}}