As the "point of no return" approaches, experts are developing defenses against runaway artificial intelligence

 

As the "point of no return" approaches, experts are developing defenses against runaway artificial intelligence

American experts specializing in artificial intelligence development are working on creating emergency protection systems against out-of-control algorithms, using other artificial intelligence tools.

Hot Topics

This was reported by the American news website Axios.

The portal said that security issues related to the development of artificial intelligence have resurfaced, after Anthropic researcher Jacob Cookson announced earlier this week his decision to leave the algorithm development sector, justifying his move by saying that the race among technology companies is bringing the world closer to a "point of no return," and may lead to a catastrophic scenario by the end of 2027.

According to Cookson, Anthropic and OpenAI are rushing to develop a super-intelligence capable of improving itself at a faster pace than addressing the safety issues associated with these technologies.

Ivan Huebinger, a researcher at Anthropic, supported this view, saying: "I personally believe that the probability of humanity being wiped out in the next decade is over 10%."

The portal stated: "Companies can shut down some of the servers that AI relies on, but truly powerful systems run on multiple computers and platforms, and there is no single switch that can be pulled to shut them down. That's why companies are experimenting with multi-layered protection systems, capable of detecting suspicious behavior, stopping agents, and cutting off out-of-control systems' access to the resources they need to keep working."

Representatives from OpenAI stated that their goal is to find "completely independent shutdown procedures when serious problems occur," whereby an AI-based monitoring system would alert employees if it appeared that the behavior of AI agents posed a risk, and shut down the system within 30 minutes if the threat was confirmed.

Anthropic is betting on combining human and artificial intelligence, with algorithms monitoring suspicious activity and alerting employees to system errors. However, recent tests have shown that automated monitoring systems were only able to identify 50% of threats.

The Pentagon’s top technology specialist, Emile Michael, had previously stated that concerns about artificial intelligence’s ability to wipe out humanity reflect a fear of confronting change.

US President Donald Trump also stated that the machine revolution resulting from the development of artificial intelligence will not happen, adding that if any threat does emerge, there will be "another little tool".

what is your opinion on this news ?do let us know in the comments on tha comment box

 if you liked this news article please share on friends & family & don't forget to follow on website & social media

 

1 Comments

Previous Post Next Post