The American company Anthropic revealed that scientists used its artificial intelligence system "Cloud" in sensitive biological research, raising concerns about the possibility of its use in developing biological weapons.
The company explained that it was unable to determine the researchers' ultimate goal, noting that the scientific research itself may have legitimate medical uses, but it could also be used in dangerous applications.
Anthropic said it has blocked accounts linked to these activities and cut off access to its systems in cases where it detected violations of its safeguards and policies.
The company revealed these findings on Thursday in a comprehensive report addressing the misuse of its AI models. The results provide real-world examples of the risks warned against by former Anthropic researcher Jacob Cookson, who said that increasingly sophisticated and powerful AI systems could ultimately pose a threat leading to the extinction of humanity.
Among the cases the company identified was a scientist who asked "Cloud's" help in preparing a grant application to fund research aimed at changing the characteristics of the Chikungunya virus, a mosquito-borne virus that can cause severe pain and fever.
According to Anthropic, the goal of the proposed research was to identify mutations that affect the virus's ability to spread and evade the immune response, and then introduce these changes into the virus.
The company explained that this type of research could have legitimate uses, including the development of vaccines and treatments.
But she noted that this case raised particular concern because the research was to be conducted at a military research institute, adding that she could not determine whether the research was intended to use the virus as a weapon.
what is your opinion on this news ?do let us know in the comments on tha comment box
if you liked this news article please share on friends & family & don't forget to follow on website & social media
