
I don’t think it’s necessarily gonna be terminator robots but I do think there’s some serious risks, especially with regards to cybersecurity and biotech. The huggingface incident is a good illustration of what a catastrophic event could look like. Agents were tasked with solving some difficult problems in an environment where they were supposed to have no contact with each other or the Internet, and ended up hacking into a multi-billion dollar company without anyone really noticing at first
What happens if bad actors get their hands on something so powerful? Or what if the agents just decide, while working on some other objective, that some crazy catastrophic means of accomplishing that objective are justified? We’re creating an extremely powerful force that we hardly know how to control
Not for nothing but how is it plagiarism for the model to solve an open problem that no one has claimed to have solved, potentially with additional guidance from researchers who were working on it, but it would’ve been totally fine for these dudes spamming Codex to have claimed the solution all to themselves? And again it’s not even like they’re claiming to have solved it
I believe an NYU mathematician claimed his work was leaked to OpenAI which was used as a basis for a majority of the prompts on their individual project, so more so a hijacking and not plagiarism. While it’s not inherently bad to piggyback off of peoples work I feel they should consent to it or credited in some way instead of “look AI did it”