Anthropic Debuts New 'Constitution' for AI to Police Itself
According to Kaplan, though, Anthropic’s tests show the constitutional model does a better job of bringing AI to heel. “We trained models constitutionally and compared them to models trained with human feedback we collected from our prior research,” Kaplan said. “We basically A/B tested them, and asked people,hich of these models is giving outputs that are more helpful and less harmless?’ We found that the constitutional models did as well, or better, in those evaluations.
Coupled with other advantages—including transparency, doing away with crowdsourced workers, and the ability to update an AI’s constitution on the fly—Kaplan said that makes Anthropic’s model superior.Still, the AI constitution itself demonstrates just how bizarre and difficult the problem is. Many of the principles outlined in the constitution are basically identical instructions phrased in different language.
Anyone who’s tried to get ChatGPT or another AI to do something complicated will recognize the issue: it’sthe developer who’s actually building the tech.“The general problem is these models have such a huge surface area. Compare them to a product like Microsoft Word that just has to do one very specific task, it works or it doesn’t,” Kaplan said. “But with these models, you can ask them to write code, make a shopping list, answer personal questions, almost anything you can think of.
It’s an admission that, at least for now, AI is out of control. The people building AI tools may have good intentions, and most of the time chatbots don’t barf up anything that’s harmful, offensive, or disquieting. Sno one’s figured out how to make them stop. It could be a matter of time and energy, or it could be a problem that’s impossible to fix with 100% certainty.
Deutschland Neuesten Nachrichten, Deutschland Schlagzeilen
Similar News:Sie können auch ähnliche Nachrichten wie diese lesen, die wir aus anderen Nachrichtenquellen gesammelt haben.
Man attacks Chicago police officer with knife during robbery, police sayThe police officer is in good condition after being cut in the arm and head, police said.
Weiterlesen »
Ogden police beating of man on ground was ‘severe abuse of police power,’ lawsuit allegesThe family of a 30-year-old man who was beaten by Ogden police officers during his April 22 arrest sued the law enforcement agency in federal court Monday.
Weiterlesen »
Chile right-wing parties hold big lead in vote on new constitution advisersChilean right-wing parties are projected to win a majority in a vote on Sunday to elect advisers to draft a new constitution, marking a sharp shift from a progressive majority that drafted a failed first constitutional rewrite.
Weiterlesen »
Chile right-wing parties win majority in vote to draft new constitutionChilean right-wing parties won a majority of votes on Sunday to elect advisers to draft a new constitution, marking a sharp shift from a progressive majority that drafted a failed first constitutional rewrite.
Weiterlesen »
Uzbekistan declares early presidential poll after updating constitutionPresident Shavkat Mirziyoyev says the updated constitution sets “new political, social and economic tasks for the president, parliament, government, ministers, and governors that cannot be delayed.'
Weiterlesen »
Chilean Right-Wing Wins Control of Council Tasked With Writing New Constitution'I want to invite the Republican Party, that's won an unquestionable majority, to not make the same mistakes we made,' leftist President Gabriel Boric said. 'This process can't be about vendettas, but putting Chile first.'
Weiterlesen »