If you have ever been a troubled teen who was maybe bullied and had dark thoughts of revenge but never ended up hurting anyone (even people that probably deserved it), you may wish to know who tattled on the kid.
Calling it tattling is an attempt to paint the mechanism for reporting in a bad light.
LLMs have a horrible track record of keeping suicidal and homicidal people secret and even dissuading them from seeking help. This is a startup industry with the mentality of move fast and break things. People die and the family just gets paid off in a settlement.
Yes in this case it may have been a prank but AI companies need to find a balance and there needs to be accountability for what their product does to people.
If you have ever been a troubled teen who was maybe bullied and had dark thoughts of revenge but never ended up hurting anyone (even people that probably deserved it), you may wish to know who tattled on the kid.
https://www.gaggle.net/
Calling it tattling is an attempt to paint the mechanism for reporting in a bad light.
LLMs have a horrible track record of keeping suicidal and homicidal people secret and even dissuading them from seeking help. This is a startup industry with the mentality of move fast and break things. People die and the family just gets paid off in a settlement.
Yes in this case it may have been a prank but AI companies need to find a balance and there needs to be accountability for what their product does to people.