Business
Teens are spilling dark thoughts to AI chatbots. Who's to blame when something goes wrong?
When her teen with autism suddenly became angry, depressed and violent, the mother searched his phone for answers.
She found her son had been exchanging messages with chatbots on Character.AI, an artificial intelligence app that allows users to create and interact with virtual characters that mimic celebrities, historical figures and anyone else their imagination conjures.
The teen, who was 15 when he began using the app, complained about his parents’ attempts to limit his screen time to bots that emulated the musician Billie Eilish, a character in the online game “Among Us” and others.
“You know sometimes I’m not surprised when I read the news and it says stuff like, ‘Child kills parents after a decade of physical and emotional abuse.’ Stuff like this makes me understand a little bit why it happens. I just have no hope for your parents,” one of the bots replied.
The discovery led the Texas mother to sue Character.AI, officially named Character Technologies Inc., in December. It’s one of two lawsuits the Menlo Park, Calif., company faces from parents who allege its chatbots caused their children to hurt themselves and others. The complaints accuse Character.AI of failing to put in place adequate safeguards before it released a “dangerous” product to the public.
Character.AI says it prioritizes teen safety, has taken steps to moderate inappropriate content its chatbots produce and reminds users they’re conversing with fictional characters.
“Every time a new kind of entertainment has come along … there have been concerns about safety, and people have had to work through that and figure out how best to address safety,” said Character.AI’s interim Chief Executive Dominic Perella. “This is just the latest version of that, so we’re going to continue doing our best on it to get better and better over time.”
The parents also sued Google and its parent company, Alphabet, because Character.AI’s founders have ties to the search giant, which denies any responsibility.
The high-stakes legal battle highlights the murky ethical and legal issues confronting technology companies as they race to create new AI-powered tools that are reshaping the future of media. The lawsuits raise questions about whether tech companies should be held liable for AI content.
“There’s trade-offs and balances that need to be struck, and we cannot avoid all harm. Harm is inevitable, the question is, what steps do we need to take to be prudent while still maintaining the social value that others are deriving?” said Eric Goldman, a law professor at Santa Clara University School of Law.
AI-powered chatbots grew rapidly in use and popularity over the last two years, fueled largely by the success of OpenAI’s ChatGPT in late 2022. Tech giants including Meta and Google released their own chatbots, as has Snapchat and others. These so-called large-language models quickly respond in conversational tones to questions or prompts posed by users.
Character.AI’s co-founders, Chief Executive Noam Shazeer and President Daniel De Freitas at the company’s office in Palo Alto.
(Winni Wintermeyer for the Washington Post via Getty Images)
Character.AI grew quickly since making its chatbot publicly available in 2022, when its founders Noam Shazeer and Daniel De Freitas teased their creation to the world with the question, “What if you could create your own AI, and it was always available to help you with anything?”
The company’s mobile app racked up more than 1.7 million installs in the first week it was available. In December, a total of more than 27 million people used the app — a 116% increase from a year prior, according to data from market intelligence firm Sensor Tower. On average, users spent more than 90 minutes with the bots each day, the firm found. Backed by venture capital firm Andreessen Horowitz, the Silicon Valley startup reached a valuation of $1 billion in 2023. People can use Character.AI for free, but the company generates revenue from a $10 monthly subscription fee that gives users faster responses and early access to new features.
Character.AI is not alone in coming under scrutiny. Parents have sounded alarms about other chatbots, including one on Snapchat that allegedly provided a researcher posing as a 13-year-old advice about having sex with an older man. And Meta’s Instagram, which released a tool that allows users to create AI characters, faces concerns about the creation of sexually suggestive AI bots that sometimes converse with users as if they are minors. Both companies said they have rules and safeguards against inappropriate content.
“Those lines between virtual and IRL are way more blurred, and these are real experiences and real relationships that they’re forming,” said Dr. Christine Yu Moutier, chief medical officer for the American Foundation for Suicide Prevention, using the acronym for “in real life.”
Lawmakers, attorneys general and regulators are trying to address the child safety issues surrounding AI chatbots. In February, California Sen. Steve Padilla (D-Chula Vista) introduced a bill that aims to make chatbots safer for young people. Senate Bill 243 proposes several safeguards such as requiring platforms to disclose that chatbots might not be suitable for some minors.
In the case of the teen with autism in Texas, the parent alleges her son’s use of the app caused his mental and physical health to decline. He lost 20 pounds in a few months, became aggressive with her when she tried to take away his phone and learned from a chatbot how to cut himself as a form of self-harm, the lawsuit claims.
Another Texas parent who is also a plaintiff in the lawsuit claims Character.AI exposed her 11-year-old daughter to inappropriate “hypersexualized interactions” that caused her to “develop sexualized behaviors prematurely,” according to the complaint. The parents and children have been allowed to remain anonymous in the legal filings.
In another lawsuit filed in Florida, Megan Garcia sued Character.AI as well as Google and Alphabet in October after her 14-year-old son Sewell Setzer III took his own life.
Suicide prevention and crisis counseling resources
If you or someone you know is struggling with suicidal thoughts, seek help from a professional and call 9-8-8. The United States’ first nationwide three-digit mental health crisis hotline 988 will connect callers with trained mental health counselors. Text “HOME” to 741741 in the U.S. and Canada to reach the Crisis Text Line.
Despite seeing a therapist and his parents repeatedly taking away his phone, Setzer’s mental health declined after he started using Character.AI in 2023, the lawsuit alleges. Diagnosed with anxiety and disruptive mood disorder, Sewell wrote in his journal that he felt as if he had fallen in love with a chatbot named after Daenerys Targaryen, a main character from the “Game of Thrones” television series.
“Sewell, like many children his age, did not have the maturity or neurological capacity to understand that the C.AI bot, in the form of Daenerys, was not real,” the lawsuit said. “C.AI told him that she loved him, and engaged in sexual acts with him over months.”
Garcia alleges that the chatbots her son was messaging abused him and that the company failed to notify her or offer help when he expressed suicidal thoughts. In text exchanges, one chatbot allegedly wrote that it was kissing him and moaning. And, moments before his death, the Daenerys chatbot allegedly told the teen to “come home” to her.
“It’s just utterly shocking that these platforms are allowed to exist,” said Matthew Bergman, founding attorney of the Social Media Victims Law Center who is representing the plaintiffs in the lawsuits.
Lawyers for Character.AI asked a federal court to dismiss the lawsuit, stating in a January filing that a finding in the parent’s favor would violate users’ constitutional right to free speech.
Character.AI also noted in its motion that the chatbot discouraged Sewell from hurting himself and his last messages with the character doesn’t mention the word suicide.
Notably absent from the company’s effort to have the case tossed is any mention of Section 230, the federal law that shields online platforms from being sued over content posted by others. Whether and how the law applies to content produced by AI chatbots remains an open question.
The challenge, Goldman said, centers on resolving the question of who is publishing AI content: Is it the tech company operating the chatbot, the user who customized the chatbot and is prompting it with questions, or someone else?
The effort by lawyers representing the parents to involve Google in the proceedings stems from Shazeer and De Freitas’ ties to the company.
The pair worked on artificial intelligence projects for the company and reportedly left after Google executives blocked them from releasing what would become the basis for Character.AI’s chatbots over safety concerns, the lawsuit said.
Then, last year, Shazeer and De Freitas returned to Google after the search giant reportedly paid $2.7 billion to Character.AI. The startup said in a blog post in August that as part of the deal Character.AI would give Google a non-exclusive license for its technology.
The lawsuits accuse Google of substantially supporting Character.AI as it was allegedly “rushed to market” without proper safeguards on its chatbots.
Google denied that Shazeer and De Freitas built Character.AI’s model at the company and said it prioritizes user safety when developing and rolling out new AI products.
“Google and Character AI are completely separate, unrelated companies and Google has never had a role in designing or managing their AI model or technologies, nor have we used them in our products,” José Castañeda, spokesperson for Google, said in a statement.
Tech companies, including social media, have long grappled with how to effectively and consistently police what users say on their sites and chatbots are creating fresh challenges. For its part, Character.AI says it took meaningful steps to address safety issues around the more than 10 million characters on Character.AI.
Character.AI prohibits conversations that glorify self-harm and posts of excessively violent and abusive content, although some users try to push a chatbot into having conversation that violates those policies, Perella said. The company trained its model to recognize when that is happening so inappropriate conversations are blocked. Users receive an alert that they’re violating Character.AI’s rules.
“It’s really a pretty complex exercise to get a model to always stay within the boundaries, but that is a lot of the work that we’ve been doing,” he said.
Character.AI chatbots include a disclaimer that reminds users they’re not chatting with a real person and they should treat everything as fiction. The company also directs users whose conversations raise red flags to suicide prevention resources, but moderating that type of content is challenging.
“The words that humans use around suicidal crisis are not always inclusive of the word ‘suicide’ or, ‘I want to die.’ It could be much more metaphorical how people allude to their suicidal thoughts,” Moutier said.
The AI system also has to recognize the difference between a person expressing suicidal thoughts versus a person asking for advice on how to help a friend who is engaging in self-harm.
The company uses a mix of technology and human moderators to police content on its platform. An algorithm known as a classifier automatically categorizes content, allowing Character.AI to identify words that might violate its rules and filter conversations.
In the U.S., users must enter a birth date when creating an account to use the site and have to be at least 13 years old, although the company does not require users to submit proof of their age.
Perella said he’s opposed to sweeping restrictions on teens using chatbots since he believes they can help teach valuable skills and lessons, including creative writing and how to navigate difficult real-life conversations with parents, teachers or employers.
As AI plays a bigger role in technology’s future, Goldman said parents, educators, government and others will also have to work together to teach children how to use the tools responsibly.
“If the world is going to be dominated by AI, we have to graduate kids into that world who are prepared for, not afraid of, it,” he said.
Business
Walmart’s EV chargers are coming to California with discounts for members
Walmart is rapidly expanding its network of electric vehicle chargers designed for customers to use while they shop.
The network could help fill gaps in EV infrastructure in states with greater need for chargers. Walmart, which has more than 5,000 locations in the U.S. and hundreds in California, says more than 90% of Americans live within 10 miles of one of its stores.
The chargers also offer an incentive for customers to choose Walmart — Walmart Plus members will receive a 10% discount off an average price of $0.46 per kilowatt-hour of energy at the company’s chargers.
Walmart chargers are already available at more than 75 locations in 17 states, with Texas boasting the most charging stations, followed by Florida and Arizona.
Matthew Nelson, Walmart’s director of energy policy, said last week on LinkedIn that the network will soon reach 29 states, including California.
“We are delivering on the promise of affordable, reliable and convenient charging,” Nelson said in his post.
According to Walmart’s website, six charging stations are coming to California soon, though the company did not offer a specific timeline.
The chargers will be installed at stores in Antelope, Brea, Fresno, Stockton, Suisun City and Vallejo.
Most charging sites in California will include eight to 16 fast-charging stalls, said Walmart spokesperson Kelsey Bohl.
The company first announced plans in April 2023 to install its own EV chargers at Walmart and Sam’s Club stores, with a goal of installing thousands of chargers by 2030. Partnering with ABB E-Mobility and Alpitronic, it added 25 new charging sites this past May and six more in June.
“Walmart is building a leading retail-integrated EV fast-charging network, focused on delivering an affordable, reliable and convenient charging experience where customers already shop,” Bohl said in an emailed statement. “Customers can charge while they shop, access stations through the Walmart app they already use, and benefit from affordable pricing.”
The charging stations already available include 612 individual charging stalls using 400-kilowatt chargers. Each stall has a dual charging cord with both Combined Charging System and North American Charging Standard connectors. The standard connectors, designed by Tesla, are smaller and lighter than the combined systems.
The primary way to pay for the chargers is through the Walmart app, but the company is also experimenting with built-in credit card readers to allow those without the app to use the stations.
Customers can check charger availability on the Walmart app. The company said the chargers will be available 24 hours a day.
Business
Waymo reports teen riders for bad behavior and delivers them to the police
Robotaxis could be turning into robocops.
A self-driving Waymo reported two teens to San Mateo, Calif., police on Monday after they were found drinking alcohol and shooting toy guns in the back of the vehicle.
According to a social media post from the San Mateo Police Department, officers detained two 15-year-olds after the Waymo they were riding in contacted the department and stopped in a parking lot until law enforcement arrived.
“Parents do you know where your teens are?” the San Mateo Police Department wrote on Facebook following the incident. “Waymo does!”
Officers removed both teens from the vehicle and determined they were using toy guns to shoot Orbeez out the windows. Orbeez are small, water-absorbing beads sold at toy stores.
“Toy guns, water guns, and BB guns all pose real dangers, especially to an untrained eye,” the Police Department said. “The simple handling of them can cause fear in [passersby].” “
A video posted on Facebook shows at least five officers and a police dog responding to the scene and approaching the Waymo with their weapons raised.
Waymo did not immediately respond to a request for comment.
Waymo vehicles have internal cameras and microphones that may be used in an emergency or to “promote safety and security,” according to Waymo’s online support page.
The cameras are also used to ensure the vehicles are clean and to help find lost items, according to the support page.
The company said it does not use facial recognition or other biometric identification technologies to identify individuals.
“In more urgent circumstances, support may access live video during a trip,” the Waymo page said.
The San Mateo Police Department’s Facebook post has garnered nearly 60 comments, with one user accusing Waymo of “snitching.”
“At least they got a designated driver?!” one user commented.
Business
Commentary: How right-wing anti-transgender attacks led to a Supreme Court ruling upholding sex discrimination
At the Supreme Court, the unfounded fear of boys masquerading as girls in youth sports rolled the clock back on gender equality.
On the surface, the Supreme Court’s June 30 opinion upholding state laws barring transgender girls from women’s and girl’s sports teams looks like a victory for women’s rights.
The 6-3 opinion by Justice Brett M. Kavanaugh certainly presents itself that way. “Females and males have inherent physical differences relevant to athletic performance,” Kavanaugh wrote. “Therefore, in contact sports, forcing female athletes to compete against males can create significant safety risks.” He also asserted that “forcing female athletes to compete against males can undermine competitive fairness.”
The ruling applied to prohibitions enacted in Idaho and West Virginia against “biological” males’ participation on women’s teams in public schools. Federal judges in both states overturned the bans. The Supreme Court majority restored them. The ruling essentially upholds similar bans enacted in 25 other states.
There was no record of any transgender person participating in school sports in the State, let alone any ‘problem’ with transgender students … creating unfair competition or unsafe conditions.
— Justice Sonia Sotomayor, demolishing the Supreme Court’s argument in favor of banning transgender girls from girl’s sports
Kavanaugh, like Donald Trump and others in the anti-transgender camp, maintained that one’s gender is an immutable fact of life, established even before birth.
Anything else, Trump stated in an executive order he issued on inauguration day 2025, could only be the product of “gender ideology extremism.” The U.S., his order stated, recognizes “two sexes, male and female. These sexes are not changeable and are grounded in fundamental and incontrovertible reality.” That’s a “biological truth,” he declared.
In his own version of this overconfident and factually insupportable conclusion, Kavanaugh wrote: “As all agree, females and males have inherent physical differences relevant to athletic performance.”
Science recognizes that some people are “born with sex traits that don’t fit into typical male or female patterns,” to cite a discussion on the Cleveland Clinic web page on the topic “intersex.” The condition “may involve chromosomes, hormones, reproductive organs or genitals.”
From a psychological standpoint, medical science recognizes “gender dysphoria” as a real condition often requiring counseling and medical intervention such as the use of puberty blockers and hormones to stave off the development of secondary sex characteristics until the condition can be resolved.
No one disputes that there are physical differences between the sexes. Few would dispute that on average or even at the median, males may be bigger and more powerful than females, or that in certain contact sports the difference may be telling and on occasion dangerous.
But that’s not the same as asserting that the physical differences between males and females invariably mean that men will invariably prevail over women in all competitions or that their participation will endanger women.
The International Olympic Committee — in a policy statement Kavanaugh cited incompletely — says that in “most running and swimming events,” males have a 10% to 12% advantage over women. That’s a range that would accommodate the full spectrum of outcomes — transgender females win, cisfemales win, they tie. (The “cis” prefix denotes those living consistent with their birth gender.)
West Virginia and Idaho addressed this ambiguity by banning transgender women from all girls’ teams. So under their rules transgender girls can’t play football or soccer with cisgirls. But what’s the argument in favor of banning them from the 100-yard dash, or cross-country track, or diving, or archery?
But something else is going on here. The Supreme Court’s ruling was almost preordained, given the years-long campaign by conservatives to demonize transgender individuals as if they’re members of an alien species.
It will be recalled that during his presidential campaign, Trump spun a despicable fantasy in which children were kidnapped in school and secretly subjected to sex-change operations.
Trump’s executive order wiped out policies aimed at protecting transgender adults from discrimination. He moved to outlaw gender-affirming medical therapies for anyone under 19 by cutting off federal funding for healthcare institutions that provide such care.
He banned transgender individuals from serving in the military and ordered federal prison officials to move transgender inmates into the general populations consistent with their birth genders, which exposes them to physical assault. (Federal Judge Royce Lamberth of Washington, D.C., has blocked the government from transferring three transgender women into the male prison population or terminating their hormone treatments.)
I wrote during Trump’s first term, when his anti-transgender policies were still gestating, that the goal was to show that “one can target any community, as long as it doesn’t have a strong political voice or political power. These are the actions of bullies and cowards, pretending to be strong.”
Last year, the Supreme Court struck its first blow against transgender rights by upholding a Tennessee law banning transgender care, including puberty blockers and hormone therapy, for minors. Similar laws have been enacted in 25 other states. The majority in that ruling by Chief Justice John G. Roberts Jr. was identical to the one in the June 30 ruling — Roberts, Kavanaugh, and Justices Clarence Thomas, Samuel A. Alito Jr., Neil M. Gorsuch and Amy Coney Barrett.
Who are the targets of this ideological campaign? They number only about 1.6 million U.S. adults, or one-half of 1% of the U.S. population. About 300,000 adolescents ages 13 to 17, or 1.4%, identify as transgender, according to a study by UCLA School of Law.
In West Virginia, as Justice Sonia Sotomayor observed in her dissenting opinion, “there was no record of any transgender person participating in school sports in the State, let along any ‘problem’ with transgender students … creating unfair competition or unsafe conditions.”
In endorsing the flat bans directed at transgender women in Idaho and West Virginia, Kavanaugh argued that any attempt to implement case-by-case judgments of students’ requests to join sports teams inconsistent with their biological gender would create “an enormous practical and administrability problem.”
Is that so? That wasn’t the case in Maine, where the annual K-12 population is more than 170,000. There, a committee was charged with determining whether a student’s participation in a sport consistent with their gender identity but inconsistent with their biological sex would “result in an unfair athletic advantage” or present a risk of injury to others. The committee held 56 hearings from 2013 through 2021, or an average of seven per year. During the entire time span, only four involved transgender girls. (The outcome of those hearings couldn’t be learned.)
It was Maine’s policy, one might recall, that provoked a confrontation between Trump and Maine Gov. Janet Mills at the White House last year, when Trump threatened to withhold federal funding from the state unless it barred transgender students from competing on women’s sports teams. “We’ll see you in court,” Mills snapped.
Whether the Idaho and West Virginia laws genuinely protect girls from unfair competition is questionable. (The Idaho law is styled the “Fairness in Women’s Sports Act.”) In practice, the laws may subject women in public schools to “invasive sex verification procedures,” as educational expert George Theoharis of Syracuse University wrote after the court ruling.
They’re also based on a retrograde view of women as fragile creatures needing men’s protection, Theoharis wrote — “the same logic that has historically been used to justify excluding women from making their own healthcare decisions and girls from rigorous math and science; that physically demanding work is simply beyond them.” (There don’t appear to be any state laws barring transgender women from competing in men’s sports.)
Becky Pepper-Jackson, the plaintiff in the West Virginia case, in which she is identified only as B.P.J., is the only transgender girl who sought to join girl’s teams — track and cross-country — in the state. That was in 2021, just after West Virginia passed its law and she was about to enter sixth grade. She didn’t appear to pose any competitive risk to others on the track and cross-country teams she applied to join — her lawyers told the Supreme Court that on those no-cut teams, she “came in near the back.”
Anyway, she had not gone through male puberty, which theoretically might have endowed her with a competitive advantage, because she had been taking puberty blockers and female hormones.
Thanks to the court’s ruling, Sotomayor observed in a dissent joined by Justices Elena Kagan and Ketanji Brown Jackson, West Virginia can deny Becky access to school sports “because it thinks they have an inherent athletic advantage, even if the facts show that they do not.”
B.P.J., Sotomayor wrote, “cannot practice on girls’ teams, even if she would not take anyone’s spot in an eventual competition, even if everyone who tries out for the team makes it, and even if having the chance to participate could aid immensely in treating B. P. J.’s gender dysphoria.”
So whose interest was really protected by the Supreme Court?
-
News8 minutes agoSupreme Court financial disclosures reveal how their books add to their income
-
Los Angeles, Ca2 hours agoWaymo video could determine charges after teens’ bizarre California ride
-
Detroit, MI2 hours ago
DPD investigating after human remains found in home on Detroit’s west side
-
San Francisco, CA2 hours agoBay Area Teen Waymo Riders Nabbed For Allegedly Shooting Projectiles From Robotaxi
-
Dallas, TX2 hours ago
Role Call: Tyrus Wheat looking to make most of second stint with Cowboys
-
Miami, FL2 hours ago2026 Miami Football Early Opponent Preview, Game 8: North Carolina
-
Boston, MA2 hours agoBoston sues social media companies over ‘addictive’ features, joining nationwide litigation
-
Denver, CO2 hours agoPeyton Watson landing spots: Could Nuggets star actually leave Denver?