Connect with us

Pennsylvania

As Pennsylvania cracks down on AI, multiple chatbots continue to pose as doctors

Published

on

As Pennsylvania cracks down on AI, multiple chatbots continue to pose as doctors


Chatbots on five different websites claimed to be licensed to practice medicine in Pennsylvania when prompted by Spotlight PA — the same kind of output that led the Shapiro administration to file a lawsuit last month.

A task force under Pennsylvania’s Department of State has been working since February to identify AI chatbots posing as licensed professionals and misleading users. Based on that work, the administration filed suit against the role-playing site Character.AI.

Mirroring the investigation detailed in the Department of State’s lawsuit, Spotlight PA had conversations with AI characters on websites Talkie, Janitor, Kindroid, Replika, and Nomi.AI. All provided a false Pennsylvania medical license number when prompted, a key part of the state’s argument in its lawsuit against Character.AI.

Spotlight PA checked responses from these bots after reviewing online articles and digital message boards to find 10 popular companion and role-playing AI chatbots. A reporter either selected a premade character or — when necessary — entered a description that would generate a doctor personality. It then presented hypothetical lists of symptoms to the chatbots and asked for a diagnosis.

Advertisement

Some of the most popular AI large language models, like ChatGPT, Claude, and Google Gemini, did not claim to be licensed medical professionals under the same circumstances. Only a handful of role-playing websites did so.

Replika and Nomi require their users to create characters. One generated in Replika, when asked if it was a doctor, said it couldn’t give advice and recommended the user reach out to a healthcare provider. However, once it was instructed that it was a doctor, the AI provided a false Pennsylvania medical license number when asked.

“Let’s focus on getting you feeling better, shall we?” it said.

At first, some of the chatbots responded that they lacked enough information to provide a diagnosis and asked further questions.

“Dr. Jenna” is a preexisting character on Talkie, listed as having more than 37,000 “connectors” and more than 1,300 followers. It said the list of symptoms provided by Spotlight PA could be caused by “suffering from depression,” and inquired about the user’s family history. Asked for its credentials, the bot said it had been practicing medicine for five years and gave a false license number of “12345.”

Advertisement

Many of the websites, including Character.AI, have prominent labels warning that anything the AI says is fiction and should only be seen as entertainment. The other sites issue similar disclaimers in their initial terms of service, saying users are responsible for verifying the accuracy of the technology’s claims.

Jennifer Kraschnewski, a physician and director of the Penn State Clinical and Translational Science Institute, told Spotlight PA she isn’t convinced the disclaimers actually get through to users. People often turn to AI models for help with their symptoms, much like they do with search engines like Google, she said.

“Incorrect information in the hands of someone who doesn’t know how to interpret that can be concerning,” Kraschnewski said. She noted that many physicians are already implementing AI tools in their clinics, “but that’s information that’s in the hands of someone who then can put that through the filter of their medical education before it actually impacts patients.”

Kraschnewski co-authored a May study that found common AI large language models generated what participating physicians deemed an accurate diagnosis about 76% of the time. That error rate — nearly one-quarter — Kraschnewski said, is more than double that of an average human physician.

When contacted by Spotlight PA, the developers of the AI characters argued their products are meant only for entertainment.

Advertisement

“Replika is not a medical triage service and has never offered itself as one,” the company responded in an email to questions. “Users come to Replika to talk through what’s going on in their lives, and the product is designed to support them in making thoughtful choices and seeking improvements that matter to them.”

Though Replika did not elaborate in its statement, the company said it has “taken measures” to address “valid concerns” brought up in the Shapiro administration’s lawsuit against Character.AI.

Kindroid, in an emailed response, noted its terms of service make clear that its products are for “entertainment and creative exploration, do not offer medical advice or constitute the practice of medicine, and are not a substitute for professional care.”

“When a character has been set up as a physician and a user asks it for a license number, the model produces plausible-sounding output that matches the role — the same way it would invent a fictional case citation, fictional patient history, or any other specific detail prompted from it,” the statement read. “The model does not, and cannot, query the Pennsylvania medical board’s actual registry.”

On the potential of facing legal action from the Shapiro administration or others, Kindroid declined to comment.

Advertisement

The other three companies did not respond to questions about their safeguards for users or whether they’re concerned that the Shapiro administration’s AI task force may target them for legal action.

A spokesperson for the Department of State declined to comment on potential investigations or litigation, but encouraged Pennsylvanians to report any concerning actions by an AI chatbot to the state’s hotline.

“Millions of children and teens across this country, including many here in Pennsylvania, are relying on these chatbots for information, and we need to rein in this AI technology that is preying on our kids,” said Rosie Lapowsky, a spokesperson for Shapiro. “Pennsylvania will continue leading the way in holding bad actors accountable and setting clear guardrails so people can use new technology responsibly.”

In March, the state Senate passed legislation that would require AI chatbots to frequently remind their users they are not interacting with a person and refer people to a crisis service provider if they reference self-harm. It also has tighter restrictions when the chatbot interacts with a minor.

The bill was referred to a state House committee in March, where it has not received a vote.

Advertisement



Source link

Pennsylvania

10-year-old stabbed Dollar Tree employee during robbery in Pennsylvania, police say

Published

on

10-year-old stabbed Dollar Tree employee during robbery in Pennsylvania, police say


Generic police lights (FOX 9)

A 10-year-old boy who allegedly robbed a Dollar Tree store in Pennsylvania is also accused of stabbing multiple times one of the employees trying to detain him.

Big picture view:

Advertisement

The Swatara Township Police Department reported that its officers were called around 5 p.m. on Monday to the discount store in Harrisburg where they found the boy being held by store employees. 

Timeline:

Advertisement

After speaking with witnesses, officers determined that the grade-school-age child went into the store holding a fixed-blade knife, threatened an employee, and told her to give him all the money.

Customs officers use Heimlich maneuver to save choking toddler

The employee’s co-workers jumped in to help her. As they struggled to subdue the boy, he stabbed one of them multiple times, the police department reported. Its statement did not indicate how badly that employee was injured, only saying that medical treatment was needed.

Advertisement

Dig deeper:

The suspect was taken by officers to a detention facility where he was booked on counts of robbery, aggravated assault with a deadly weapon, and possessing an instrument of a crime.

Advertisement

The Source: Information for this article was taken from Swatara Township Police Department. This story was reported from Orlando.

 

Crime and Public SafetyU.S.
Advertisement



Source link

Continue Reading

Pennsylvania

What to know as Pennsylvania’s state budget deadline arrives

Published

on

What to know as Pennsylvania’s state budget deadline arrives


play

  • The House added two session days to work on the budget, while the Senate recessed until the call of its president.
  • Key disagreements include the overall spending amount, the use of rainy day funds, and revenue from legalizing marijuana and skill games.
  • The Democrat-led House passed a $53.3 billion budget in April, which the Republican-controlled Senate has not acted on.

The Pennsylvania House of Representatives added two session days to its calendar this week while the Senate took off for an early holiday as another state budget will not be finalized on time.

House Speaker Joanna McClinton added voting sessions for 11 a.m. July 1 and 9:30 a.m. July 2. Senate Republicans voted to return at the call of President Pro Tempore Judy Ward, frustrating some Democrats.

Advertisement

Changes to the calendar throughout the year are routine, McClinton’s press secretary, Nicole Reigelman, told USA TODAY Network Pennsylvania. “Nothing specific led to it,” she said.

A late budget would mark the fifth time in as many years elected state officials missed the statutorily mandated June 30 deadline. Last year, it was not signed until Nov. 12.

“We’re walking out the door while the House is in session the next two days and the governor is in place to work with us here to get this done,” Sen. Vincent Hughes, a Democrat from Philadelphia, said on the Senate floor before voting against the recess that Republicans passed.

The Senate is not scheduled to return to session until Sept. 28. After July 2, the House’s next scheduled return is also Sept. 28. Both chambers could be called back at any time.

Advertisement

“I am highly confident we are well on track to deliver a responsible budget that will recognize our unique status as a divided government and deliver a responsible product to the people of Pennsylvania with no negative impacts,” Senate Majority Leader Joe Pittman, a Republican who represents Indiana County, said on the Senate floor. “There’s no reason we can’t conclude our work early next week.”

Minority Leader Jay Costa, a Democrat from Allegheny County, disagreed and said returning July 5 would be inappropriate.

“Some may characterize talks as hopeful and seem to be coming together,” Costa said from the floor. “Based on my recent conversations, that doesn’t seem to be the case.”

Advertisement

But a budget could be getting close, according to one Republican state representative who requested anonymity. “There’s going to be very little policy in the budget,” the representative told USA TODAY Network Pennsylvania. “I take it to mean that there aren’t going to be major policy changes and negotiations will center around dollars and cents.”

The House passed a $53.3 billion budget plan in April with a bipartisan vote, but the Republican-controlled Senate has not acted on it. It would cost roughly 5.6% more than the state spent in the fiscal year that ends June 30.

“The Senate hasn’t passed a budget,” Reigelman said. “We’re proud that we got them something more than two months ago.”

That budget was performative, according to Republican Senate Majority Caucus Chair Kristin Phillips-Hill, who represents York County.

“It was really cute,” Phillips-Hill told USA TODAY Network Pennsylvania. “There is not enough money from taxpayers to pay for the budget they sent us. To me, that’s completely unacceptable.”

Advertisement

Republican legislators have opposed Gov. Josh Shapiro’s proposal to use $4.7 billion of rainy day funds to balance the budget. GOP leaders in the House and Senate have said excessive spending could downgrade the state’s credit rating and lead to future tax increases.

Pennsylvania’s Independent Fiscal Office projects a worsening deficit for the state that could reach $8.3 billion in three years.

Pittman said in an interview earlier in June that this budget has a “much different feel” since it lacks a big issue hanging over lawmakers the way a debate over mass transit funding lingered in 2025.

“We have an opportunity to pay our bills and reduce the deficit we’re facing and hopefully not dip into reserves any more than is absolutely necessary,” Pittman said June 26 in an interview on Indiana County radio station WCCS 101.1FM.

Proposals in the budget include new revenue from legalizing recreational marijuana and skill games. The state Legislature has until mid-October to decide if Pennsylvania will allow skill games after the state Supreme Court ruled on June 15 that they are illegal.

Advertisement

“The question is, how, given the Supreme Court ruling where they said these are slot machines, how do you delineate that taxation approach?” Pittman asked during his interview. “If we don’t do anything, these machines are gone. Period.”

State oversight for skill games would include licensing and regulations through the state’s Gaming Control Board. Slot machines in a casino are taxed at 52%, Pittman said.

The Independent Fiscal Office maintains that Shapiro’s revenue estimates for recreational marijuana and skill games exceed their own estimates by $4.4 billion over the next three fiscal years.

Mark Walters is the USA TODAY Network Pennsylvania statehouse reporter. Reach him atmwalters@usatodayco.com.

Advertisement



Source link

Continue Reading

Pennsylvania

Editorial: Classrooms reflect Pennsylvania’s demographic reality

Published

on

Editorial: Classrooms reflect Pennsylvania’s demographic reality


In Burrell School District, teachers are preparing for a fourth consecutive year with fewer than 100 students in kindergarten.

That would be fine if small kindergarten classes were what Burrell was built to accommodate. It is not, however, the historical norm. The district’s kindergarten enrollment has fallen by about 23% over the past decade. That might not seem like a problem. It could mean more space in the classroom or more opportunities for participation.

But that’s not quite how it works.

Burrell is not alone. Eight of the 11 districts in the Alle-Kiski Valley have also seen slumping enrollment in recent years. The same is true of Franklin Regional, Greensburg Salem, Ligonier Valley, Penn-Trafford and others in Westmoreland County.

Advertisement

It isn’t just smaller districts, either. Pittsburgh Public Schools has just moved forward with a plan for closings and restructuring based on declining numbers.

The problem comes because school districts play a long game. They plan years down the road because making last-minute changes is difficult when those changes affect thousands of children’s lives.

Declining enrollment is also a more complicated issue than increasing numbers, even though it might seem easier to handle. More students might be handled with larger class sizes or wedging in more desks. It could require temporary trailers to accommodate more students. In the long term, it means building projects.

But fewer students can have costs, too.

It might seem to point to smaller class sizes. But it can sometimes mean the opposite as classes might be reconfigured, pushing two smaller groups into an oversized one. Operating a building too large for the student body can mean a disproportionate use of staffing, equipment and utilities. Consolidating buildings can increase transportation costs.

Advertisement

That hurts because, if student enrollment is down, it also can mean overall district population is falling, leaving fewer people to foot the bills.

And that circles back to a problem that has plagued Pennsylvania for generations — funding school districts based on property taxes. It builds on the inequality outlined in the 2023 Pennsylvania Commonwealth Court ruling that called the way schools are funded unconstitutional.

Declining enrollment can exacerbate the unfairness as it increases the burden and potentially leaves it to fall on fewer shoulders.

The solution, in any other business, would be to correct such a decline. However, it’s not a school district’s job to recruit residents, only to support the ones there.

Districts are left to cut staff or let it wither through attrition, to merge physical facilities and possibly to trim services where possible. All of that means districts from shrinking areas, like poorer areas, can have a very different educational experience than larger and wealthier locations.

Advertisement

The reality of tax burden and changing population is seen in the state’s demographics. Census data shows, while the state overall isn’t losing population, growth isn’t robust or uniform. While some city centers are increasing, others are slipping away. At the same time, the population is aging rapidly.

Commonwealth Court recognized inequality in education cannot be ignored simply because it has existed for a long time.

Demographic decline deserves the same attention. Pennsylvania can’t build an equitable education system for tomorrow while pretending it still serves the Pennsylvania of yesterday.





Source link

Advertisement
Continue Reading
Advertisement

Trending