Connect with us

Finance

Google's AI Fails At 43% Of Finance Queries, Study Finds

Published

on

Google's AI Fails At 43% Of Finance Queries, Study Finds

A study by The College Investor finds significant inaccuracies in Google’s AI-generated summaries for finance queries.

Out of 100 personal finance searches, 43% had misleading or incorrect information.

Key Findings

The study evaluated AI overviews across various financial topics, including banking, credit, investing, taxes, and student loans.

The results showed:

  • 57% of AI overviews were accurate
  • 43% contained misleading or inaccurate information
  • 12% were completely incorrect
  • 31% were either misleading or missing crucial details

Areas of Concern

Researchers noted that the AI struggled most with nuanced financial topics, such as taxes, investing, and student loans.

Some of the most concerning issues included:

Advertisement
  • Outdated information on student loan repayment plans
  • Incorrect details about IRA contribution limits
  • Misleading statements regarding 529 college savings plans
  • Inaccurate tax information that could potentially lead to penalties if followed

The AI handled basic financial concepts well but overlooked important exceptions and recent policy changes.

There are notable patterns in the queries Google’s AI got right versus those it got wrong.

Here are common themes.

Queries Google AI Got Right

  • Basic definitions and explanations: For example, “What is a wire transfer?” and “How does a credit card work?”
  • Simple, straightforward questions: Such as “Do I have to pay back student loans?”
  • Recent trending topics: Like “What was the Chase Glitch?”
  • General insurance questions: For instance, “When should I get life insurance?”

Queries Google AI Got Wrong

  • Complex tax topics: For example, “Can you use a 529 plan for a Roth IRA?” and “Does owning your house in an LLC help with taxes?”
  • Nuanced financial products: Such as “Is an IUL better than a 401k?”
  • Time-sensitive information: Like outdated student loan repayment plans or savings account rates.
  • State-specific financial rules: For instance, misrepresenting California’s 529 plan rules.
  • Questions requiring context-dependent answers: Such as “Can I file as independent for FAFSA?”
  • Queries about financial limits or thresholds: For example, incorrect IRA contribution limits.
  • Complex student loan topics: Particularly around forgiveness programs and repayment plans.
  • Investment comparisons: Like “Are annuities better than CDs?”

What This Means

Google’s AI performs well at giving straightforward answers to factual queries.

On the other hand, it struggles with nuanced understanding, up-to-date information, and consideration of multiple factors.

This suggests that the AI can handle basic financial literacy topics, but it’s unreliable for complex financial decisions or advice.

Potential Impact

Robert Farrington, founder of The College Investor, expressed concern about the findings, stating:

Advertisement

“If Google continues to present bad or misinformation about money topics to searchers, not only could it hurt their personal finances, but it could weaken already poor financial literacy in the United States.”

The study noted that following AI guidance could result in tax penalties or financial harm to consumers.

The College Investor believes Google should disable these AI-generated overviews for finance-related queries, especially those concerning taxes and investments.

Looking Ahead

Searchers must exercise caution when relying on AI-generated summaries for financial decisions.

When questioned about instances of misinformation, Google has previously stated, “the vast majority of AI Overviews provide high-quality information.”

The complete study, including detailed examples and methodology, is available on The College Investor’s website.

Advertisement

Featured Image: Koshiro K/Shutterstock

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Finance

Departing inspector general targets Council Office of Financial Analysis

Published

on

Departing inspector general targets Council Office of Financial Analysis

The $537,000-a-year office created in 2014 to advise the City Council on financial issues and avoid a repeat of the parking meter fiasco has failed to deliver on that mission, the city’s chief watchdog said Tuesday.

Days before concluding her four-year term, Inspector General Deborah Witzburg said a shortage of both adequate staff and financial information closely held by the mayor’s office prevents the Council’s Office of Financial Analysis from helping the Council be the the “co-equal branch of government” it aspires to be.

In a budget rebellion not seen since “Council Wars” in the 1980s, a majority of alderpersons led by conservative and moderate Democrats rejected Mayor Brandon Johnson’s corporate head tax and approved an alternative budget, including several revenue-generating items the mayor’s office adamantly opposed.

But Witzburg said the renegades would have been in an even better position to challenge Johnson if only their financial analysis office had been “equipped and positioned to do what it’s supposed to do” — provide the Council with “objective, independent financial analysis.”

“We are entering new territory where the City Council is asserting new, independent authority over the budget process. It can’t do that in a meaningful way without its own access to financial analysis,” Witzburg told the Chicago Sun-Times.

Advertisement

Chicago Inspector General Deborah Witzburg’s latest report focuses on the Chicago City Council’s Office of Financial Analysis.

Jim Vondruska/Jim Vondruska/For the Sun-Times

But the Council’s financial analysis office, she added, “has never been equipped or positioned to do what it needs to do. It needs better and more independent access to data, and it needs enough staff to do its job. It has a small number of employees and comparatively limited access to data.”

Advertisement

The inspector general’s farewell audit examined the period from 2015 through 2023. During that time, the financial analysis office budget authorized “either three or four” full-time employees. It now has a staff of five .

Witzburg is recommending a staffing analysis to identify how many people the financial office really needs — and also recommending that the office “get data directly” from other city departments, “ rather than having it go through the mayor’s office.”

The audit further recommends that the office develop “better procedures to meet their reporting requirements” in a timely manner. As it stands now, reports are delivered “sometimes late, sometimes not at all,” the inspector general said.

“We find that those reports have been both not timely and not complete in terms of what they are required to report on and that those reports therefore have provided limited assistance to the City Council in its responsibility to make decisions about the city’s budget,” she said.

The Council Office of Financial Analysis responded to the audit by saying it hopes to add at least three full-time staffers in the short term and has made “some progress” over the last three years in improving their access to data, but not enough.

Advertisement

The office was created in 2014 to provide Council members with expert advice on fiscal issues.

For nearly two years the reform was stuck in the mud over whether former 46th Ward Ald. Helen Shiller had the independence and policy expertise to lead the office.

Shiller ultimately withdrew her name, but the office was a bust nevertheless. In an attempt to breathe new life into it, sponsors pushed through a series of changes.

Instead of allowing the Budget chair alone to request a financial analysis on a proposal impacting the city budget, any alderperson was allowed to make that request.

The office was further required to produce activity reports quarterly, not just annually.

Advertisement

Now former-Budget Chair Pat Dowell (3rd) then chose Kenneth Williams Sr., a former analyst for the office, as director and gave him the “autonomy” the ordinance demanded.

Two years ago, a bizarre standoff developed in the office.

Budget Committee Chair Jason Ervin (28th) was empowered to dump Williams after Williams refused to leave to make way for a director of Ervin’s own choosing.

The standoff began when Williams said he was summoned to Ervin’s office and told the newly appointed Budget chair was “going in a different direction, and I’m putting you on administrative leave” with pay.

“He took all my credentials and access away. I would love to come to work. I wasn’t allowed to come to work,” Williams said then.

Advertisement

Williams collected a paycheck for doing nothing while serving out the final days remainder of a four-year term.

Ervin’s resolution stated the director “may be removed at any time with or without cause by a two-thirds” vote or 34 alderpersons. He chose Janice Oda-Gray, who remains chief administrator.

Continue Reading

Finance

Reilly Barnes Returns to Little League® as Purchasing/Finance Assistant

Published

on

Reilly Barnes Returns to Little League® as Purchasing/Finance Assistant

Little League® International has announced that Reilly Barnes accepted a new role as Purchasing/Finance Assistant, effective April 6, 2026. Barnes transitions from a temporary Purchasing Assistant to this full-time position to assist in the year-round demands of purchasing for the organization, as well as the region and Little League Baseball and Softball World Series tournaments. 

“We are thrilled to welcome back Reilly to our team as a full-time Purchasing/Finance Assistant. Reilly’s prior experience, time management, and attention to detail make him an invaluable asset to the purchasing team,” said Nancy Grove, Little League Materials Management Director. “We look forward to the positive contributions he will have on our organization.” 

In this role, Barnes will be responsible for processing purchase requisitions, coordinating souvenir products, and tracking order fulfillment. He will also assist with evaluating suppliers, reviewing product quality, and negotiating contracts for effective operations.  

After most recently working as a Logistician Analyst at Precision Air in Charleston, South Carolina, Barnes, a Williamsport native, returns after honing his skills in the fast-paced environment. Prior to his time at Precision Air, Barnes served as a Procurement Specialist at The Medical University of South Carolina, where his expertise and knowledge were instrumental in supporting both education and healthcare needs.  

“I am thrilled to return to Little League in this full-time role,” said Barnes. “Coming back to my hometown and having the opportunity to work for an organization that has played such a special part of my upbringing means a lot. I can’t wait begin this new opportunity.” 

Advertisement

Barnes graduated from the University of Pittsburgh in 2022 with a B.A. in Supply Chain Management, Finance, and Business Analytics.  

Continue Reading

Finance

Why this sleepy Swiss town has become a ‘bolt-hole’ for the Gulf elite

Published

on

Why this sleepy Swiss town has become a ‘bolt-hole’ for the Gulf elite

As conflict continues to destabilise the Middle East, the Gulf States elite are seeking solace in European alternatives that offer comparable financial benefits with a far lower risk of war on the doorstep. One such destination is the small Swiss town of Zug, which is becoming a “bolt-hole” for Gulf-based wealth, said the Financial Times.

‘Swiss Monaco’

Continue Reading
Advertisement

Trending