Connect with us

Technology

OpenAI is plagued by safety concerns

Published

on

OpenAI is plagued by safety concerns

OpenAI is a leader in the race to develop AI as intelligent as a human. Yet, employees continue to show up in the press and on podcasts to voice their grave concerns about safety at the $80 billion nonprofit research lab. The latest comes from The Washington Post, where an anonymous source claimed OpenAI rushed through safety tests and celebrated their product before ensuring its safety.

“They planned the launch after-party prior to knowing if it was safe to launch,” an anonymous employee told The Washington Post. “We basically failed at the process.”

Safety issues loom large at OpenAI — and seem to just keep coming. Current and former employees at OpenAI recently signed an open letter demanding better safety and transparency practices from the startup, not long after its safety team was dissolved following the departure of cofounder Ilya Sutskever. Jan Leike, a key OpenAI researcher, resigned shortly after, claiming in a post that “safety culture and processes have taken a backseat to shiny products” at the company.

Safety is core to OpenAI’s charter, with a clause that claims OpenAI will assist other organizations to advance safety if AGI is reached at a competitor, instead of continuing to compete. It claims to be dedicated to solving the safety problems inherent to such a large, complex system. OpenAI even keeps its proprietary models private, rather than open (causing jabs and lawsuits), for the sake of safety. The warnings make it sound as though safety has been deprioritized despite being so paramount to the culture and structure of the company.

It’s clear that OpenAI is in the hot seat — but public relations efforts alone won’t suffice to safeguard society

Advertisement

“We’re proud of our track record providing the most capable and safest AI systems and believe in our scientific approach to addressing risk,” OpenAI spokesperson Taya Christianson said in a statement to The Verge. “Rigorous debate is critical given the significance of this technology, and we will continue to engage with governments, civil society and other communities around the world in service of our mission.” 

The stakes around safety, according to OpenAI and others studying the emergent technology, are immense. “Current frontier AI development poses urgent and growing risks to national security,” a report commissioned by the US State Department in March said. “The rise of advanced AI and AGI [artificial general intelligence] has the potential to destabilize global security in ways reminiscent of the introduction of nuclear weapons.”

The alarm bells at OpenAI also follow the boardroom coup last year that briefly ousted CEO Sam Altman. The board said he was removed due to a failure to be “consistently candid in his communications,” leading to an investigation that did little to reassure the staff.

OpenAI spokesperson Lindsey Held told the Post the GPT-4o launch “didn’t cut corners” on safety, but another unnamed company representative acknowledged that the safety review timeline was compressed to a single week. We “are rethinking our whole way of doing it,” the anonymous representative told the Post. “This [was] just not the best way to do it.”

In the face of rolling controversies (remember the Her incident?), OpenAI has attempted to quell fears with a few well timed announcements. This week, it announced it is teaming up with Los Alamos National Laboratory to explore how advanced AI models, such as GPT-4o, can safely aid in bioscientific research, and in the same announcement it repeatedly pointed to Los Alamos’s own safety record. The next day, an anonymous spokesperson told Bloomberg that OpenAI created an internal scale to track the progress its large language models are making toward artificial general intelligence.

This week’s safety-focused announcements from OpenAI appear to be defensive window dressing in the face of growing criticism of its safety practices. It’s clear that OpenAI is in the hot seat — but public relations efforts alone won’t suffice to safeguard society. What truly matters is the potential impact on those beyond the Silicon Valley bubble if OpenAI continues to fail to develop AI with strict safety protocols, as those internally claim: the average person doesn’t have a say in the development of privatized-AGI, and yet they have no choice in how protected they’ll be from OpenAI’s creations.

“AI tools can be revolutionary,” FTC chair Lina Khan told Bloomberg in November. But “as of right now,” she said, there are concerns that “the critical inputs of these tools are controlled by a relatively small number of companies.”

If the numerous claims against their safety protocols are accurate, this surely raises serious questions about OpenAI’s fitness for this role as steward of AGI, a role that the organization has essentially assigned to itself. Allowing one group in San Francisco to control potentially society-altering technology is cause for concern, and there’s an urgent demand even within its own ranks for transparency and safety now more than ever.

Advertisement
Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Technology

Amazon Prime will shut down its clothing try-on program

Published

on

Amazon Prime will shut down its clothing try-on program

Given the combination of Try Before You Buy only scaling to a limited number of items and customers increasingly using our new AI-powered features like virtual try-on, personalized size recommendations, review highlights, and improved size charts to make sure they find the right fit, we’re phasing out the Try Before You Buy option, effective January 31, 2025. Of course, customers will continue to enjoy fast, free shipping, with easy, free returns on our full apparel selection.

Continue Reading

Technology

Fox News AI Newsletter: Tech leaders' message to Biden

Published

on

Fox News AI Newsletter: Tech leaders' message to Biden

Welcome to Fox News’ Artificial Intelligence newsletter with the latest AI technology advancements.

IN TODAY’S NEWSLETTER:

– Tech industry leaders urge Biden not to cement rule they say could diminish US global leadership on AI
– Sam Altman responds to lawsuit, allegations of abuse from sister
– As a Berkeley professor, I see the impact H-1B visas and AI have on students’ job opportunities
– Top tech stealing the show at CES 2025

PUSH BACK: The new rule, which industry leaders say could come as early as the end of this week, effectively seeks to shore up the U.S. economy and national security efforts by adding new restrictions on how many U.S.-made artifical intelligence products can be deployed across the globe. 

AI robots Nvidia

Jensen Huang, co-founder and chief executive officer of Nvidia Corp., speaks during the Nvidia GPU Technology Conference (GTC) in San Jose, Calif., on Monday, March 18, 2024.  (David Paul Morris/Bloomberg via Getty Images)

‘UTTERLY UNTRUE’: Open AI CEO Sam Altman on Tuesday responded to a lawsuit in which his sister accused him of sexually abusing her for nearly a decade. Altman, along with his mother and two brothers, issued a joint statement denying the claims of his sister, Ann Altman.

Advertisement
Sam Altman

Sam Altman, chief executive officer of OpenAI, speaks during the Bloomberg Technology Summit in San Francisco on Thursday, June 22, 2023. (David Paul Morris/Bloomberg via Getty Images)

LOW COST LABOR: The H-1B visa program was intended to bring in specialized talent from abroad, but instead it has become a tool for employers to hire lower-cost labor for ordinary jobs.

Visa application

Illustrative picture showing an application for the United States of America work visa H1B with a pen.

BEST OF CES: Get ready for some pretty cool innovations that are lighting up CES 2025, the world’s biggest annual tech event. From AI-powered smart glasses to revolutionary TVs and mind-blowing gadgets, this year’s show is proving that the future isn’t just knocking. It’s bursting through the door.

Top tech stealing the show at CES 2025

Samsung Food app. (Kurt “CyberGuy” Knutsson)

Subscribe now to get the Fox News Artificial Intelligence Newsletter in your inbox.

FOLLOW FOX NEWS ON SOCIAL MEDIA

Facebook
Instagram
YouTube
Twitter
LinkedIn

SIGN UP FOR OUR OTHER NEWSLETTERS

Advertisement

Fox News First
Fox News Opinion
Fox News Lifestyle
Fox News Health

DOWNLOAD OUR APPS

Fox News
Fox Business
Fox Weather
Fox Sports
Tubi

WATCH FOX NEWS ONLINE

Fox News Go

Advertisement

STREAM FOX NATION

Fox Nation

Stay up to date on the latest AI technology advancements and learn about the challenges and opportunities AI presents now and for the future with Fox News here.

Continue Reading

Technology

How Watch Duty’s wildfire tracking app became a crucial lifeline for LA

Published

on

How Watch Duty’s wildfire tracking app became a crucial lifeline for LA

If you live in Los Angeles, you are probably already intimately familiar with Watch Duty, the free app that shows active fires, mandatory evacuation zones, air quality indexes, wind direction, and a wealth of other information that everyone, from firefighters to regular people, have come to rely on during this week’s historic and devastating wildfires.

Watch Duty is unique in the tech world in that it doesn’t care about user engagement, time spent, or ad sales. The 501(c)(3) nonprofit behind it only cares about the accuracy of the information it provides and the speed with which the service can deliver that information. The app itself has taken off, rocketing to the top of Apple’s and Google’s app stores. Over 1 million people have downloaded it over the last few days alone. 

The elegance of the app lies in its simplicity. It doesn’t scrape user data, show ads, require any kind of login, or track your information. Its simple tech stack and UI — most of which is maintained by volunteer engineers and reporters — has likely helped save countless lives. While Watch Duty is free to use, the app accepts tax-deductible donations and offers two tiers of membership that unlock additional features, like a firefighting flight tracker and the ability to set alerts for more than four counties.

With plans to expand the service across the United States, as well as overseas and into other emergency services, Watch Duty may eventually replace some of the slower and less reliable local government alert systems for millions of people.

Photo by Lokman Vural Elibol / Anadolu via Getty Images

Advertisement

An app born from fire

The idea for Watch Duty came to cofounder John Mills while he was trying to protect his off-grid Sonoma County home from the Walbridge fire in 2020. He realized there wasn’t a single source for all the information people needed to protect themselves from the blaze, which ultimately killed 33 people and destroyed 156 homes. John and his friend David Merritt, who is Watch Duty’s cofounder and CTO, decided to build an app to help.

“This came out of an idea that John had, and he talked to me about it four years ago,” Merritt tells The Verge. “We built the app in 60 days, and it was run completely by volunteers, no full-time staff. It was a side project for a lot of engineers, so the aim was to keep it as simple as possible.”

Fire reporting is piecemeal at best in fire-prone areas and frequently scattered across platforms like Facebook and X, where fire departments and counties have verified pages sharing relevant updates. But increasingly, social media platforms are putting automated access for alert services behind paywalls. Governments also use a wide variety of alert systems, causing delays that can cost lives, especially in fast-moving fires like the Palisades and Eaton fires that have forced evacuations for more than 180,000 people. And sometimes, these government-run alerts are sent out mistakenly, causing mass confusion.

Watch Duty simplifies all that for millions of people.

Advertisement

“We view what we are doing as a public service,” says Merritt. “It is a utility that everyone should have, which is timely, relevant information for their safety during emergencies. Right now, it’s very scattered. Even the agencies themselves, which have the best intentions, their hands are tied by bureaucracy or contracts. We partner with government sources with a focus on firefighting.”

“We view what we are doing as a public service.”

One of the biggest issues around fires, in particular, is that they can move quickly and consume large swaths of land and structures in minutes. For example, the winds that drove the Palisades fire to spread to more than 10,000 acres reached 90 miles per hour on Tuesday. When minutes matter, the piecemeal alert system that Watch Duty replaces can cause delays that cost lives. 

“Some of the delivery systems for push notifications and text messages that government agencies use had a 15-minute delay, which is not good for fire,” says Merritt. “We shoot to have push notifications out in under a minute. Right now, 1.5 million people in LA are getting push notifications through the app. That’s a lot of messages to send out in 60 seconds. In general, people are getting it pretty much all at the same time.”

A simple tech stack

Advertisement

For Watch Duty, this kind of mass communication requires reliable technology as well as a group of dedicated staff and skilled volunteers. Merritt says that Watch Duty relies on a number of corporate partners with whom it has relationships and contracts to provide its service. 

“We shoot to have push notifications out in under a minute.”

The app is built on a mix of technology, including Google’s cloud platform, Amazon Web Services, Firebase, Fastly, and Heroku. Merritt says the app uses some AI, but only for internal routing of alerts and emails. Reporters at Watch Duty — those who listen to scanners and update the app with push notifications about everything from air drops to evacuation updates — are mostly volunteers who coordinate coverage via Slack.

“All information is vetted for quality over quantity,” he says. “We have a code of conduct for reporters. For example, we never report on injuries or give specific addresses. It’s all tailored with a specific set of criteria. We don’t editorialize. We report on what we have heard on the scanners.” 

According to Merritt, the app has 100 percent uptime. Even though it started with volunteer engineers, the nonprofit has slowly added more full-time people. “We still have volunteers helping us, but it’s becoming more on the internal paid staff as we grow, as things get more complex, and as we have more rigorous processes,” he says.

Advertisement

“All information is vetted for quality over quantity.”

He says there are no plans to ever charge for the app or scrape user data. The approach is kind of the Field of Dreams method to building a free app that saves people’s lives: if you build it well, the funding will come. 

“It’s the antithesis of what a lot of tech does,” Merritt says. “We don’t want you to spend time in the app. You get information and get out. We have the option of adding more photos, but we limit those to the ones that provide different views of a fire we have been tracking. We don’t want people doom scrolling.” 

Photo by FREDERIC J. BROWN / AFP via Getty Images

Collecting information in the era of Trump

Advertisement

Watch Duty relies heavily on publicly available information from places like the National Weather Service and the Environmental Protection Agency. Should the incoming Trump administration decide to execute on threats to dismantle and disband the EPA (which monitors air quality) and the National Oceanic and Atmospheric Administration, the parent agency to the National Weather Service, such moves would impact Watch Duty’s ability to operate. 

Even still, Merritt is optimistic. “We will be pretty well insulated from any change to policy,” he says. “We are either buying that information ourselves already or we are happy to buy it, and we will take that cost on. The fact that we’re soon going to be covering the entire US will defray the cost of anything that shifts from a policy perspective. Our operation costs are mostly salaries. We are trying to hire really good engineers and have a really solid platform. If we need to raise a grant to buy data from the National Weather Service, then we will.”

Regardless of what the next administration does, it’s clear that Watch Duty has become a critical and necessary app for those in Southern California right now. The app currently covers 22 states and plans to roll out nationwide soon. 

“We got 1.4 million app downloads in the last few days,” according to Merritt. “I think we have only received 60 support tickets, so that shows that something is working there. We are really just focused on the delivery of this information.”

Advertisement
Continue Reading

Trending