Connect with us

News

Helen Toner on the OpenAI coup: ‘It was about trust and accountability’

Published

on

Helen Toner on the OpenAI coup: ‘It was about trust and accountability’

A few days before Thanksgiving last year, Helen Toner and three of her peers on the board of OpenAI — the world’s best-known artificial intelligence company — fired its chief executive Sam Altman in a surprise coup.

The reason they gave was Altman’s lack of candour in his dealings with the board, but details were minimal. In the days that followed, Toner, a director at Georgetown University’s AI think-tank, the Center for Security and Emerging Technology, swirled at the centre of a crisis that threatened to tear the $86bn company apart. She became a symbolic figure of opposition to Altman, a legendary and canny Silicon Valley operator.

The coup lasted five days, amid intense pressure from the start-up’s powerful investors, supporters and employees to reinstate Altman. One of Toner’s co-directors defected back to Altman, the management team rushed to his defence and, by the end of the long weekend, Altman was back in place as CEO. Toner was forced to resign.

The showdown was more than a clash of personalities: it sparked a global debate about the nature of corporate power, and whether today’s tech leaders can be trusted to oversee what is one of our most powerful inventions.

Seated at the back of a Sichuanese restaurant near London’s St James’s Park, Toner seems unperturbed by the chaos she helped to instigate. In a plain black T-shirt, with her short, wavy hair pulled back sensibly, revealing little emerald studs, the 32-year-old is an unlikely nemesis for Altman. Since her exit from the OpenAI stage, the Melbourne-born engineer has remained mostly tight-lipped about the ousting and how it went awry. To many, she remains an enigma.

Advertisement

“It’s very hard to look at what happened and conclude that self-governing is going to work at these companies,” she says, sipping jasmine tea. “Or that we can rely on self-governance structures to stand up to the pressures of the different kinds of power and incentives that are at play here.

“For the board, there was this trajectory of going from ‘everything’s very low stakes, you want to be pretty hands-off’ to ‘actually, we’re playing this critical governance function in an incredibly high-stakes — not just for the company, but for the world — situation,’” she says.

We turn to the relatively low-stakes task of choosing our meal, which prompts us to discover our mutual vegetarianism. Toner gave up meat for animal welfare reasons a few years ago, so ordering lunch becomes unexpectedly easy. We decide on the veggie sharing menu, to sample as many dishes as we can, united by our love of spicy foods.

Toner was invited to join OpenAI’s board in 2021 by her former boss Holden Karnofsky. They had worked together at the California-based non-profit GiveWell, which used the principles of effective altruism — a controversial social and philanthropic movement influential in tech circles — to conduct research and make grants. At GiveWell, Toner pursued an early interest in AI policy issues, particularly its military use and the influence of geopolitics on AI development. 

Karnofsky was stepping off the company’s board and was looking for an apt replacement. Toner knew OpenAI had a convoluted and unusual governance structure, involving a non-profit shell with capped-profit subsidiaries. (The FT has a licensing agreement with OpenAI.) Its largest backer, Microsoft, did not own any conventional equity shareholding in the company. Instead, it is entitled to receive a share of profits from a specific subsidiary of OpenAI, up to a certain limit. In its charter, the company claims that its “primary fiduciary duty is to humanity” and that the non-profit’s board, which governs all OpenAI activities, should act to further its mission, rather than to maximise profit for investors.

Advertisement

Toner asked around — would this board have any real power to hold the company to account? — and was convinced by people close to it that it would. To her, it felt like a potentially valuable way to contribute to the development of safe and beneficial AI. “The funny part is, I think the [OpenAI] board was filtering heavily for someone who would be . . . agreeable and practical and a bridge builder, and not going to rock the boat too much,” she says.

“I was never on this board for fun or for glory. Definitely the level of spotlight that I personally was put under was not something I was expecting,” she tells me. “I think having a kid was very helpful. It’s just very, very grounding.”


Toner’s choice of restaurant, Ma La Sichuan, a buzzing spot decked out in traditional red and gold, is a throwback to her nine-month stint in Beijing in 2018, when she studied Chinese, schooled herself in Sichuanese food and worked as a research affiliate on AI and defence.

During her time there, she worked with machine-learning researchers and attended conferences on AI and the Chinese military, often one of just a handful of foreigners. “China is often used as a bit of a cudgel in DC . . . to do things in AI because [of] China. And often it’s not necessarily that closely connected with what China is actually doing, or how well they’re actually succeeding at their plans,” she says.

Menu

Ma La Sichuan
37 Monck St, London SW1P 2BL

Advertisement

Vegetarian sharing menu x2 £56
— Aromatic duck
— Ma po tofu
— Aubergine hot pot
— Dry-fried fine beans
— Mixed vegetable fried rice
Lychee juice £3
Jasmine tea £2
Total (inc service) £68.60

Since we’ve opted for the sharing menu, trays of steaming dishes begin to arrive in procession, preceded by wafting aromas of chilli and garlic. There are vegetarian aromatic “duck” pancakes with slim cylinders of cucumber, leeks and a hoisin sauce (an unexpected Peking dish at a Sichuanese place, Toner points out, but crisp, salty-sweet and delicious nonetheless).

This is followed by a parade of regional favourites such as ma po tofu and fish-fragrant aubergine hotpot, with a dry dish of fine green beans topped with little piles of roasted garlic and chilli slivers that melt pungently on the tongue. The aubergine has hints of miso that I savour.

Ma is part of the Chinese word for anaesthesia or paralysis, and that’s because the Sichuan peppercorn numbs your tongue and your lips,” she explains. “I’m kinda addicted to that flavour.”

The conversation turns back to OpenAI, and Toner’s relationship with the company over the two years she sat on its board. When she first joined, there were nine members, including LinkedIn co-founder Reid Hoffman, Shivon Zilis, an executive at Elon Musk’s neurotechnology company Neuralink, and Republican congressman Will Hurd. It was a collegiate atmosphere, she says, though in 2023 those three members all stepped down, leaving three non-execs on the board, including Toner, tech entrepreneur Tasha McCauley and Adam D’Angelo, the chief executive of website Quora, alongside Altman and the company’s co-founders Greg Brockman and Ilya Sutskever.  

Advertisement

“I came on as the company was going through a clear shift,” Toner says. “Certainly when I joined, it was much more comparable to being on the board of a VC-funded start-up, where you’re just there to help out [and] do what the CEO thinks is right. You don’t want to be meddling or you don’t want to be getting in the way of anything.”

The transition at the company, she says, was precipitated by the launch of ChatGPT — which Toner and the rest of the board found out about on Twitter — but also of the company’s most advanced AI model, GPT-4. OpenAI went from being a research lab, where scientists were working on nascent and blue-sky research projects not designed to be used by the masses, to a far more commercial entity with powerful underlying technology that had far-reaching impacts.  

I ask Toner what she thinks of Altman, the person and leader. “We’ve always had a friendly relationship, he’s a friendly guy,” she says. Toner still has legal duties of confidentiality to the company, and is limited in what she can reveal. But speaking on the Ted AI podcast in May, she was vocal in claiming that Altman had misled the board “on multiple occasions” about its existing safety processes. According to her, he had withheld information, wilfully misrepresented things that were happening at the company, and in some cases outright lied to the board. 

She pointed to the fact that Altman hadn’t informed the board about the launch of ChatGPT, or that he owned the OpenAI Startup Fund, a venture capital fund he had raised from external limited partners and made investment decisions on — even though, says Toner, he claimed “to be an independent board member with no financial interest in the company”. Altman stepped down from the fund in April this year.

In the weeks leading up to the November firing, Altman and Toner had also clashed over a paper she had co-authored on public perceptions of various AI developments, which included some criticism of the ChatGPT launch. Altman felt that it reflected badly on the company. “If I had wanted to critique OpenAI, there would have been many more effective ways to do that,” Toner says. “It’s honestly not clear to me if it actually got to him or if he was looking for an excuse to try and get me off the board.”

Advertisement

Today, she says those are all merely illustrative examples to point to long-term patterns of untrustworthy behaviour that Altman exhibited, with the board but also with his own colleagues. “What changed it was conversations with senior executives that we had in the fall of 2023,” she says. “That is where we started thinking and talking more actively about [doing] something about Sam specifically.”

Public criticisms of the board’s decision have ranged from personal attacks on Toner and her co-directors — with many describing her as a “decel”, someone who is anti-technological progress — to disapproval of how the board handled the fallout. Some noted that the board’s timing had been poor, given the concurrent share sale at OpenAI, potentially jeopardising employees’ payouts.

Last March, an independent review conducted by an external law firm into the events concluded that Altman’s behaviour “did not mandate removal”. The entrepreneur rejoined the board the same month. At the time he said he was “pleased this whole thing is over”, adding: “Over these last few months it’s been disheartening to see some people with an agenda trying to tease leaks in the press to try and hurt the company and hurt the mission. They have not worked.”

In Toner’s view, the review’s outcome sounded like the new board had posed the question of whether it had to fire Altman. “Which I think gets interpreted as: ‘Did he do something illegal?’ And that is not how I think the board should necessarily be evaluating his conduct,” she says.

“They’ve not disputed anywhere any of the actual claims that we’ve made about what went wrong or why we fired him . . . which was about trust and accountability and oversight.”

Advertisement

In a statement to the FT, chair of OpenAI’s board Bret Taylor said that “over 95% of employees, including senior leadership, asked for Sam’s reinstatement”. Toner can’t explain — and didn’t anticipate — defections by senior staff, including by board member Sutskever, who went from criticising to supporting Altman within days. “I learnt a lot about how different people react to pressure in different situations.”


We’re making our way through the feast with efficiency, in agreement that the tingly and fragrant ma po tofu is the star of the show. I ask Toner how life has changed for her since November, and she insists that it hasn’t. She has kept her full-time job at CSET, where she advises senior government officials on AI policy and national security, makes her own rye bread at home with her husband, a German scientist, and deals daily with the exertions of toddler-parenting.

At the time, when the OpenAI crisis turned into a long weekend of sleepless negotiations and damage control, she admits it gave her a new appreciation for her community in DC. Since many of her colleagues were in the national security space, they had dealt with “real actual crises, where people were dying or wars were going on, so that put that into perspective”, she says. “A few sleepless nights is not that bad.”

Her biggest learning was around the future of AI governance. To her, the events at OpenAI raised the stakes of getting outside oversight right for the small group of companies racing to build powerful AI systems. “It could mean government regulation but could also just mean . . . industry-wide standards, public pressure, public expectations,” she says.

This isn’t just the case for OpenAI, she emphasises, but for companies including Anthropic, Google and Meta. Establishing legal requirements around transparency is crucial to prevent building a tool that is dangerous to humanity, she believes.

Advertisement

“[The companies] are also in a tough situation, where they’re all trying to compete with each other. And so you talk to people inside these companies, and they almost beg you to intervene from the outside,” she says. “It’s not just about trusting the beneficence and judgment of specific individuals. We shouldn’t let things be set up such that a small number of people get to be the ones that get to decide what happens, no matter how good those people are.”


Toner came to AI policy through an unusual path. As a university student in Melbourne, she was introduced to effective altruism (EA). She’d been seduced by the community’s ideas of helping to improve the world in a way that required thinking with both head and heart, she says.

The EA community — and its problematic workings — were dragged into the limelight in 2022 by its most public promoter and donor, Sam Bankman-Fried, disgraced founder of cryptocurrency trading firm FTX. Toner says she knew him “a little, not well”, and had met him “once or twice”.

“I’ve been much less involved in recent years, mostly because of this groupthink, hero-worship kind of stuff. [Bankman-Fried] is a symptom of it,” she says. “The last thing I wrote [about it] was about getting disillusioned with EA, both how I experienced that and how I’d seen others experience it.”

At this point, we’re sated from the meal but can’t resist picking at the leftovers for another twinge of that numbing peppercorn flavour. A full stomach feels like the right time to ask the dystopian question about the coming wave of AI systems. “One thing [effective altruists] got really right is taking seriously the possibility we might see very advanced AI systems in our lifetimes and that might be a big deal for what happens in the world,” she says. “In 2013, 2014, when I was starting to hear these kinds of ideas, it seemed very countercultural, and now . . . certainly feels more mainstream.”

Advertisement

Despite this, she has faith in humanity’s ability to adapt. “I feel overall somewhat hopeful that we will have space to breathe and prepare,” she says.

Throughout our conversation, Toner has been restrained in recounting her attempts to take on one of tech’s most powerful CEOs. Much of the personal criticism and spotlight she was forced to accept may have been avoided if she’d acted differently, prepared better for the fallout, or taken more counsel, perhaps. I feel compelled to ask if she ever questions herself, her actions or her methods last November.

“I mean, all the time,” she says, smiling broadly. “If you’re not questioning yourself, how are you making good decisions?”

Madhumita Murgia is the FT’s AI editor

Find out about our latest stories first — follow FT Weekend on Instagram and X, and subscribe to our podcast Life & Art wherever you listen

Advertisement

Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

News

Senate committee details failures by Secret Service in preventing Trump shooting

Published

on

Senate committee details failures by Secret Service in preventing Trump shooting

Then-candidate Donald Trump is rushed offstage by U.S. Secret Service agents after being struck by a bullet during a rally on July 13, 2024, in Butler, Pa.

Anna Moneymaker/Getty Images


hide caption

toggle caption

Advertisement

Anna Moneymaker/Getty Images

A Senate committee report released Sunday blames the U.S. Secret Service for a “cascade of preventable failures” that led up to the assassination attempt against then-presidential candidate Donald Trump during a rally in Butler, Pa., last summer.

Trump was injured in the shooting when a bullet whizzed past his head, grazing his ear. Two attendees were wounded, and rally-goer and former fire chief Corey Comperatore was killed.

A Secret Service sniper shot and killed the perpetrator, 20-year-old Thomas Matthew Crooks of Bethel Park, Pa.

Advertisement

In its report, the Senate Homeland Security and Governmental Affairs Committee said the Secret Service’s “lack of structured communication was likely the greatest contributor to the failures” on the day of the rally. The report was released by the committee’s chairman, Sen. Rand Paul, R-Ky.

For instance, the Secret Service security room agent, who is responsible for collecting and disseminating information, learned about a suspicious person with a rangefinder from a counterpart in the Pennsylvania State Police roughly 25 minutes before the shooting. That agent relayed the report to a fellow Secret Service agent in the room, but the information did not go out over the radio or make it to Trump’s security detail in time for them to prevent him from taking the stage.

There were communication gaps both within the Secret Service hierarchy, and also among the agency and the state and federal law enforcement agencies on scene, the committee said.

There were organizational mistakes, too. The committee noted that one of the Secret Service countersniper teams protecting Trump at the Butler rally had an obstructed view of the roof of the nearby American Glass Research building where Crooks was located.

The report, released one year to the day after the shooting, also found that the Secret Service had denied some resources to Trump’s detail during the 2024 presidential election and said former Secret Service Director Kimberly Cheatle had falsely testified to Congress when she said no requests were denied for the Butler rally.

Advertisement

In a statement on Sunday, Secret Service Director Sean Curran said the agency “took a serious look at our operations” following last year’s shooting and “implemented substantive reforms to address the failures that occurred that day.”

The agency announced last week that it had put in place 21 of 46 recommendations made by congressional oversight bodies, including streamlining communication procedures and clarifying the responsibilities of advance teams.

The Secret Service also said it had disciplined six employees in relation to the Butler shooting, with suspensions ranging from 10 to 42 days without pay. Still, the committee said in its report that “not a single person has been fired.”

Curran, who was one of the agents who surrounded Trump as shots were fired in Butler, added in his statement that the Secret Service will “continue to work cooperatively with the committee as we move forward in our mission.”

Advertisement
Continue Reading

News

Texas flood death toll rises as search continues for victims – UPI.com

Published

on

Texas flood death toll rises as search continues for victims – UPI.com

A young girl carries a stuffed bear during a vigil for those lost in the Texas floods at the “Wall of Hope” fence memorial in Kerrville, Texas, on Friday. Photo by Dustin Safranek/EPA

July 12 (UPI) — More than 2,100 searchers from a dozen Texas Counties, other states and Mexico are continuing recovery efforts to find more victims of the deadly flash flooding in central Texas.

The confirmed-deaths toll rose to 129 with 170 still missing after officials in Travis and Kerr counties reported the recovery of more bodies, USA Today reported.

Most of the dead, 103, were found in Kerr County, including 36 children and 67 adults.

Among those missing is Volunteer Fire Chief Michael Phillips, whose rescue vehicle was swept away when flash flooding struck Burnet County.

Advertisement

Search crews later found the vehicle, but Phillips was not inside.

“Specialist teams and equipment continue to deploy into the search area and work themselves to exhaustion or until nightfall in the effort to find him,” the Burnet County Sheriff’s Office announced on Saturday, according to USA Today.

Many states and Mexico sent entire first responder teams, including Indiana, which deployed personnel from 15 fire and police departments to help the recovery effort, The New York Times reported.

Many volunteer groups also traveled to Kerr County, where most search efforts are focused.

“It’s overwhelming to see so many people come and help in the search,” Kerrville, Texas, resident Amy Vanlandingham told The New York Times.

Advertisement

“This is our town,” she said. “I do it so I can sleep.”

The Guadalupe River’s flash flooding during the early morning hours of July 4 decimated several local camps and other popular visitor destinations on one of their busiest days of the year.

The bodies of victims likely are situated in debris fields located along more than 100 miles of narrow and shallow valleys along the Guadalupe River in the mostly rural area of Texas Hill Country.

President Donald Trump, first lady Melania Trump and others visited Kerr County on Friday to assess the situation and better gauge the need for federal assistance.

Advertisement
Continue Reading

News

'Helping every dang soul': Beloved camp director was among those lost in Texas flooding

Published

on

'Helping every dang soul': Beloved camp director was among those lost in Texas flooding

Just after the summer session ended in late June, Heart O’ the Hills camper Sydney Sutton sent this photo to the camp’s director, Jane Ragsdale, who was killed in the July 4 flooding in Kerr County, Texas.

Erika Sutton


hide caption

toggle caption

Advertisement

Erika Sutton

Jane Ragsdale spent her summers by the Guadalupe, the very river that killed her a week ago today in the catastrophic July Fourth flood. Mention her name in Kerrville, Texas, this week, and folks tend to do two things: tear up and smile.

“I mean I can’t tell you how many people, acquaintances of mine say, ‘My dear, dear friend died.’ And then they said, ‘Did you know Jane Ragsdale?’ and I say, ‘Yeah, I did,’ ” said Karen Taylor, who lives in nearby Hunt, Texas. For her, Ragsdale was West Kerr County personified.

“Everybody’s friendly here, but she embodied that friendliness and generosity and love for others. I just can’t imagine life without her,” Taylor said.

Advertisement

Ragsdale, who was in her late 60s, did a lot of things, but she’s best known as the owner and director of Heart O’ the Hills camp for girls. She was born into the business.

Jane Ragsdale ran the Heart O’ the Hills camp for girls in Kerr County, Texas. The camp was between sessions when the deluge hit. The only person killed there was Ragsdale.

Jane Ragsdale ran the Heart O’ the Hills camp for girls in Kerr County, Texas. The camp was between sessions when the deluge hit. The only person killed there was Ragsdale.

Kerrville Daily Times


hide caption

toggle caption

Advertisement

Kerrville Daily Times

Her family bought a boys’ camp, Camp Stewart in 1966, the year Ragsdale turned 9. They bought Heart O’ the Hills about a decade later. Ragsdale helped run it from the start. By 1988, she was in charge.

Unlike Camp Mystic, the girls camp where at least 27 perished when the deluge hit, Heart O’ the Hills was between sessions. The only person killed there was Ragsdale.

“I’ve never in my life met someone like Jane,” said Kathy Simmons, who was a good friend of Ragsdale’s.

Advertisement

Simmons was at Heart O’ the Hills picking up her granddaughter just the week before the flood, on the last night the camp was open.

“We had a candlelight service on the river at 9 p.m., and it was so beautiful. There were prayers and there were songs,” Simmons said. “Jane always led the children in songs. And every one of those girls and those counselors absolutely idolized her.”

After Heart O' the Hills camper Sydney Sutton sent a photo of herself to Jane Ragsdale, the camp director wrote this letter back to Sydney.

After Heart O’ the Hills camper Sydney Sutton sent a photo of herself to Jane Ragsdale, the camp director wrote this letter back to Sydney.

Erika Sutton


hide caption

Advertisement

toggle caption

Erika Sutton

The summer camps on the Guadalupe River in Kerr County are institutions. Generations of girls and boys go through them, often forming life-long attachments. Simmons considered Ragsdale the heart and soul of her camp, both spiritual leader and educator.

“I mean, Jane taught these girls how to change a tire, how to ride a horse, how to swim, how to shoot a gun, archery, cooking. I mean, the necessities of life,” Simmons said.

Advertisement

In the off-season, when she wasn’t running the camp, Ragsdale often traveled to Guatemala, where she volunteered as an interpreter and a project organizer. It was mission work she started doing when she was 19 and studying journalism. She was a badass. But she was also about the sweetest person in town.

“Jane was one of the most genuine, kind, honest people and very intelligent, very warm,” recalls Mindy Wendele, president and CEO of the Kerrville Area Chamber of Commerce. “She had a smile that you knew Jane Ragsdale was smiling at you.”

Wendele grew up with Ragsdale, who she describes as a real go-getter: deeply involved in the Chamber of Commerce, a board member of the local liberal arts college, a class leader in high school.

“Anytime that we were out with Jane and her family at Heart O’ the Hills, we had just a fabulous time, just fabulous memories out there,” Wendele said.

Now, with some of the camps and almost all of the riverfront in ruins, Kerr County faces a monumental clean-up and rebuilding effort.

Advertisement

Another reason to miss Jane Ragsdale.

“Oh, she would be out there volunteering. She would be out there clearing property,” Simmons said. “She would have her boots on, her gloves on, she would be helping every dang soul that needed to be helped.”

So the flood took one of Kerr County’s most capable citizens, but Ragsdale’s influence on the community and the girls who came through Heart O’ the Hills camp is going to last a long time.

Continue Reading

Trending