Connect with us

News

Helen Toner on the OpenAI coup: ‘It was about trust and accountability’

Published

on

Helen Toner on the OpenAI coup: ‘It was about trust and accountability’

A few days before Thanksgiving last year, Helen Toner and three of her peers on the board of OpenAI — the world’s best-known artificial intelligence company — fired its chief executive Sam Altman in a surprise coup.

The reason they gave was Altman’s lack of candour in his dealings with the board, but details were minimal. In the days that followed, Toner, a director at Georgetown University’s AI think-tank, the Center for Security and Emerging Technology, swirled at the centre of a crisis that threatened to tear the $86bn company apart. She became a symbolic figure of opposition to Altman, a legendary and canny Silicon Valley operator.

The coup lasted five days, amid intense pressure from the start-up’s powerful investors, supporters and employees to reinstate Altman. One of Toner’s co-directors defected back to Altman, the management team rushed to his defence and, by the end of the long weekend, Altman was back in place as CEO. Toner was forced to resign.

The showdown was more than a clash of personalities: it sparked a global debate about the nature of corporate power, and whether today’s tech leaders can be trusted to oversee what is one of our most powerful inventions.

Seated at the back of a Sichuanese restaurant near London’s St James’s Park, Toner seems unperturbed by the chaos she helped to instigate. In a plain black T-shirt, with her short, wavy hair pulled back sensibly, revealing little emerald studs, the 32-year-old is an unlikely nemesis for Altman. Since her exit from the OpenAI stage, the Melbourne-born engineer has remained mostly tight-lipped about the ousting and how it went awry. To many, she remains an enigma.

Advertisement

“It’s very hard to look at what happened and conclude that self-governing is going to work at these companies,” she says, sipping jasmine tea. “Or that we can rely on self-governance structures to stand up to the pressures of the different kinds of power and incentives that are at play here.

“For the board, there was this trajectory of going from ‘everything’s very low stakes, you want to be pretty hands-off’ to ‘actually, we’re playing this critical governance function in an incredibly high-stakes — not just for the company, but for the world — situation,’” she says.

We turn to the relatively low-stakes task of choosing our meal, which prompts us to discover our mutual vegetarianism. Toner gave up meat for animal welfare reasons a few years ago, so ordering lunch becomes unexpectedly easy. We decide on the veggie sharing menu, to sample as many dishes as we can, united by our love of spicy foods.

Toner was invited to join OpenAI’s board in 2021 by her former boss Holden Karnofsky. They had worked together at the California-based non-profit GiveWell, which used the principles of effective altruism — a controversial social and philanthropic movement influential in tech circles — to conduct research and make grants. At GiveWell, Toner pursued an early interest in AI policy issues, particularly its military use and the influence of geopolitics on AI development. 

Karnofsky was stepping off the company’s board and was looking for an apt replacement. Toner knew OpenAI had a convoluted and unusual governance structure, involving a non-profit shell with capped-profit subsidiaries. (The FT has a licensing agreement with OpenAI.) Its largest backer, Microsoft, did not own any conventional equity shareholding in the company. Instead, it is entitled to receive a share of profits from a specific subsidiary of OpenAI, up to a certain limit. In its charter, the company claims that its “primary fiduciary duty is to humanity” and that the non-profit’s board, which governs all OpenAI activities, should act to further its mission, rather than to maximise profit for investors.

Advertisement

Toner asked around — would this board have any real power to hold the company to account? — and was convinced by people close to it that it would. To her, it felt like a potentially valuable way to contribute to the development of safe and beneficial AI. “The funny part is, I think the [OpenAI] board was filtering heavily for someone who would be . . . agreeable and practical and a bridge builder, and not going to rock the boat too much,” she says.

“I was never on this board for fun or for glory. Definitely the level of spotlight that I personally was put under was not something I was expecting,” she tells me. “I think having a kid was very helpful. It’s just very, very grounding.”


Toner’s choice of restaurant, Ma La Sichuan, a buzzing spot decked out in traditional red and gold, is a throwback to her nine-month stint in Beijing in 2018, when she studied Chinese, schooled herself in Sichuanese food and worked as a research affiliate on AI and defence.

During her time there, she worked with machine-learning researchers and attended conferences on AI and the Chinese military, often one of just a handful of foreigners. “China is often used as a bit of a cudgel in DC . . . to do things in AI because [of] China. And often it’s not necessarily that closely connected with what China is actually doing, or how well they’re actually succeeding at their plans,” she says.

Menu

Ma La Sichuan
37 Monck St, London SW1P 2BL

Advertisement

Vegetarian sharing menu x2 £56
— Aromatic duck
— Ma po tofu
— Aubergine hot pot
— Dry-fried fine beans
— Mixed vegetable fried rice
Lychee juice £3
Jasmine tea £2
Total (inc service) £68.60

Since we’ve opted for the sharing menu, trays of steaming dishes begin to arrive in procession, preceded by wafting aromas of chilli and garlic. There are vegetarian aromatic “duck” pancakes with slim cylinders of cucumber, leeks and a hoisin sauce (an unexpected Peking dish at a Sichuanese place, Toner points out, but crisp, salty-sweet and delicious nonetheless).

This is followed by a parade of regional favourites such as ma po tofu and fish-fragrant aubergine hotpot, with a dry dish of fine green beans topped with little piles of roasted garlic and chilli slivers that melt pungently on the tongue. The aubergine has hints of miso that I savour.

Ma is part of the Chinese word for anaesthesia or paralysis, and that’s because the Sichuan peppercorn numbs your tongue and your lips,” she explains. “I’m kinda addicted to that flavour.”

The conversation turns back to OpenAI, and Toner’s relationship with the company over the two years she sat on its board. When she first joined, there were nine members, including LinkedIn co-founder Reid Hoffman, Shivon Zilis, an executive at Elon Musk’s neurotechnology company Neuralink, and Republican congressman Will Hurd. It was a collegiate atmosphere, she says, though in 2023 those three members all stepped down, leaving three non-execs on the board, including Toner, tech entrepreneur Tasha McCauley and Adam D’Angelo, the chief executive of website Quora, alongside Altman and the company’s co-founders Greg Brockman and Ilya Sutskever.  

Advertisement

“I came on as the company was going through a clear shift,” Toner says. “Certainly when I joined, it was much more comparable to being on the board of a VC-funded start-up, where you’re just there to help out [and] do what the CEO thinks is right. You don’t want to be meddling or you don’t want to be getting in the way of anything.”

The transition at the company, she says, was precipitated by the launch of ChatGPT — which Toner and the rest of the board found out about on Twitter — but also of the company’s most advanced AI model, GPT-4. OpenAI went from being a research lab, where scientists were working on nascent and blue-sky research projects not designed to be used by the masses, to a far more commercial entity with powerful underlying technology that had far-reaching impacts.  

I ask Toner what she thinks of Altman, the person and leader. “We’ve always had a friendly relationship, he’s a friendly guy,” she says. Toner still has legal duties of confidentiality to the company, and is limited in what she can reveal. But speaking on the Ted AI podcast in May, she was vocal in claiming that Altman had misled the board “on multiple occasions” about its existing safety processes. According to her, he had withheld information, wilfully misrepresented things that were happening at the company, and in some cases outright lied to the board. 

She pointed to the fact that Altman hadn’t informed the board about the launch of ChatGPT, or that he owned the OpenAI Startup Fund, a venture capital fund he had raised from external limited partners and made investment decisions on — even though, says Toner, he claimed “to be an independent board member with no financial interest in the company”. Altman stepped down from the fund in April this year.

In the weeks leading up to the November firing, Altman and Toner had also clashed over a paper she had co-authored on public perceptions of various AI developments, which included some criticism of the ChatGPT launch. Altman felt that it reflected badly on the company. “If I had wanted to critique OpenAI, there would have been many more effective ways to do that,” Toner says. “It’s honestly not clear to me if it actually got to him or if he was looking for an excuse to try and get me off the board.”

Advertisement

Today, she says those are all merely illustrative examples to point to long-term patterns of untrustworthy behaviour that Altman exhibited, with the board but also with his own colleagues. “What changed it was conversations with senior executives that we had in the fall of 2023,” she says. “That is where we started thinking and talking more actively about [doing] something about Sam specifically.”

Public criticisms of the board’s decision have ranged from personal attacks on Toner and her co-directors — with many describing her as a “decel”, someone who is anti-technological progress — to disapproval of how the board handled the fallout. Some noted that the board’s timing had been poor, given the concurrent share sale at OpenAI, potentially jeopardising employees’ payouts.

Last March, an independent review conducted by an external law firm into the events concluded that Altman’s behaviour “did not mandate removal”. The entrepreneur rejoined the board the same month. At the time he said he was “pleased this whole thing is over”, adding: “Over these last few months it’s been disheartening to see some people with an agenda trying to tease leaks in the press to try and hurt the company and hurt the mission. They have not worked.”

In Toner’s view, the review’s outcome sounded like the new board had posed the question of whether it had to fire Altman. “Which I think gets interpreted as: ‘Did he do something illegal?’ And that is not how I think the board should necessarily be evaluating his conduct,” she says.

“They’ve not disputed anywhere any of the actual claims that we’ve made about what went wrong or why we fired him . . . which was about trust and accountability and oversight.”

Advertisement

In a statement to the FT, chair of OpenAI’s board Bret Taylor said that “over 95% of employees, including senior leadership, asked for Sam’s reinstatement”. Toner can’t explain — and didn’t anticipate — defections by senior staff, including by board member Sutskever, who went from criticising to supporting Altman within days. “I learnt a lot about how different people react to pressure in different situations.”


We’re making our way through the feast with efficiency, in agreement that the tingly and fragrant ma po tofu is the star of the show. I ask Toner how life has changed for her since November, and she insists that it hasn’t. She has kept her full-time job at CSET, where she advises senior government officials on AI policy and national security, makes her own rye bread at home with her husband, a German scientist, and deals daily with the exertions of toddler-parenting.

At the time, when the OpenAI crisis turned into a long weekend of sleepless negotiations and damage control, she admits it gave her a new appreciation for her community in DC. Since many of her colleagues were in the national security space, they had dealt with “real actual crises, where people were dying or wars were going on, so that put that into perspective”, she says. “A few sleepless nights is not that bad.”

Her biggest learning was around the future of AI governance. To her, the events at OpenAI raised the stakes of getting outside oversight right for the small group of companies racing to build powerful AI systems. “It could mean government regulation but could also just mean . . . industry-wide standards, public pressure, public expectations,” she says.

This isn’t just the case for OpenAI, she emphasises, but for companies including Anthropic, Google and Meta. Establishing legal requirements around transparency is crucial to prevent building a tool that is dangerous to humanity, she believes.

Advertisement

“[The companies] are also in a tough situation, where they’re all trying to compete with each other. And so you talk to people inside these companies, and they almost beg you to intervene from the outside,” she says. “It’s not just about trusting the beneficence and judgment of specific individuals. We shouldn’t let things be set up such that a small number of people get to be the ones that get to decide what happens, no matter how good those people are.”


Toner came to AI policy through an unusual path. As a university student in Melbourne, she was introduced to effective altruism (EA). She’d been seduced by the community’s ideas of helping to improve the world in a way that required thinking with both head and heart, she says.

The EA community — and its problematic workings — were dragged into the limelight in 2022 by its most public promoter and donor, Sam Bankman-Fried, disgraced founder of cryptocurrency trading firm FTX. Toner says she knew him “a little, not well”, and had met him “once or twice”.

“I’ve been much less involved in recent years, mostly because of this groupthink, hero-worship kind of stuff. [Bankman-Fried] is a symptom of it,” she says. “The last thing I wrote [about it] was about getting disillusioned with EA, both how I experienced that and how I’d seen others experience it.”

At this point, we’re sated from the meal but can’t resist picking at the leftovers for another twinge of that numbing peppercorn flavour. A full stomach feels like the right time to ask the dystopian question about the coming wave of AI systems. “One thing [effective altruists] got really right is taking seriously the possibility we might see very advanced AI systems in our lifetimes and that might be a big deal for what happens in the world,” she says. “In 2013, 2014, when I was starting to hear these kinds of ideas, it seemed very countercultural, and now . . . certainly feels more mainstream.”

Advertisement

Despite this, she has faith in humanity’s ability to adapt. “I feel overall somewhat hopeful that we will have space to breathe and prepare,” she says.

Throughout our conversation, Toner has been restrained in recounting her attempts to take on one of tech’s most powerful CEOs. Much of the personal criticism and spotlight she was forced to accept may have been avoided if she’d acted differently, prepared better for the fallout, or taken more counsel, perhaps. I feel compelled to ask if she ever questions herself, her actions or her methods last November.

“I mean, all the time,” she says, smiling broadly. “If you’re not questioning yourself, how are you making good decisions?”

Madhumita Murgia is the FT’s AI editor

Find out about our latest stories first — follow FT Weekend on Instagram and X, and subscribe to our podcast Life & Art wherever you listen

Advertisement

Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

News

With no federal standard for heat, states are making their own to protect workers

Published

on

With no federal standard for heat, states are making their own to protect workers

Admire Stewart and Margie Rodriguez hold up water bottles that Rodriguez purchased for housekeepers at the University of Maryland. Hydration is a challenge when the housekeepers work long hours in unairconditioned dormitories across campus.

Emily Hofstaedter/WYPR


hide caption

toggle caption

Advertisement

Emily Hofstaedter/WYPR

Admire Stewart takes a deep breath and sits still while a breeze hits her face. Her gallon-sized water bottle is by her side.

“Right now I have a migraine because of the heat yesterday and I have heat hives,” she says as she points to the bumps on her arms. She’s trained herself not to scratch them, which only makes them worse.

Stewart works inside Ellicott Hall, one of the unairconditioned dormitories on University of Maryland’s College Park campus.

Advertisement

President Joe Biden introduced an occupational standard for workers laboring in extreme heat, but it could take years to take effect. Meanwhile, states like California, Colorado, Minnesota, Oregon and Washington have passed protections as workers toil in extreme temperatures.

Maryland is set to finalize its heat standard later this summer, making it the first state to do so on the East Coast.

When students leave for the summer, Stewart is one of dozens of housekeepers who clean every inch of the building – doing laundry, waxing floors, and pushing a vacuum through student bedrooms.

When she spoke to a reporter in early June, she said temperatures in the building had already swelled close to ninety degrees.

“I really didn’t finish my assignment yet because I’ve been really slowing myself down a little bit [more] than usual,” she said.

Advertisement

Stewart feels generally supported by her employer to take the measures she needs to keep herself from getting too sick– like slowing down, stopping for water, or just leaving work undone until the worst part of the heat passes.

But many are not so lucky.

Thirty-six U.S. workers died from heat sickness in 2021, the last complete year in which the Bureau of Labor Statistics provided data. That number has grown throughout the last decade and according to independentinvestigations, those are likely undercounts.

In the decade from 2011-2020 there were 34,000 work-related heat injuries and illnesses severe enough that workers had to take time away from the job. It’s likely those numbers are undercounts too, according to the federal Occupational Safety and Health Administration (OSHA) because states have varying definitions for heat sickness and most data comes from self-reporting.

State Delegate Lorig Charkoudian, a Democrat, proposed the bill to create Maryland’s heat standard back in 2020.

Advertisement

“We are facing serious impacts from climate change, and it plays out in many ways, harming usually, the most vulnerable communities first,” Charkoudian said.

Occupational safety experts say Maryland is poised to enact one of the most comprehensive standards.

Under the rules, employers will have to post protections in workers’ native languages and provide acclimatization periods so workers can get adjusted to the heat. Workplaces will have to have a written heat safety plan for any work done when the heat index, including humidity, is at 80 degrees or above. That goes for indoor and outdoor work. Additional protocols, like paid mandatory cooled and shaded breaks every two hours, are triggered when temperatures reach ninety degrees.

The incoming standards have received pushback from some industry groups.

Steve Sohasky, who advises construction companies with Creative Risk Management Solutions, says the standard is too extreme and that workers and companies can regulate themselves.

Advertisement

“If people need breaks, they take breaks, you know, we have that flexibility in the job,” Sohasky said after a stakeholder meeting with the Maryland Department of Labor.

Construction workers make up about 6% of the workforce, but according to a National Institute of Health study account for over one-third of yearly heat deaths. Workers of color and immigrants tend to work jobs with the most risk of heat sickness.

Adele Abrams, a labor attorney based in Maryland, says the dangers of working in the heat shouldn’t be minimized.

“I represent employers but I’m not going to sugarcoat this: people die from heat illness. I have had fatality cases I have handled where I know weather conditions were a contributing factor in causing the death of the worker,” she said.

Industry advocates have expressed concerns about the feasibility of setting up cooling and shading stations, especially in jobs where crews are constantly moving. But Abrams says some solutions require planning and creativity. Low-cost options include letting crews sit in a truck with the AC on or setting up a cooling trailer.

Advertisement

Abrams expressed concerns about the patchwork of state protections going into effect as the federal government slowly moves to set its own standards.

“How many times can [employers] reinvent the wheel and re-do their programs?” Abrams said. “This was part of what was making employers crazy back when the COVID regulations were in place…it seemed like every other month we were having to retool it because new information was available or old information was found not to be accurate.”

Anastasia Christman, a policy analyst from the National Employment Law Project, says Congress is notoriously slow in updating laws for the Occupational Safety and Health Administration, or OSHA.

“The public comment period can be made very long, the cost-benefit analysis is very difficult in the case of OSHA, because how do you count the value of injuries that won’t happen? You’re having to sort of count something negative,” Christman said.

Meanwhile, states like Texas and Florida have made it illegal for municipalities to pass their own heat ordinances.

Advertisement

Christman points out that heat, which can cause tiredness or confusion, can be the underlying cause of other incidents like forklift collisions or car accidents on the commute home.

“I think it will be very interesting to see whether or not we see not only a decrease in straight up heat illness, but also a decrease in all these other kinds of injuries. And if in fact, the workplace just starts to become exponentially safer,” she said.

If a federal standard goes into effect, experts say enforcement will still be a challenge. OSHA has fewer than 2,000 inspectors responsible for nearly eight million worksites.

Continue Reading

News

Video: Biden and Harris Greet Americans Released From Russia

Published

on

Video: Biden and Harris Greet Americans Released From Russia

new video loaded: Biden and Harris Greet Americans Released From Russia

transcript

transcript

Biden and Harris Greet Americans Released From Russia

Three Americans — Evan Gershkovich, a reporter of The Wall Street Journal; Alsu Kurmasheva, an editor for RFE/RL; and Paul Whelan, a former U.S. Marine — were freed in a prisoner exchange with Russia.

There’s nothing beyond our capacity when we act together. Nothing, nothing, nothing. Remember who the hell we are. We’re the United States of America.

Advertisement

Recent episodes in U.S.

Continue Reading

News

Japanese shares rout deepens after tech sell-off on Wall Street

Published

on

Japanese shares rout deepens after tech sell-off on Wall Street

Unlock the Editor’s Digest for free

Japanese stocks ended an already turbulent week in a nosedive, dropping to a six-month low as global funds fled risk and the strengthening yen continued to squeeze speculators out of the so-called carry trade.

The broad Topix benchmark of Japanese stocks, which peaked at an all-time high in mid-July and had been one of the world’s best-performing indices of 2024, fell 5.5 per cent in the first hour of Tokyo trading on Friday.

The sell-off followed a 3.2 per cent fall in the Topix on Thursday and heavy overnight drops on Wall Street led by growing market concerns around the US economy and resilience of the tech sector.

Advertisement

“We haven’t really seen these moves since Covid. Why are they so extreme? Because bad data in the US is now being treated as bad data,” said Takeo Kamai, head of execution services at CLSA in Tokyo. He added that weak economic data was now fuelling recession fears, whereas previously investors took negative US data as a sign that interest rates might come down and boost equities.

“Geopolitics and earnings are playing into this,” said Kamai. “Uncertainty is very high, and people are de-risking.”

The sell-off has been accelerated by heavily leveraged Japanese retail investors rushing to get out of a popular exchange traded fund, the Nomura NF Nikkei 225 ETF, traders said. The ETF fell 9.55 per cent on Friday as individual investors rushed to stem losses.

A 20 per cent plunge in Intel shares after US markets closed spooked Tokyo, where tech and semiconductor names have been among the most attractive to foreign investors.

Bellwether Japanese technology names, led by Tokyo Electron, SoftBank, Lasertec and Advantest all fell heavily in a rout that traders at two Japanese houses said appeared to have been led by large overnight sell orders from European and US long-only funds.

Advertisement

“It’s been a profit-taking frenzy this week. The big funds are taking risk off the table, and Japan is being hardest hit after a very strong run and now a macro backdrop that looks less bright,” said one senior broker at a Japanese securities house. “How long will this go on? We are not seeing signs of strong support here.”

The selling targeted many sectors but hit financials and industrials especially hard. Mitsubishi Heavy Industries, the defence contractor whose shares had surged to an all-time high this year and which had been a favourite of foreign investors, has fallen more than 13 per cent this week.

Part of the damage has been the stronger yen, with a chill cast over Japanese manufacturers whose profits are heavily bolstered when the currency is weak, traders said.

The Bank of Japan’s unexpected interest rate increase on Wednesday and the implication that it has entered a rate-raising cycle, even as the US Federal Reserve appears poised to cut rates, has propelled the yen far higher than many had expected.

At Friday’s level of ¥149.6 against the dollar, the yen is now 7 per cent higher than it was in mid-July, and at a level that currency traders said was continuing to deter speculators from the huge bets against the yen that had been built up throughout 2024.

Advertisement

For Japanese stocks, the dollar-yen rate has suddenly switched from tailwind to headwind, hitting exporters and forcing investors into fairly aggressive portfolio restructuring, analysts said.

“We don’t think that the Japan story is broken at this point, but the rules of the game have definitely changed,” said Bruce Kirk, chief Japan equity strategist at Goldman Sachs.

“The way investors have made money from Japan up until now and what will be required to make money from here will be different. So less focus on a narrow group of blue-chip exporters and more work around companies with higher domestic demand exposure.”

Continue Reading

Trending