Connect with us

Business

How Self-Driving Cars Get Help From Humans Hundreds of Miles Away

Published

on

How Self-Driving Cars Get Help From Humans Hundreds of Miles Away

In places like San Francisco, Phoenix and Las Vegas, robot taxis are navigating city streets, each without a driver behind the steering wheel. Some don’t even have steering wheels:

But cars like this one in Las Vegas are sometimes guided by someone sitting here:

Advertisement

This is a command center in Foster City, Calif., operated by Zoox, a self-driving car company owned by Amazon. Like other robot taxis, the company’s self-driving cars sometimes struggle to drive themselves, so they get help from human technicians sitting in a room about 500 miles away.

Inside companies like Zoox, this kind of human assistance is taken for granted. Outside such companies, few realize that autonomous vehicles are not completely autonomous.

For years, companies avoided mentioning the remote assistance provided to their self-driving cars. The illusion of complete autonomy helped to draw attention to their technology and encourage venture capitalists to invest the billions of dollars needed to build increasingly effective autonomous vehicles.

“There is a ‘Wizard of Oz’ flavor to this,” said Gary Marcus, an entrepreneur and a professor emeritus of psychology and neural science at New York University who specializes in A.I. and autonomous machines.

If a Zoox robot taxi encounters a construction zone it has not seen before, for instance, a technician in the command center will receive an alert — a short message in a small, colored window on the side of the technician’s computer screen. Then, using the computer mouse to draw a line across the screen, the technician can send the car a new route to follow around the construction zone.

Advertisement

“We are not in full control of the vehicle,” said Marc Jennings, 35, a Zoox remote technician. “We are providing guidance.”

As companies like Waymo, owned by Google’s parent company, Alphabet, and Cruise, owned by General Motors, have begun to remove drivers from their cars, scrutiny of their operations has increased. After a series of high-profile accidents, they have started to acknowledge that the cars require human assistance.

While Zoox and other companies have started to reveal how humans intervene to help driverless cars, none of the companies have disclosed how many remote-assistance technicians they employ or how much it all costs. Zoox’s command center holds about three dozen people who oversee what appears to be a small number of driverless cars — two in Foster City and several more in Las Vegas — as well as a fleet of about 200 test cars that each still have a driver behind the steering wheel.

When regulators last year ordered Cruise to shut down its fleet of 400 robot taxis in San Francisco after a woman was dragged under one of its driverless vehicles, the cars were supported by about 1.5 workers per vehicle, including remote assistance staff, according to two people familiar with the company’s operations. Those workers intervened to assist the vehicles every two and a half to five miles, the people said.

The expenses associated with remote assistance are one reason robot taxis will struggle to replace traditional ride-hailing fleets operated by Uber and Lyft. Though companies like Zoox are beginning to replace drivers, they still pay people to work behind the scenes.

Advertisement

“It may be cheaper just to pay a driver to sit in the car and drive it,” said Thomas W. Malone, a professor at the Massachusetts Institute of Technology Center for Collective Intelligence.

Waymo and Cruise declined to comment for this story.

While those companies use traditional cars retrofitted for self-driving, Zoox is testing a new kind of vehicle in Foster City, just south of San Francisco, and in Las Vegas, not far from the Strip.

After testing the vehicles with Zoox employees, their family members and friends, the company plans to make the service available to the public this year. But this robot taxi, like all others, will lean on human assistance.

In Foster City, the company operates what it calls a “fusion center,” where employees monitor robot taxis operating both locally and in Las Vegas, several hundred miles away. From their computer screens, these workers can track live feeds of the road from cameras installed on the cars as well as a detailed overhead view of each car and its surroundings, which is stitched together using data streaming from an array of sensors on the vehicle.

Advertisement

The workers can provide verbal assistance to riders via speakers and microphones inside the cars. They can also assist a car if it encounters a scenario it cannot handle on its own.

Jason Henry for The New York Times

“These are situations that don’t necessarily fit the mold,” said Jayne Aclan, who oversees a team of Zoox technicians that provide cars with remote assistance.

Advertisement

Self-driving cars can reliably handle familiar situations, like an ordinary right turn or a lane change. They are designed to brake on their own when a pedestrian runs in front of them. But they are less adept in unusual or unexpected situations. That’s why they still need the humans in the fusion center.

But even though self-driving cars have remote assistance, they still make mistakes on the road.

After reviewing the incident, Zoox indicated that its car had struggled to recognize the fire trucks because they were yellow, not red. “We continue to test and refine our driving software,” Whitney Jencks, a company spokeswoman, said.

Zoox will also continue to lean on human assistance.

Advertisement

“We think that computers should be able to replicate humans and replace humans in all ways,” Dr. Malone, the M.I.T. professor, said. “It is possible that might happen. But it hasn’t yet.”

Business

How bits of Apple history can be yours

Published

on

How bits of Apple history can be yours

In March 1976, Apple cofounders Steve Jobs and Steve Wozniak both signed a $500 check weeks before the official creation of a California company that would transform personal computing and become a global powerhouse.

Now that historic Wells Fargo check could be sold for $500,000 at an auction that ends on Jan. 29. The sale, run by RR Auction, includes some of Apple’s early items and childhood belongings of Jobs, Apple’s cofounder and chief executive, who died in 2011 at 56, after battling pancreatic cancer.

Since its founding, the Cupertino tech giant has attracted millions of fans who buy its laptops, smartphones, headphones and smart watches. The auction gives the adoring public a chance to own part of the company’s history ahead of Apple’s 50th anniversary in April.

Apple’s first check from March 1976 predates the company’s official founding in April 1976. It also includes the signatures of Steve Jobs and Steve Wozniak.

(RR Auction)

Advertisement

“Without a doubt, check number one is the most important piece of paper in Apple’s history,” said Corey Cohen, a computer historian and Apple-1 expert, in a video about the item. At the time, Apple’s cofounders, he added, were “putting everything on the line.”

Cohen said he’s known of a governor, entrepreneurs, award-winning filmmakers and musicians who own rare Apple collectibles. Jobs is a “cult of personality,” and people collect items tied to the tech mogul.

“This is a very important collection that’s being sold because there are a lot of personal items, a lot of things that weren’t generally available to the public before, because these things are coming right out of Jobs’ home,” he said in an interview.

RR Auction said it couldn’t share the names of the consignors on the check and some of the other auction items.

Advertisement

As of Monday, bids on the check surpassed $200,000. Jobs typically didn’t sign autographs, so owning a document bearing his signature is rare.

Other items up for auction include Apple’s March 1976 Wells Fargo account statement — the company’s first financial document — and an Apple-1 computer prototype board used to validate Apple’s first computer.

The auction features a variety of memorabilia, including vintage Apple posters, Apple rainbow glasses, letters, magazines, older Apple computers, and other historic items.

Apple didn’t respond to a request for comment.

Some of Jobs’ personal items came from his stepbrother, John Chovanec, who had preserved them for decades.

Advertisement

The items provide “a rare view” into Jobs’ “private world and formative years outside Apple’s corporate narrative,” a news release about the auction said.

Jobs’ bedroom desk from his family’s Los Altos home, which housed a garage where Apple-1 computers were put together, is also up for sale.

Papers from Jobs’ years before Apple are inside the desk and the highest bid on that item has surpassed $44,000.

An auction celebrating Apple's upcoming 50th anniversary includes late Apple co-founder Steve Jobs' belongings.

A bedroom desk that belonged to late Apple cofounder Steve Jobs provides a glimpse into his early years before he created the tech company.

(RR Auction)

Advertisement

Bids on an Apple business card on which Jobs writes “Hi, I’m back” in black ink to his father reached more than $22,200. The card features Apple’s colorful logo alongside Jobs’ title as chairman, a role he returned to in 2011, according to the auction site.

Other items include 8-track tapes that featured music from artists such as Bob Dylan. Bids on a 1977 vintage poster featuring a red Apple that hung in Jobs family’s living room top $16,600, the auction site shows.

While Jobs is known for donning a black turtleneck, he also wore bow ties during high school and at Apple’s early events.

An auction to celebrate Apple's upcoming 50th anniversary includes bow ties worn by late Apple cofounder Steve Jobs.

A collection of bow ties that belonged to late Apple co-founder Steve Jobs.

(RR Auction)

Advertisement

Some of Jobs’ bow ties have sold for thousands of dollars at other auctions.

Last year, a pink-and-green striped bow tie he wore when introducing the Macintosh computer in 1984 sold for more than $35,000 at a Julien’s Auctions event that highlighted technology and history.

The items on RR Auction feature colorful clip-on bow ties from Jobs’ bedroom closet.

“This brief fashion phase contrasted sharply with the minimalist black turtleneck and jeans that would later define his public image,” a description of the item states. “The shift reflected Jobs’ evolution from an ambitious young innovator to a visionary with a distinct and enduring personal brand.”

Advertisement
Continue Reading

Business

Defiant independence from the Federal Reserve catches Trump off guard

Published

on

Defiant independence from the Federal Reserve catches Trump off guard

White House officials were caught by surprise when a post appeared Sunday night on the Federal Reserve’s official social media channel, with Jerome Powell, its chairman, delivering a plain and clear message.

President Trump was not only weaponizing the Justice Department to intimidate him, Powell said to the camera, standing before an American flag. This time, he added, it wasn’t going to work.

The lack of any warning for officials in the West Wing, confirmed to The Times, was yet another exertion of independence from a Fed chair whose stern resistance to presidential pressure has made him an outlier in Trump’s Washington.

Advertisement
  • Share via

Advertisement

Powell was responding to grand jury subpoenas delivered to the Fed on Friday related to his congressional testimony over the summer regarding construction work at the Reserve.

“The threat of criminal charges is a consequence of the Federal Reserve setting interest rates based on our best assessment of what will serve the public, rather than following the preferences of the president,” Powell said.

“This is about whether the Fed will be able to continue to set interest rates based on evidence and economic conditions,” he added, “or whether instead monetary policy will be directed by political pressure or intimidation.”

For months, Trump and his aides have harshly criticized Powell for his decision-making on interest rates, which the president believes should be dropped faster. On various occasions, Trump has threatened to fire Powell — a move that legal experts, and Powell himself, have said would be illegal — before pulling back.

Advertisement

The Trump administration is currently arguing before the Supreme Court that the president should have the ability to fire the heads of independent agencies at will, despite prior rulings from the high court underscoring the unique independence of the central bank.

The decision by the Justice Department to subpoena the Fed over the construction — a $2.5-billion project to overhaul two Fed buildings, operating unrenovated since the 1930s — comes at a critical juncture for the U.S. economy, which has been issuing conflicting signals over its health.

Employers added only 50,000 jobs last month, fewer than in November, even as the unemployment rate dipped a tenth of a point to 4.4%, for its first decline since June. The figures indicate that businesses aren’t hiring much despite inflation slowing down and growth picking up.

The government reported last month that inflation dropped to an annual rate of 2.7% in November, down from 3% in September, while economic growth rose unexpectedly to an annual rate of 4.3% in the third quarter.

However, the long government shutdown interrupted data collection, lending doubt to the numbers. At the same time, there is uncertainty about the legality of $150 billion or more in tariffs imposed on China and dozens of countries through the International Emergency Economic Powers Act, which has been challenged and is under review by the Supreme Court.

Advertisement

As inflation has cooled, the Fed under Powell has incrementally cut the federal funds rate, the target interest rate at which banks lend to one another and the bank’s primary tool for influencing inflation and growth. The Fed held the rate steady at a range of 4.25% to 4.5% through August, before a series of fall cuts left it at 3.5% to 3.75%.

That hasn’t been enough for Trump, who has called for the rate to be lowered faster and to a nearly rock bottom 1%. The last time the central bank dropped the rate so low was in the dark days of the early pandemic in March 2020. It began raising rates in 2022 as inflation took off and proved stubborn despite the bank’s efforts to rein it in.

Mark Zandi, chief economist at Moody’s Analytics, said there is room to continue lowering the federal funds rate to 3%, where it should be in a “well functioning economy, neither supporting or restraining growth.”

However, muscling the Fed to lower rates and reduce or destroy its independence is another matter.

“There’s no upside to that. It’s all downside, different shades of gray and black, depending on how things unfold,” he said. “It ends in higher inflation and ultimately a much diminished economy and potentially a financial crisis.”

Advertisement

Zandi said much will hinge on the Supreme Court’s decision on whether Trump can remove Federal Reserve Governor Lisa Cook, which he sought to do last year, citing allegations of mortgage fraud she denies.

While Powell’s term as chairman ends in May, his term as a governor — influencing interest-rate decisions — extends to January 2028. A criminal indictment over the construction project could provide Trump the legal justification he needs to remove him altogether.

“When he steps down in May, will he stay on the board or does he leave? That will make a difference,” Zandi said.

A key issue will be how much independence the Fed retains, he said, given the central bank’s role in establishing the U.S. as a safe haven for international bond investors who play a key role funding the federal deficit.

The investors rely on the bank to keep inflation under control, or they will demand the government pay more for its long term bonds — though the subpoenas had little effect so far Monday on bond prices.

Advertisement

“There are scenarios where the bond market says, ‘Oh my gosh, we’re going to see much higher inflation, and there’s a bond sell-off and a spike in long-term rates,” he said. “That’s a crisis.”

Zandi said that even if the worst-case scenarios don’t play out, it will take time for the Federal Reserve to reestablish its reputation as an independent bank not influenced by politics.

“I’m not sure investors will ever forget this,” he said. “Most importantly, it depends on who Trump nominates to be the next chair of the Federal Reserve — and how that person views his or her job.”

Lawmakers from both parties have questioned the motivation behind the investigation.

North Carolina Sen. Thom Tillis, a Republican member of the Senate Committee on Banking, Housing and Urban Affairs, has said he plans to oppose the confirmation of any nominee for the Fed until the legal matter is “fully resolved.”

Advertisement

“If there were any remaining doubt whether advisers within the Trump administration are actively pushing to end the independence of the Federal Reserve, there should now be none,” Tillis wrote in a social media post.

Sen. Elizabeth Warren, the top Democrat on that committee, accused Trump of trying to “install another sock puppet to complete his corrupt takeover of America’s central bank.”

“Trump is abusing the authorities of the Department of Justice like a wannabe dictator so the Fed serves his interests, along with his billionaire friends,” Warren said in a statement.

Rep. French Hill (R-Ark.), the chairman of the House Financial Services Committee, also expressed skepticism about the inquiry, which he characterized as an “unnecessary distraction.”

“The Federal Reserve is led by strong, capable individuals appointed by President Trump, and this action could undermine this and future Administrations’ ability to make sound monetary public decisions,” Hill wrote in a statement.

Advertisement

As Hill raised concerns about the investigation, he added he personally knew Powell to be a “person of the highest integrity.”

House Speaker Mike Johnson (R-La.), meanwhile, dismissed the idea that the Justice Department was being weaponized against Powell. When asked by a reporter if he thought that was the case, he said: “Of course not.”

Times staff writers Wilner and Ceballos reported from Washington and Darmiento from Los Angeles.

Advertisement
Continue Reading

Business

Mattel introduces its first Barbie with autism, headphones on and fidget spinner in hand

Published

on

Mattel introduces its first Barbie with autism, headphones on and fidget spinner in hand

Mattel is releasing its first autistic Barbie doll.

Created in partnership with the Autistic Self Advocacy Network (ASAN), the toy launched Monday is meant to represent children with autism spectrum disorder and how they experience the world.

The doll joins the Barbie Fashionistas line, which features more than 175 looks across various skin tones, body types and disabilities.

Previous additions include Barbie dolls with Type 1 diabetes, Down syndrome and blindness.

The Barbie with autism was in development for more than 18 months. ASAN, the nonprofit disability rights organization run by and for the autistic community, provided guidance as to how the doll can most accurately represent the various experiences people on the autism spectrum may relate to and celebrate the community.

Advertisement

The toy features elbow and wrist articulation, which allows for stimming and other gestures. Her eyes are shifted to the side to avoid eye contact.

She carries a fidget spinner and a tablet. She also wears noise-canceling headphones and a loose-fitting dress that allows for less fabric-to-skin contact.

To celebrate the new doll, Mattel is donating more than 1,000 autistic Barbies to pediatric hospitals across the country that offer specialized services for children on the spectrum. According to the autism nonprofit, Autism Speaks, one in 31 children and one in 45 adults in the U.S. has autism.

“Barbie has always strived to reflect the world kids see and the possibilities they imagine, and we’re proud to introduce our first autistic Barbie as part of that ongoing work,” said Jamie Cygielman, global head of dolls at Mattel, in a press release.

She added that the doll “helps to expand what inclusion looks like in the toy aisle and beyond because every child deserves to see themselves in Barbie.”

Advertisement

The toymaker’s investments in diversity and representation have proved commercially successful.

The Fashionistas line launched in 2009 and has provided the opportunity to create dolls beyond Barbie’s original look. In 2024, the most popular Fashionistas dolls globally included the blind Barbie and the Barbie with Down syndrome. The wheelchair-using doll has also consistently been a top performer since its debut in 2019.

Founded in 1945, Mattel started out of a Los Angeles garage. Over the last 80 years, the El Segundo-based company cemented itself as a multibillion-dollar toy company with products and brands like Fisher-Price, Hot Wheels cars and American Girl.

The new autistic Barbie is available starting Monday through Mattel Shop and retailers nationwide.

Advertisement
Continue Reading

Trending