Connect with us

Business

Inside the race to train AI robots how to act human in the real world

Published

on

Inside the race to train AI robots how to act human in the real world

Now that artificial intelligence has mastered almost everything we do online, it needs help learning how we physically move around in the real world.

A growing global army of trainers is helping it escape our computers and enter our living rooms, offices and factories by teaching it how we move.

In an industrial town in southern India, Naveen Kumar, 28, stands at his desk and starts his job for the day: folding hand towels hundreds of times, as precisely as possible.

He doesn’t work at a hotel; he works for a startup that creates physical data used to train AI.

A robot practices for the 100-meter race before the opening ceremony of the World Humanoid Robot Games in Beijing in August.

Advertisement

(Ng Han Guan / Associated Press)

He mounts a GoPro camera to his forehead and follows a regimented list of hand movements to capture exact point-of-view footage of how a human folds.

That day, he had to pick up each towel from a basket on the right side of his desk, using only his right hand, shake the towel straight using both hands, then fold it neatly three times. Then he had to put each folded towel in the left corner of the desk.

If it takes more than a minute or he misses any steps, he has to start over.

Advertisement

His firm, a data labeling company called Objectways, sent 200 towel-folding videos to its client in the United States. The company has more than 2,000 employees; about half of them label sensor data from autonomous cars and robotics, and the rest work on generative AI.

Most of them are engineers, and few are well-practiced in folding towels, so they take turns doing the physical labor.

“Sometimes we have to delete nearly 150 or 200 videos because of silly errors in how we’re folding or placing items,” said Kumar, an engineering graduate who has worked at Objectways for six years.

The carefully choreographed movements are to capture all the nuances of what humans do — arm reaching, fingers gripping, fabric sliding — to fold clothes.

The captured videos are then annotated by Kumar and his team. They draw boxes around the different parts of the video, tag the towels, and label whether the arm moved left or right, and classify each gesture.

Advertisement

Kumar and his colleagues in the town of Karur, which is about 300 miles south of Bengaluru, are an unlikely batch of tutors for the next generation of AI-powered robots.

“Companies are building foundation models fit for the physical world,” said Ulrik Stig Hansen, co-founder of Encord, a data management platform in San Francisco that contracts with Objectways to collect human demonstration data. “There’s this huge resurgence in robotics.”

Encord works with robotics companies such as Jeff Bezos-backed Physical Intelligence and Dyna Robotics.

Tesla, Boston Dynamics and Nvidia are among the leaders in the U.S. in the race to develop the next generation of robots. Tesla already uses its Optimus robots — which seem to be often remotely controlled — for different company events. Google has its own AI models for robotics. OpenAI is beefing up its robotics ambitions.

Nvidia projects the humanoid robot market could reach $38 billion over the next decade.

Advertisement

There are also many lesser-known companies trying to provide the hardware, software and data to make a mass-produced, multitasking humanoid robot a reality.

Robots at Nvidia's booth an an expo in Beijing

Robots are displayed at Nvidia’s booth during the China International Supply Chain Expo in Beijing in July.

(Mahesh Kumar A. / Associated Press)

Large language models that power chatbots such as ChatGPT have mastered using language, images, music, coding and other skills by hoovering up everything online. They use the entire internet to figure out how things are connected and mimic how we do things, such as answering questions and creating photo-realistic videos.

Data on how the physical world works — how much force is required to fold a napkin, for example — is harder to get and translate into something AI can use.

Advertisement

As robotics improves and combines with AI that knows how to move in the physical world, it could bring more robots into the workplace and the home. While many fear this could lead to job losses and unemployment, optimists think advanced robots would free up humans from tedious work, lower labor costs and eventually give people more time to relax or focus on more interesting and important work.

Many companies have entered the fray as shovel sellers in the AI gold rush, seeing an opportunity to gather data for what is being called physical AI.

One group of companies is teaching AI how to act in the real world by having humans guide robots remotely.

Ali Ansari, founder of San Francisco-based Micro1, said emerging robotics data collection increasingly focuses on teleoperations. Humans with controllers make the robot do something like picking up a cup or making tea. The AI is fed videos of successful and failed attempts at doing something and learns to do it.

The remote-control training can happen in the same room as the robots or with the controller in a different country. Encord’s Hansen said that there are warehouses planned in Eastern Europe where large teams of operators will sit with joysticks, guiding robots across the world.

Advertisement

There are more of these, what some have dubbed “arm farms,” popping up as demand increases, said Mohammad Musa, founder of Deepen AI, a data annotation firm headquartered in California.

“Today, a mix of real and synthetic data is being used, gathered from human demonstrations, teleoperation sessions and staged environments,” he said. “Much of this work still occurs outside the West, but automation and simulation are reducing that dependency over time.”

Some have criticized teleoperated humanoids for being more sizzle than substance. They can be impressive when others are controlling them, but still far from fully autonomous.

Ansari’s Micro1 also does something called human data capture. It pays people to wear smart glasses that capture everyday actions. It is doing this in Brazil, Argentina, India, and the United States.

San José-based Figure AI, partnered with real estate giant Brookfield to capture footage from inside 100,000 homes. It will collect data about human movement to teach humanoid robots how to move in human spaces. The company said it will spend much of the $1 billion it raised to collect first-person human data.

Advertisement

Meta-backed Scale AI, has collected 100,000 hours of similar training footage for robotics through its prototype laboratory set up in San Francisco.

Still, training bots isn’t always easy.

Twenty-year-old Dev Mandal created a company in Bengaluru, hoping to cash in on the need for physical data to train AI. He offered India’s inexpensive labor to capture movements. After advertising his services, he got requests to help train a robotic arm to cook food as well as a robot to plug and unplug cables in data centers.

But he had to give up the business, as potential clients needed the physical movement data collected in a very specific manner, making it tougher for him to make money, even with India’s inexpensive labor. Clients wanted an exact robot arm, for example, using a certain kind of table with purple lights to be used.

“Everything, down to the color of the table, had to be specified by them,” he said. “And they said that this has to be the exact color.”

Advertisement

Still, there’s lots of work for the towel folders of Karur.

Their boss, Objectways founder Ravi Shankar, says that in recent months, his firm has captured and annotated footage of robotic arms folding cardboard boxes and T-shirts and picking out certain colored objects on a table.

It recently started annotating videos from more advanced humanoid robots, helping train them to sort and fold a mix of towels and clothes, folding them and placing them in different corners of the table. His team had to annotate 15,000 videos of the robots doing the jobs.

“Sometimes the robot’s arms throw the clothes and won’t fold properly. Sometimes it scatters the stack,” but the robots are learning quickly said Kavin, 27, an Objectways employee who goes by one name. “In five or 10 years, they’ll be able to do all the jobs and there will be none left for us.”

Advertisement

Business

Rent-hike ban to protect fire victims ends despite gouging concerns

Published

on

Rent-hike ban to protect fire victims ends despite gouging concerns

A rule intended to prevent rent gouging in the wake of the Eaton and Palisades fires has lapsed in Los Angeles County, possibly exposing some renters to hikes.

The executive order that blocked rent increases was issued by Gov. Gavin Newsom amid the devastating wildfires last year. Under the order, landlords couldn’t increase rents by more than 10% above their prefire levels.

The rule, which was supposed to be temporary and was repeatedly extended, ended Friday after a vote to extend it again failed to garner enough votes. Supervisor Lindsey Horvath, whose district includes Pacific Palisades, sounded the alarm in a motion to extend price protections that failed to pass at the Board of Supervisors’ May 19 meeting.

“These price gouging protections continue to be necessary as construction and rebuilding continue, and as thousands of people remain displaced,” the motion said. “Families which signed short-term leases could face drastic price increases of 50% or more without further price gouging protection.”

Advertisement

Los Angeles County is home to more than 1 million rental properties, though not all of them needed protection from the new rule. There are already stricter rent increase caps for many residences, depending on the location, type and age of the building. Despite the rent control in the region, the people of Los Angeles pay among the highest rents in the country.

It is uncertain whether renters will face rapidly rising rents now that the protection has lapsed. But some real estate experts and policymakers said there was no need for the temporary rule that was part of the governor’s state of emergency.

Supervisors Kathryn Barger, Janice Hahn and Holly Mitchell abstained from voting on the motion to extend the protection, while Supervisors Hilda Solis and Horvath supported it.

“I abstained because I did not see sufficient evidence to justify extending this emergency ordinance, nor did I see evidence to eliminate it entirely,” Hahn said.

Barger’s office said she supported allowing the protections to sunset while waiting to see whether new information emerged.

Advertisement

“Market data already shows countywide rents are only about 2% above pre-emergency levels and rental inventory has grown,” Barger representative Helen E. Chavez Garcia said. “The Supervisor is also mindful of the burden these ongoing protections place on small property owners throughout the county.”

Mitchell did not immediately respond to a request for comment.

There haven’t been steep rent hikes in neighborhoods within three miles of the Palisades fire, according to a Times analysis of data from Zillow, the property listing company.

In ZIP Codes within three miles of the Palisades fire, rent increased 4.8% from December 2024 to April 2025. In areas around the Eaton fire, which destroyed swaths of Altadena, rent jumped 5.2% in the same period.

In L.A. County, ZIP Codes farther from the fires saw only about a 2% increase.

Advertisement

A landlords representative, Jesus Rojas of the Apartment Owners Assn. of Greater Los Angeles, told the supervisors during public comment at the meeting that the county’s rent-gouging rules have “long outlived the emergency they were intended to address” and are now being “wrongfully used to harm thousands of rental housing providers throughout the county.”

“There is no proof that multifamily rental housing providers are hugely increasing rents for impacted homeowners,” Rojas said.

Indeed, there are strong signs that the property market in the Los Angeles area has at last begun to cool.

L.A. metro-area rent prices recently fell to a four-year low, with the median rent slipping to $2,167 in December.

Meanwhile, condominium sales had their slowest start of the year in decades. Condo sales in Los Angeles have plummeted to a 20-year low, with fewer than 2,000 units sold in January and February — the worst start to the year since 2005.

Advertisement

Newsom defended the price-gouging protections shortly after they went into effect.

“In the days following the Los Angeles firestorms, we worked quickly to protect Los Angeles survivors from any form of exploitation,” he said in February 2025. “The state has the tools in place to not only block price gouging during this emergency, but also to prosecute bad actors.”

The Los Angeles County Department of Consumer and Business Affairs said it received more than 2,000 complaints after the fires, alleging that retailers and landlords were taking advantage of people put in hardship by their losses, and sent out more than 2,000 cease-and-desist letters to businesses and landlords for alleged price gouging, said Morine Merritt, who oversees department investigations into consumer and real estate fraud.

“Close to 90% of the complaints that we received involved allegations of rent increases,” Merritt said in an interview. Now that the fire-related protections have expired, existing laws and “regular market conditions determine price increases for goods and services, including rents,” she said.

Crackdowns on fire-related rent gouging have been rare, said Chelsea Kirk of the activist organization the Rent Brigade, which analyzed L.A. County’s rental market in the year after the fires. It reported 18,360 potential examples of price gouging in listings but said that few lawsuits had been filed by authorities so far.

Advertisement

Last week, Rent Brigade announced what it said was the first private civil lawsuit brought by a family that claimed to be rent-gouged in the aftermath of the wildfires. Plaintiffs Randall and Candy Renick, whose Altadena home was damaged, said they were charged nearly three times the maximum permitted rate for nearly 10 months. They seek restitution of $96,000 plus civil penalties and attorneys’ fees.

The rental market has probably stabilized since the fires, Kirk said, but other families may still be “locked into illegal rents” that they agreed to pay when they were in a rush to find housing after they were displaced.

Continue Reading

Business

Read Nick Bilton’s Letter to Scott Pelley

Published

on

Read Nick Bilton’s Letter to Scott Pelley

Dear Mr. Pelley:

I meant what I said in my letter last week to the 60 Minutes team: joining 60 Minutes is the honor of my career and I am grateful to be working alongside the people who have contributed to the most important television journalism brand this country has ever produced. While I’m new to 60 Minutes, I’ve devoted my career to investigative journalism and storytelling. I started this job excited to collaborate and to benefit from the wisdom and experience of the 60 Minutes veterans, with you among them. For that reason, one of the first things I did in my new role was call you to talk and invite you to dinner. It is a profound disappointment that you rejected that overture and chose ambush instead. Yesterday, you hijacked my first meeting with staff to disparage me, my qualifications, and my intentions with remarkable incivility and contempt. I welcome a diversity of viewpoints and respectful debate among the team, but this was nothing of the sort. Yesterday’s performative display of hostility enacted in front of the staff instead of in a civil, private conversation-demonstrated that you have no interest in contributing to the future success of the show, or approaching my new tenure with a mind open to collaboration and progress. I am here to deliver first-in-class news programming, not to make headlines about newsroom drama. I am eager to work alongside those who share this goal.

Despite yesterday’s misconduct, I had hoped that in sitting down with you today we could find a path forward together. You made clear that you are not interested in such a path.

Your antipathy to the future of the show has come through loud and clear. And I have heard you. I therefore write on behalf of CBS News, Inc. (“CBS”) to inform you that your employment with CBS is terminated for cause effective immediately. Enclosed is your formal termination letter.

Sincerely,

Nick Bilton

Executive Producer, 60 Minutes

Continue Reading

Business

Aspiration co-founder sentenced to 14 years for fraud

Published

on

Aspiration co-founder sentenced to 14 years for fraud

The co-founder of Aspiration, Joseph Sanberg, was sentenced to 14 years in prison on Monday after defrauding investors and lenders of over $248 million.

The startup, an eco-friendly digital banking company boasting fossil fuel-free investments, carbon offsets for gas purchases, and a debit card with cash-back benefits for shopping at clean companies, was founded by Sanberg and Andrei Cherny. Cherny left the company in 2022 and has not been charged.

Sanberg, an Orange County native, pleaded guilty to wire fraud in October after being arrested in March last year. Aspiration subsequently filed for bankruptcy and liquidated all of its assets by July.

Sanberg and venture capitalist Ibrahim AlHusseini, who also faces charges, together forged a series of bank statements in order to obtain loans. From 2020 to 2021, the pair forged AlHusseini’s bank statements to show millions of dollars in assets in order to obtain millions of dollars from lenders.

Advertisement

Additionally, they forged a letter from their audit committee stating that $250 million in funds were available, when in reality Aspiration had less than $1 million. The amount of loans defrauded exceeded $248 million.

In 2021, Sanberg artificially inflated Aspiration’s 2021 revenue by $44 million by recruiting 27 fake customers to sign letters of intent pledging tens of thousands of dollars per month for tree planting services. Sanberg himself funded the contracts and used the inflated revenue numbers to obtain more loans.

The charges sparked an NBA investigation into salary cap allegations due to Aspiration’s connections with Clippers owner Steve Ballmer.

Ballmer personally invested $60 million in Aspiration, all of which was lost. He is now the target of a civil lawsuit alleging his participation in the scheme. Ballmer denies the allegations.

The team announced a $300-million sponsorship deal with Aspiration, and Clippers player Kawhi Leonard signed a four-year, $28-million marketing contract with the company, which reportedly performed no duties. The issue has raised concerns about how players are circumventing the NBA’s salary cap.

Advertisement

The team lost the $300-million sponsorship deal and an additional $20 million paid for carbon offset purchases.

Continue Reading
Advertisement

Trending