Connect with us

Business

Inside the race to train AI robots how to act human in the real world

Published

on

Inside the race to train AI robots how to act human in the real world

Now that artificial intelligence has mastered almost everything we do online, it needs help learning how we physically move around in the real world.

A growing global army of trainers is helping it escape our computers and enter our living rooms, offices and factories by teaching it how we move.

In an industrial town in southern India, Naveen Kumar, 28, stands at his desk and starts his job for the day: folding hand towels hundreds of times, as precisely as possible.

He doesn’t work at a hotel; he works for a startup that creates physical data used to train AI.

A robot practices for the 100-meter race before the opening ceremony of the World Humanoid Robot Games in Beijing in August.

Advertisement

(Ng Han Guan / Associated Press)

He mounts a GoPro camera to his forehead and follows a regimented list of hand movements to capture exact point-of-view footage of how a human folds.

That day, he had to pick up each towel from a basket on the right side of his desk, using only his right hand, shake the towel straight using both hands, then fold it neatly three times. Then he had to put each folded towel in the left corner of the desk.

If it takes more than a minute or he misses any steps, he has to start over.

Advertisement

His firm, a data labeling company called Objectways, sent 200 towel-folding videos to its client in the United States. The company has more than 2,000 employees; about half of them label sensor data from autonomous cars and robotics, and the rest work on generative AI.

Most of them are engineers, and few are well-practiced in folding towels, so they take turns doing the physical labor.

“Sometimes we have to delete nearly 150 or 200 videos because of silly errors in how we’re folding or placing items,” said Kumar, an engineering graduate who has worked at Objectways for six years.

The carefully choreographed movements are to capture all the nuances of what humans do — arm reaching, fingers gripping, fabric sliding — to fold clothes.

The captured videos are then annotated by Kumar and his team. They draw boxes around the different parts of the video, tag the towels, and label whether the arm moved left or right, and classify each gesture.

Advertisement

Kumar and his colleagues in the town of Karur, which is about 300 miles south of Bengaluru, are an unlikely batch of tutors for the next generation of AI-powered robots.

“Companies are building foundation models fit for the physical world,” said Ulrik Stig Hansen, co-founder of Encord, a data management platform in San Francisco that contracts with Objectways to collect human demonstration data. “There’s this huge resurgence in robotics.”

Encord works with robotics companies such as Jeff Bezos-backed Physical Intelligence and Dyna Robotics.

Tesla, Boston Dynamics and Nvidia are among the leaders in the U.S. in the race to develop the next generation of robots. Tesla already uses its Optimus robots — which seem to be often remotely controlled — for different company events. Google has its own AI models for robotics. OpenAI is beefing up its robotics ambitions.

Nvidia projects the humanoid robot market could reach $38 billion over the next decade.

Advertisement

There are also many lesser-known companies trying to provide the hardware, software and data to make a mass-produced, multitasking humanoid robot a reality.

Robots at Nvidia's booth an an expo in Beijing

Robots are displayed at Nvidia’s booth during the China International Supply Chain Expo in Beijing in July.

(Mahesh Kumar A. / Associated Press)

Large language models that power chatbots such as ChatGPT have mastered using language, images, music, coding and other skills by hoovering up everything online. They use the entire internet to figure out how things are connected and mimic how we do things, such as answering questions and creating photo-realistic videos.

Data on how the physical world works — how much force is required to fold a napkin, for example — is harder to get and translate into something AI can use.

Advertisement

As robotics improves and combines with AI that knows how to move in the physical world, it could bring more robots into the workplace and the home. While many fear this could lead to job losses and unemployment, optimists think advanced robots would free up humans from tedious work, lower labor costs and eventually give people more time to relax or focus on more interesting and important work.

Many companies have entered the fray as shovel sellers in the AI gold rush, seeing an opportunity to gather data for what is being called physical AI.

One group of companies is teaching AI how to act in the real world by having humans guide robots remotely.

Ali Ansari, founder of San Francisco-based Micro1, said emerging robotics data collection increasingly focuses on teleoperations. Humans with controllers make the robot do something like picking up a cup or making tea. The AI is fed videos of successful and failed attempts at doing something and learns to do it.

The remote-control training can happen in the same room as the robots or with the controller in a different country. Encord’s Hansen said that there are warehouses planned in Eastern Europe where large teams of operators will sit with joysticks, guiding robots across the world.

Advertisement

There are more of these, what some have dubbed “arm farms,” popping up as demand increases, said Mohammad Musa, founder of Deepen AI, a data annotation firm headquartered in California.

“Today, a mix of real and synthetic data is being used, gathered from human demonstrations, teleoperation sessions and staged environments,” he said. “Much of this work still occurs outside the West, but automation and simulation are reducing that dependency over time.”

Some have criticized teleoperated humanoids for being more sizzle than substance. They can be impressive when others are controlling them, but still far from fully autonomous.

Ansari’s Micro1 also does something called human data capture. It pays people to wear smart glasses that capture everyday actions. It is doing this in Brazil, Argentina, India, and the United States.

San José-based Figure AI, partnered with real estate giant Brookfield to capture footage from inside 100,000 homes. It will collect data about human movement to teach humanoid robots how to move in human spaces. The company said it will spend much of the $1 billion it raised to collect first-person human data.

Advertisement

Meta-backed Scale AI, has collected 100,000 hours of similar training footage for robotics through its prototype laboratory set up in San Francisco.

Still, training bots isn’t always easy.

Twenty-year-old Dev Mandal created a company in Bengaluru, hoping to cash in on the need for physical data to train AI. He offered India’s inexpensive labor to capture movements. After advertising his services, he got requests to help train a robotic arm to cook food as well as a robot to plug and unplug cables in data centers.

But he had to give up the business, as potential clients needed the physical movement data collected in a very specific manner, making it tougher for him to make money, even with India’s inexpensive labor. Clients wanted an exact robot arm, for example, using a certain kind of table with purple lights to be used.

“Everything, down to the color of the table, had to be specified by them,” he said. “And they said that this has to be the exact color.”

Advertisement

Still, there’s lots of work for the towel folders of Karur.

Their boss, Objectways founder Ravi Shankar, says that in recent months, his firm has captured and annotated footage of robotic arms folding cardboard boxes and T-shirts and picking out certain colored objects on a table.

It recently started annotating videos from more advanced humanoid robots, helping train them to sort and fold a mix of towels and clothes, folding them and placing them in different corners of the table. His team had to annotate 15,000 videos of the robots doing the jobs.

“Sometimes the robot’s arms throw the clothes and won’t fold properly. Sometimes it scatters the stack,” but the robots are learning quickly said Kavin, 27, an Objectways employee who goes by one name. “In five or 10 years, they’ll be able to do all the jobs and there will be none left for us.”

Advertisement

Business

The rise and fall of the Sprinkles empire that made cupcakes cool

Published

on

The rise and fall of the Sprinkles empire that made cupcakes cool

After the dot-com bubble burst in the early 2000s, Candace Nelson reevaluated her career. She had just been laid off from a boutique investment banking firm in San Francisco’s tech startup scene, and realized she wanted a change.

From her home, she launched a custom cake service that soon morphed into an idea for a cupcake-focused bakery. Nelson and her husband — whom she met at the Bay Area firm where she had worked — then pooled their savings, moved to Southern California and together opened Sprinkles Cupcakes from a 600-square-foot Beverly Hills storefront.

The store quickly sold out on opening day in 2005, and over the next two decades, the Sprinkles brand exploded across the country, opening dozens of locations of its specialty bakeries as well as mall kiosks and its signature around-the-clock cupcake ATMs in several states.

“It was an unproven concept and a big risk,” Nelson told the Times in 2013, at which point the business had 400 employees at 14 locations and dispensed upward of a thousand cupcakes a day from its Beverly Hills ATM alone.

But now, the iconic cupcake brand is no longer.

Advertisement

Sprinkles abruptly shut down all of its locations on Dec. 31, leaving hundreds of retail employees across Arizona; California; Washington, D.C.; Florida; Nevada; Texas; and Utah in a lurch with little notice, no severance and scrambling to fulfill a surge of orders from customers clamoring to get their last tastes.

Candace Nelson, the founder of Sprinkles cupcakes, in Beverly Hills in 2018.

(Mel Melcon / Los Angeles Times)

Although Nelson long ago exited the company, having sold it to private equity firm KarpReilly LLC in 2012, she shared her disappointment with its fate on social media.

Advertisement

“As many of you know, I started Sprinkles in 2005 with a KitchenAid mixer and a big idea,” Nelson said in the post. “It’s surreal to see this chapter come to a close — and it’s not how I imagined the story would unfold.”

The company, now headquartered in Austin, Texas, made no formal announcement regarding the closures and Nelson has not said more than what she posted online. The company did share a comment with KTLA, saying “After thoughtful consideration, we’ve made the very difficult decision to transition away from operating company-owned Sprinkles bakeries.” Neither Nelson nor representatives of Sprinkles and KarpReilly responded to The Times’ requests for comment.

Sprinkles’ demise comes at a tough time for the food and beverage industry. At brick-and-mortar food retail locations, the non-negotiable ingredient and labor costs can be high. And shifting consumer sentiments away from sugar-filled sweets and toward more healthy and functional options, strained pocketbooks, as well as pushes by federal and state governments to nix artificial colors and flavoring, are creating uncertainties for businesses, those in the food industry said.

A 24-hour cupcake ATM at Sprinkles Cupcakes in Beverly Hills in 2012.

A 24-hour cupcake ATM at Sprinkles Cupcakes in Beverly Hills in 2012.

(Damian Dovarganes / Associated Press)

Advertisement

“Over the last 10 years the consumer has wizened up tremendously and is looking at the back of the label and choosing where to spend their sweets,” said David Jacobowitz, founder of Austin-based Nebula Snacks, an online food retailer.

At the same time, it’s also not uncommon for businesses owned by private-equity firms to close on a whim, where relentlessly profit-driven decisions might be made simply to pursue more lucrative projects. In recent years, private-equity deals have been seen to milk businesses for profit by slashing costs and quality, and have appeared to play a role in the breakup of some legacy retail brands, including Toys ‘R’ Us, Red Lobster, TGI Fridays and fabrics chain JoAnn Inc. On the flip side, private equity can help infuse much-needed cash into a business and extend its life.

Stevie León and her co-workers received a text the night before New Year’s Eve informing them the franchise Sprinkles location in Sarasota, Fla., where they worked would close permanently after their shifts the next day.

León, 33, said her position as a scratch baker mixing batter and frosting cupcakes overnight had been a dream job, since she had been searching for ways to develop baking skills without paying for expensive schooling.

“I really thought it was my forever job and it was taken away literally in a day,” she said. “I’m just taking it one day at a time.”

Advertisement

Ivy Hernandez, 27, the general manager at the Sarasota store, said that after the news was delivered to her boss, the franchise owner, they rushed to learn their options to keep the store afloat but quickly learned it could be legally precarious to continue operating. The store had been open less than a year.

A nearby corporate store, Hernandez said, had been in disarray for months, with employees contending with broken fridges and lapsed ingredient shipments, as managers implored higher-ups to pay the bills so the business could operate properly.

“It really felt like they were trying to do everything they could to screw everyone over as hard as possible until the end,” Hernandez said.

Sprinkles did not respond to questions about the franchise program or allegations of mismanagement in the lead-up to the closure.

A person walks by Sprinkles on the Upper East Side in New York City in 2020.

A person walks by Sprinkles on the Upper East Side in New York City in 2020.

(Cindy Ord / Getty Images)

Advertisement

The obsession with tiny cakes in paper cups traces back to an episode of “Sex and the City” aired in 2000 showing Miranda and Carrie savoring cupcakes on a bench outside a West Village bakery called Magnolia’s Cupcakes.

“Big wasn’t a crush, he was a crash,” Carrie says to Miranda as she peels down the wrapper on a cupcake topped with bright pink buttercream frosting. She punctuates the quip by taking a big bite, leaving a glob of frosting on her face.

The scene sparked a tourism phenomenon for the bakery — which went on to create a “Carrie” line of cupcakes — and helped propel the burgeoning cupcake industry and companies like Sprinkles Cupcakes, Crumbs Bake Shop and Baked by Melissa to new heights.

Within a decade there was already talk of a “Cupcake Bubble,” coined by writer Daniel Gross in a 2009 Slate article where he argued that the 2008 economic recession laid the groundwork for a proliferation of cupcake stores across America, because a lot of people could figure out how to make tasty cupcakes cheaply and scale up without a huge capital investment.

Advertisement

Amid the decimation of many other local retail businesses, one could take over storefronts in heavily trafficked areas for cheap. As a result, “casual baking turned into an urban industry,” Gross said.

The cupcake fervor hit its peak when Crumbs, which had started as a single bakery on Manhattan’s Upper West Side in 2003, went public in a reverse merger worth $66 million in 2011. The wildly popular mini-cakes were selling at $4.50 a pop. But it became clear very quickly that it had grown too large, too fast. It closed in 2014 after it lost its stock listing on Nasdaq and defaulted on about $14.3 million in financing.

Analysts at the time said consumers were cooling on opulent desserts and suggested tougher times were ahead for bakeries that focused solely on cupcakes.

But Baked by Melissa has thus far proved those analysts wrong. The company has remained privately owned, and according to its founder, is focused on nationwide e-commerce operations — and on expanding the brand beyond sweets. Founder Melissa Ben-Ishay has gained a following on social media by sharing recipes for nutritious, easy-to-make meals.

“Businesses that prioritize quick value increases to get acquired often crash,” Ben-Ishay told Forbes last year. “We’re committed to maintaining product quality and steady, long-term growth.”

Advertisement

Before its unceremonious and sudden closure, Spinkles company leadership had pushed to diversify its business as part of a strategy to recover from a pandemic-era lull.

Chief Executive Dan Mesches told trade publication Nation’s Restaurant News in 2021 that comparable sales had grown since pre-pandemic years. He said the company had ramped up its direct-to-consumer and off-premises offerings and created a line of chocolates made to look like the tops of their cupcakes. The company also introduced a new franchise program with the goal of opening some 200 locations in the U.S. and abroad over three years.

“Innovation is everything for us,” Mesches said.

Sprinkles was known for, among other things, inventive and somewhat corny methods of customer delivery. Besides the trademark ATMs, the company’s vending machines found at many airports made loud, attention-drawing jingles, drawing dramatic complaints and jokes from TikTok travelers. In the 2010s, the company debuted a custom-built truck — “the Sprinklesmobile” — to deliver cupcakes to cities without physical locations.

Frances Hughes, co-founder of online wholesale marketplace Starch, said there’s no question that gourmet sweet treats are still in vogue. But brick-and-mortar locations are much more risky, with more unpredictability. Having large fixed costs makes a business “extremely sensitive to small changes in traffic or frequency,” while online or e-commerce models can be more flexible.

Advertisement

“I think cupcakes as a product still have demand. But the novelty paths that support that rapid retail expansion have passed,” Hughes said.

When Nelson, the Sprinkles founder, posted her somber message about the closure, she asked people to share memories of the company. Many offered heartfelt responses, her comments flooded with stories, for example, of poor college students making the trek to the Beverly Hills location for a limited number of first-come, first-served free cupcakes.

But many of the comments also criticized Nelson’s sale to private equity.

“You sold it to PE and expected it to not close?? What planet are you living on? I don’t begrudge you for selling as that’s entirely your choice but to think any PE firm cares about a company in the slightest is insanity,” one Instagram user said.

Nicole Rucker, an L.A.-based pastry chef and owner of Fat+Flour Pie Shop, said she didn’t observe a decline in the quality of the product after the private-equity takeover. She has been a longtime admirer of the company, driving up from San Diego to sample the cupcakes when its store opened. The simple attractiveness of the box and the logo, and the consistency in the way cupcakes were decorated, “was inspiring,” she said.

Advertisement

“It had a strong hold on people for years,” Rucker said.

Rucker said however that when a private-equity-owned business shutters, she doesn’t feel sadness: “I would rather give my money to a fellow small-business owner, because I would rather know that every dollar and every sale matters.”

Michelle Wainwright, the owner and founder of Indiana-based bakery Cute as a Cupcake! said that although the niche cupcake industry may no longer be in its heyday — with “Sex and the City” no longer airing and competitive baking show “Cupcake Wars” (which Candace Nelson served as a judge on) now canceled — they are still versatile treats, with great potential for creativity.

And they are sentimental to her, because she uses her grandmother’s recipe.

“Cupcakes are still a winner,” Wainwright said. “It’s my belief that a life with out cupcakes is a life without love.”

Advertisement

Continue Reading

Business

Bay Area semiconductor testing company to lay off more than 200 workers

Published

on

Bay Area semiconductor testing company to lay off more than 200 workers

Semiconductor testing equipment company FormFactor is laying off more than 200 workers and closing manufacturing facilities as it seeks to cut costs after being hit by higher import taxes.

The Livermore, Calif.,-based company plans to shutter its Baldwin Park facility and cut 113 jobs there on Jan. 30, according to a layoff notice sent to the California Employment Development Department this week. Its facility in Carlsbad is scheduled to close in mid-December later this year, which will result in 107 job losses, according to an earlier notice.

Technicians, engineers, managers, assemblers and other workers are among those expected to lose their jobs, according to the notices.

The company offers semiconductor testing equipment, including probe cards, and other products. The industry has been benefiting from increased AI chip adoption and infrastructure spending.

Advertisement

FormFactor is among the employers that have been shedding workers amid more economic uncertainty.

Companies have cited various reasons for workforce reductions, including restructuring, closures, tariffs, market conditions and artificial intelligence, which can help automate repetitive tasks or generate text, images and code.

The tech industry — a key part of California’s economy — has been hit hard by job losses after the pandemic, which spurred more hiring, and amid the rise of AI tools that are reshaping its workforce.

As tech companies and startups compete fiercely to dominate the AI race, they’ve also cut middle management and other workers as they move faster to release more AI-powered products. They’re also investing billions of dollars into data centers that house computing equipment used to process the massive troves of information needed to train and maintain AI systems.

Companies such as chipmaker Nvidia and ChatGPT maker OpenAI have benefited from the AI boom, while legacy tech companies such as Intel are fighting to keep up.

Advertisement

FormFactor’s cuts are part of restructuring plans that “are intended to better align cost structure and support gross margin improvement to the Company’s target financial model,” the company said in a filing to the U.S. Securities and Exchange Commission this week.

The company plans to consolidate its facilities in Baldwin Park and Carlsbad, the filing said.

FormFactor didn’t respond to a request for comment.

FormFactor has been impacted by tariffs and seen its growth slow. The company employs more than 2,000 people and has been aiming to improve its profit margins.

In October, the company reported $202.7 million in third-quarter revenue, down 2.5% from the third quarter of fiscal 2024. The company’s net income was $15.7 million in the third quarter of 2025, down from $18.7 million in the same quarter of the previous year.

Advertisement

FormFactor’s stock has been up 16% since January, surpassing more than $67 per share on Friday.

Continue Reading

Business

In-N-Out Burger outlets in Southern California hit by counterfeit bill scam

Published

on

In-N-Out Burger outlets in Southern California hit by counterfeit bill scam

Two people allegedly used $100 counterfeit bills at dozens of In-N-Out Burger restaurants in Southern California in a wide-reaching scam.

Glendale Police officials said in a statement Friday that 26-year-old Tatiyanna Foster of Long Beach was taken into custody last month. Another suspect, 24-year-old Auriona Lewis, also of Long Beach, was arrested in October.

Police released images of $100 bills used to purchase a $2.53 order of fries and a $5.93 order of a Flying Dutchman.

The Los Angeles County District Attorney’s Office charged Lewis with felony counterfeiting and grand theft in November.

Advertisement

Elizabeth Megan Lashley-Haynes, Lewis’s public defender, didn’t immediately respond to a request for comment.

Glendale police said that Lewis was arrested in Palmdale in an operation involving the U.S. Marshals Task Force. Foster is expected in court later this month, officials said.

”Lewis was found to be in possession of counterfeit bills matching those used in the Glendale incident, along with numerous gift cards and transaction receipts believed to be connected to similar fraudulent activity,” according to a police statement.

A representative for In-N-Out Burger told KTLA-TV that restaurants in Riverside, San Bernardino and San Diego counties were also targeted by the alleged scam.

“Their dedication and expertise resulted in the identification and apprehension of the suspects, helping to protect our business and our communities,” In-N-Out’s Chief Operations Officer Denny Warnick said. “We greatly value the support of law enforcement and appreciate the vital role they play in making our communities stronger and safer places to live.”

Advertisement

The company, opened in 1948 in Baldwin Park, has restaurants in nine states.

An Oakland location closed in 2024, with the owner blaming crime and slow police response times.

Company chief executive Lynsi Snyder announced last year that she planned to relocate her family to Tennessee, although the burger chain’s headquarters will remain in California.

Advertisement
Continue Reading
Advertisement

Trending