Connect with us

News

Nvidia faces looming test on use of chips

Published

on

Nvidia faces looming test on use of chips

Unlock the Editor’s Digest for free

Rivals of Nvidia, which dominates the market for AI chips, have long hoped that an inflection point would help them make up lost ground.

That point may be at hand. So far, however, there is little sign of Nvidia ceding its lead — though it is still an open question as to whether the AI market will develop in ways that eventually erode its dominance.

The key issue is when the main focus in AI moves from training the large “foundation” models that underpin modern AI systems, to putting those models into widespread use in the applications used by large numbers of consumers and businesses.

Advertisement

With their ability to handle multiple computations in parallel, Nvidia’s powerful graphical processing units, or GPUs, have maintained their dominance of data-intensive AI training. By contrast, running queries against these AI models — known as inference — is a less demanding activity that could provide an opening for makers of less powerful — and cheaper — chips.

Anyone expecting a quick shift will have been disappointed. Nvidia’s lead in this newer market already looks formidable. Announcing its latest earnings on Thursday, it said more than 40 per cent of its data centre sales over the past 12 months were already tied to inference, accounting for more than $33bn in revenue. That is more than two and a half times the entire sales of Intel’s data centre division over the same period.

But how the inference market will develop from here is uncertain. Two questions will determine the outcome: whether the AI business continues to be dominated by a race to build ever larger AI models, and where most of the inference will take place.

Nvidia’s fortunes have been heavily tied to the race for scale. Chief executive Jensen Huang said this week that it takes “10, 20, 40 times the compute” to train each new generation of large AI models, guaranteeing huge demand for Nvidia’s forthcoming Blackwell chips. These new processors will also provide the most efficient way run inferences against these “multitrillion parameter models”, he added.

Yet it is not clear whether ever-larger models will continue to dominate the market, or whether these will eventually hit a point of diminishing returns. At the same time, smaller models that promise many of the same benefits, as well as less capable models designed for narrower tasks, are already coming into vogue. Meta, for instance, recently claimed that its new Llama 3.1 could match the performance of the advanced models such as OpenAI’s GPT-4, despite being far smaller.

Advertisement

Improved training techniques, often relying on larger amounts of high-quality data, have helped. Once trained, the biggest models can also be “distilled” in smaller versions. Such developments promise to bring more of the work of AI inference to smaller, or “edge”, data centres, and on to smartphones and PCs. “AI workloads will go closer to where the data is, or where the users are,” says Arun Chandrasekaran, an analyst at Gartner.

The range of competitors with an eye on this nascent market has been growing rapidly. Mobile chip company Qualcomm, for instance, has been the first to produce chips capable of powering a new class of AI-capable PCs, matching a design laid out by Microsoft — a development that throws down a direct challenge to longtime PC chip leader Intel.

The data centre market, meanwhile, has attracted a wide array of would-be competitors, from start-ups like Cerebras and Groq to tech giants like Meta and Amazon, which have developed their own inference chips.

It is inevitable that Nvidia will lose market share as AI inference moves to devices where it does not yet have a presence, and to the data centres of cloud companies that favour in-house chip designs. But to defend its turf, it is leaning heavily on the software strategy that has long acted as a moat around its hardware, with tools that make it easier for developers to put its chips to use.

This time, it is working on a wider range of enterprise software to help companies build applications that make best use of AI — something that would also guarantee demand for its chips. Nvidia disclosed this week that it expects its revenue from this software to reach an annual run-rate of $2bn by the end of this year. The figure is small for a company expected to produce total revenue of more than $100bn, but points to the increasing take-up of technologies that should increase the “stickiness” of products. The AI chip market may be entering a new phase, but Nvidia’s grip shows no signs of being loosened.

Advertisement

richard.waters@ft.com

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

News

Under Trump, Green Card Seekers Face New Scrutiny for Views on Israel

Published

on

Under Trump, Green Card Seekers Face New Scrutiny for Views on Israel

For decades, immigrants who have followed the rules and have not broken the law have had hopes of earning a green card, a document that allows them to live legally in the United States and gain a path to citizenship.

But under new guidance issued by the Trump administration, immigrants can now be denied a green card for expressing political opinions, such as participating in pro-Palestinian campus protests, posting criticism of Israel on social media and desecrating the American flag, according to internal Department of Homeland Security training materials reviewed by The New York Times.

The documents, which have not been previously reported, show how expansively the Trump administration is carrying out a directive from last August to vet green card applicants for “anti-American” and “antisemitic” views.

The administration includes criticism of Israel as a potentially disqualifying factor, with the training materials citing as an example of questionable speech a social media post that declares, “Stop Israeli Terror in Palestine” and shows the Israeli flag crossed out.

The materials were distributed last month to immigration officers at U.S. Citizenship and Immigration Services, which is part of the Department of Homeland Security and handles applications for green cards and other forms of legal status.

Advertisement

They reflect how U.S.C.I.S. — long considered the gateway agency for legal migration — has rapidly transformed under President Trump into another cog in his administration’s deportation machine. The agency has worked to strip naturalized Americans of their citizenship and has hired armed federal agents to investigate immigration crimes.

The administration is also granting permanent legal residency to far fewer applicants. Green card approvals have fallen by more than half in recent months, according to a Times analysis of agency data.

“There is no room in America for aliens who espouse anti-American ideologies or support terrorist organizations,” Joseph Edlow, the agency’s director, told Congress in February.

Critics of Mr. Trump’s approach say the administration is seeking to restrict legitimate political speech, and has conflated opposition to Israeli government policies with antisemitism.

Basing green card decisions on “ideological screenings is fundamentally un-American and should have no place in a country built on the promise of free expression,” said Amanda Baran, a senior agency official under President Joseph R. Biden Jr.

Advertisement

Administration officials said they were defending American values.

“If you hate America, you have no business demanding to live in America,” said Zach Kahler, a spokesman for U.S.C.I.S.

Abigail Jackson, a White House spokeswoman, said the administration’s policies had “nothing to do with free speech” and were meant to protect “American institutions, the safety of citizens, national security and the freedoms of the United States.”

The administration has moved aggressively against immigrants for expressing political views that officials have deemed anti-American, making ideology a central part of its immigration vetting process. Secretary of State Marco Rubio has revoked the visas of pro-Palestinian student activists, including one who wrote a column criticizing her university’s response to pro-Palestinian demands.

The Department of Homeland Security has proposed reviewing the social media histories of tourists seeking to visit the United States.

Advertisement

Immigration officers have significant discretion in deciding whether to grant foreigners long-term permanent residence. They have long considered a variety of factors, including criminal records, national security threats, family ties to the United States and employment histories.

Ideology has also traditionally been one of those factors. In some cases, U.S. law forbids officers from granting green cards to people who have belonged to a Communist or other “totalitarian” political party, have promoted anarchy or have called for the overthrow of the U.S. government by “force or violence or other unconstitutional means.”

But in the past, immigration officers have focused on statements that could incite or encourage violence, given concerns about infringing on constitutionally protected speech, former U.S.C.I.S. officials said.

The new training materials reviewed by The Times guide immigration officers through the factors they should consider when ruling on green card applications. They discourage officers from granting green cards to people with a history of “endorsing, promoting or supporting anti-American views” or “antisemitic terrorism, ideologies or groups.”

Immigration officers have been told to weigh those factors as “overwhelmingly negative.”

Advertisement

The documents list support for “subversive” ideologies as among other factors that could lead to an application being rejected. As an example, the materials point to someone “holding a sign advocating overthrow of the U.S. government.”

In addition, the guidance describes the desecration of the American flag as a negative factor, citing Mr. Trump’s executive order last year directing the Justice Department to prosecute protesters who burn the flag. The Supreme Court has ruled that flag burning is a form of political expression protected by the First Amendment.

Immigration officers have also been told to scrutinize applicants who encourage antisemitism “through rhetorical or physical actions.” They were instructed to “focus particularly on aliens who engaged in on-campus anti-American and antisemitic activities” after the Hamas attacks against Israel in 2023, the documents show.

Further examples in the documents of conduct characterized as antisemitic include a social media post showing a map of Israel with the nation’s name crossed out and replaced with the word “Palestine.” Another illustrative post suggests that Israelis should “taste what people in Gaza are tasting.”

Immigration officers must elevate all cases involving “potential anti-American and/or antisemitic conduct or ideology” to their managers and to the agency’s general counsel’s office for review, according to the documents.

Advertisement

In recent months, the agency has also changed the way it refers to the employees who adjudicate green card applications, long known as “immigration services officers.” In job postings, it now calls them “homeland defenders.”

“Protect your homeland and defend your culture,” one posting says.

Steven Rich contributed reporting.

Continue Reading

News

America’s bid for energy supremacy is being forged in war

Published

on

America’s bid for energy supremacy is being forged in war

Additional work by Jana Tauschinski

Oil and gas tanker location and destination data are from Kpler. The map shows the latest position for vessels with an active AIS signal on April 19–20, filtered by minimum capacity thresholds: crude tankers of at least 50,000 deadweight tonnage (DWT); oil product tankers of at least 55,000 DWT; oil/chemical tankers of at least 40,000 DWT; LNG carriers of at least 150,000 cubic metres; and LPG carriers of at least 50,000 cubic metres. Net fossil fuel import data by country are based on Ember analysis of the IEA World Energy Balances 2023.

Continue Reading

News

Roommate faces murder charges in deaths of 2 University of South Florida doctoral students

Published

on

Roommate faces murder charges in deaths of 2 University of South Florida doctoral students

A 26-year-old man is facing two counts of first-degree murder in the deaths of two University of South Florida doctoral students who went missing last week, local authorities said Saturday. 

The Hillsborough County Sheriff’s Office in Florida said that evidence presented to the state attorney’s office resulted in the charges against Hisham Abugharbieh, the roommate of Zamil Limon, one of the doctoral students. 

Abugharbieh is accused of premediated murder with a weapon. He was arrested on Friday, the same day Limon was found dead. 

The family of Nahida Bristy, the other doctoral student, told CBS News that police said she is also likely dead. That is based on the volume of blood discovered at Abugharbieh’s residence, which he shared with Limon.

“Police told us she is no longer with us,” Bristy’s brother, Zahid Prato, said early Saturday.

Advertisement

The family was told her body may never be found and police believe she may have been dismembered, according to Prato. 

CBS News has reached out to police for more information.

Authorities said in a statement Saturday they were still searching for Bristy.

Limon’s remains were found on the Howard Franklin Bridge in Tampa Friday morning, Chief Deputy Joseph Maurer with the Hillsborough County Sheriff’s Office said. His cause of death was pending autopsy results.

Deputies with the sheriff’s office took Abugharbieh into custody on Friday after responding to a domestic violence call at a home in the Lake Forest Community, a neighborhood near USF’s Tampa campus, officials said. He also faces charges of domestic violence and evidence tampering, as well as a charge of failing to report a death to law enforcement.

Advertisement

Limon and Bristy, both 27, had last been seen in the Tampa area on April 16. 

Limon was studying the use of AI in environmental science and was set to present his doctoral thesis this week, his family said. Bristy is studying chemical engineering. 

Advertisement
Continue Reading
Advertisement

Trending