Connect with us

News

Chip challengers try to break Nvidia’s grip on AI market

Published

on

Chip challengers try to break Nvidia’s grip on AI market

Stay informed with free updates

Nvidia’s rivals are mobilising in an effort to break the company’s stranglehold on the AI chip market, raising hundreds of millions of dollars and rolling out new products as they look to share the spoils of a boom in artificial intelligence technology.

Cerebras, d-Matrix and Groq are among a group of smaller companies aiming to take a slice of the multibillion-dollar AI chip market from Nvidia, which has so far dominated the first wave of investment with its graphics processing units, or GPUs.

They are riding a wave of expectation that demand for artificial intelligence “inference” — the compute power needed for models such as OpenAI’s ChatGPT and Google’s Gemini to generate responses to queries — will grow exponentially as chatbots and other generative AI applications become more popular.

Advertisement

Nvidia’s Hopper GPUs, which are well suited to the highly resource-intensive task of training top AI models, have become one of the world’s hottest commodities.

Cerebras, d-Matrix and Groq are focusing instead on cheaper, more specialised chips designed for running AI models.

On Tuesday Cerebras announced its new “Cerebras Inference” platform, based on its CS-3 chip, which is the size of a dinner plate. Cerebras claims its solution is 20 times faster than Nvidia’s current generation of Hopper chips at AI inference, at a fraction of the price. Cerebras cites tests run by benchmarking analysis provider Artificial Analysis.

“The way you beat the 800lb gorilla is by bringing a vastly better product to market,” Cerebras chief executive Andrew Feldman told the Financial Times. “In my experience, better products usually win, and we’ve taken meaningful customers from [Nvidia].”

The CS-3 chip shuns the use of a separate high-bandwidth memory chip, which is used by Nvidia. Instead it offers an alternative architecture with memory built directly into the chip wafer.

Advertisement

Limitations on memory bandwidth, Feldman said, are a fundamental constraint on the inference speed of an AI chip. The combination of logic and memory into a single large chip delivers results that are “orders of magnitude faster”, he said.

d-Matrix, founded by Sid Sheth in 2019, is also kicking off a new funding round less than a year after it raised $110mn in a series B funding round led by Singapore’s state-owned fund Temasek. The company is aiming to raise $200mn or more later this year or early next, according to Sheth. d-Matrix is early in the fundraising process and said the ultimate figure raised could change.

d-Matrix is planning a full-scale launch of its own chip platform, Corsair, at the end of this year. Sheth said the company was pairing its products with open software such as Triton, which competes with Nvidia’s Cuda, a widely used software platform that offers the tools for developers to build AI applications and optimises the performance of its chips.

Nvidia’s biggest customers are backing the use of open software such as Triton. “App developers don’t like to be held to one particular tool,” Sheth said, and “people are getting wise that Nvidia has a stranglehold with Cuda on the training side”.

Groq, another AI inference competitor led by a former founding member of Google’s tensor processing unit team, raised $640mn this month from investors led by BlackRock Private Equity Partners, at a valuation of $2.8bn.

Advertisement

One venture capitalist cautioned that despite the hype around the sector, semiconductor start-ups had had a challenging time breaking into the market.

Chipmaker Graphcore was bought by SoftBank last month for just above $600mn, less than the roughly $700mn that the company had raised in venture capital since it was founded in 2016, according to people familiar with the deal.

Groq and Cerebras were also founded in 2016. “There has been a near insatiable desire from public investors to find and back the next Nvidia,” said Peter Hébert, co-founder and managing partner at venture firm Lux Capital. “This isn’t just about chasing the latest trend. The momentum is also benefiting several VC-funded chip start-ups that have been toiling away for nearly a decade.”

Video: AI: a blessing or curse for humanity? | FT Tech

News

Under Trump, Green Card Seekers Face New Scrutiny for Views on Israel

Published

on

Under Trump, Green Card Seekers Face New Scrutiny for Views on Israel

For decades, immigrants who have followed the rules and have not broken the law have had hopes of earning a green card, a document that allows them to live legally in the United States and gain a path to citizenship.

But under new guidance issued by the Trump administration, immigrants can now be denied a green card for expressing political opinions, such as participating in pro-Palestinian campus protests, posting criticism of Israel on social media and desecrating the American flag, according to internal Department of Homeland Security training materials reviewed by The New York Times.

The documents, which have not been previously reported, show how expansively the Trump administration is carrying out a directive from last August to vet green card applicants for “anti-American” and “antisemitic” views.

The administration includes criticism of Israel as a potentially disqualifying factor, with the training materials citing as an example of questionable speech a social media post that declares, “Stop Israeli Terror in Palestine” and shows the Israeli flag crossed out.

The materials were distributed last month to immigration officers at U.S. Citizenship and Immigration Services, which is part of the Department of Homeland Security and handles applications for green cards and other forms of legal status.

Advertisement

They reflect how U.S.C.I.S. — long considered the gateway agency for legal migration — has rapidly transformed under President Trump into another cog in his administration’s deportation machine. The agency has worked to strip naturalized Americans of their citizenship and has hired armed federal agents to investigate immigration crimes.

The administration is also granting permanent legal residency to far fewer applicants. Green card approvals have fallen by more than half in recent months, according to a Times analysis of agency data.

“There is no room in America for aliens who espouse anti-American ideologies or support terrorist organizations,” Joseph Edlow, the agency’s director, told Congress in February.

Critics of Mr. Trump’s approach say the administration is seeking to restrict legitimate political speech, and has conflated opposition to Israeli government policies with antisemitism.

Basing green card decisions on “ideological screenings is fundamentally un-American and should have no place in a country built on the promise of free expression,” said Amanda Baran, a senior agency official under President Joseph R. Biden Jr.

Advertisement

Administration officials said they were defending American values.

“If you hate America, you have no business demanding to live in America,” said Zach Kahler, a spokesman for U.S.C.I.S.

Abigail Jackson, a White House spokeswoman, said the administration’s policies had “nothing to do with free speech” and were meant to protect “American institutions, the safety of citizens, national security and the freedoms of the United States.”

The administration has moved aggressively against immigrants for expressing political views that officials have deemed anti-American, making ideology a central part of its immigration vetting process. Secretary of State Marco Rubio has revoked the visas of pro-Palestinian student activists, including one who wrote a column criticizing her university’s response to pro-Palestinian demands.

The Department of Homeland Security has proposed reviewing the social media histories of tourists seeking to visit the United States.

Advertisement

Immigration officers have significant discretion in deciding whether to grant foreigners long-term permanent residence. They have long considered a variety of factors, including criminal records, national security threats, family ties to the United States and employment histories.

Ideology has also traditionally been one of those factors. In some cases, U.S. law forbids officers from granting green cards to people who have belonged to a Communist or other “totalitarian” political party, have promoted anarchy or have called for the overthrow of the U.S. government by “force or violence or other unconstitutional means.”

But in the past, immigration officers have focused on statements that could incite or encourage violence, given concerns about infringing on constitutionally protected speech, former U.S.C.I.S. officials said.

The new training materials reviewed by The Times guide immigration officers through the factors they should consider when ruling on green card applications. They discourage officers from granting green cards to people with a history of “endorsing, promoting or supporting anti-American views” or “antisemitic terrorism, ideologies or groups.”

Immigration officers have been told to weigh those factors as “overwhelmingly negative.”

Advertisement

The documents list support for “subversive” ideologies as among other factors that could lead to an application being rejected. As an example, the materials point to someone “holding a sign advocating overthrow of the U.S. government.”

In addition, the guidance describes the desecration of the American flag as a negative factor, citing Mr. Trump’s executive order last year directing the Justice Department to prosecute protesters who burn the flag. The Supreme Court has ruled that flag burning is a form of political expression protected by the First Amendment.

Immigration officers have also been told to scrutinize applicants who encourage antisemitism “through rhetorical or physical actions.” They were instructed to “focus particularly on aliens who engaged in on-campus anti-American and antisemitic activities” after the Hamas attacks against Israel in 2023, the documents show.

Further examples in the documents of conduct characterized as antisemitic include a social media post showing a map of Israel with the nation’s name crossed out and replaced with the word “Palestine.” Another illustrative post suggests that Israelis should “taste what people in Gaza are tasting.”

Immigration officers must elevate all cases involving “potential anti-American and/or antisemitic conduct or ideology” to their managers and to the agency’s general counsel’s office for review, according to the documents.

Advertisement

In recent months, the agency has also changed the way it refers to the employees who adjudicate green card applications, long known as “immigration services officers.” In job postings, it now calls them “homeland defenders.”

“Protect your homeland and defend your culture,” one posting says.

Steven Rich contributed reporting.

Continue Reading

News

America’s bid for energy supremacy is being forged in war

Published

on

America’s bid for energy supremacy is being forged in war

Additional work by Jana Tauschinski

Oil and gas tanker location and destination data are from Kpler. The map shows the latest position for vessels with an active AIS signal on April 19–20, filtered by minimum capacity thresholds: crude tankers of at least 50,000 deadweight tonnage (DWT); oil product tankers of at least 55,000 DWT; oil/chemical tankers of at least 40,000 DWT; LNG carriers of at least 150,000 cubic metres; and LPG carriers of at least 50,000 cubic metres. Net fossil fuel import data by country are based on Ember analysis of the IEA World Energy Balances 2023.

Continue Reading

News

Roommate faces murder charges in deaths of 2 University of South Florida doctoral students

Published

on

Roommate faces murder charges in deaths of 2 University of South Florida doctoral students

A 26-year-old man is facing two counts of first-degree murder in the deaths of two University of South Florida doctoral students who went missing last week, local authorities said Saturday. 

The Hillsborough County Sheriff’s Office in Florida said that evidence presented to the state attorney’s office resulted in the charges against Hisham Abugharbieh, the roommate of Zamil Limon, one of the doctoral students. 

Abugharbieh is accused of premediated murder with a weapon. He was arrested on Friday, the same day Limon was found dead. 

The family of Nahida Bristy, the other doctoral student, told CBS News that police said she is also likely dead. That is based on the volume of blood discovered at Abugharbieh’s residence, which he shared with Limon.

“Police told us she is no longer with us,” Bristy’s brother, Zahid Prato, said early Saturday.

Advertisement

The family was told her body may never be found and police believe she may have been dismembered, according to Prato. 

CBS News has reached out to police for more information.

Authorities said in a statement Saturday they were still searching for Bristy.

Limon’s remains were found on the Howard Franklin Bridge in Tampa Friday morning, Chief Deputy Joseph Maurer with the Hillsborough County Sheriff’s Office said. His cause of death was pending autopsy results.

Deputies with the sheriff’s office took Abugharbieh into custody on Friday after responding to a domestic violence call at a home in the Lake Forest Community, a neighborhood near USF’s Tampa campus, officials said. He also faces charges of domestic violence and evidence tampering, as well as a charge of failing to report a death to law enforcement.

Advertisement

Limon and Bristy, both 27, had last been seen in the Tampa area on April 16. 

Limon was studying the use of AI in environmental science and was set to present his doctoral thesis this week, his family said. Bristy is studying chemical engineering. 

Advertisement
Continue Reading
Advertisement

Trending