
Experts say Alibaba’s AI Chip could also address the shortcomings of Huawei’s 910B and 910C AI chips, as the new chip is expected to be compatible with Nvidia’s CUDA and PyTorch ecosystems.
“Nvidia’s dominance isn’t just in its hardware; it is in its robust software ecosystem, particularly CUDA. A seamless compatibility layer would allow developers to easily port their existing code, bypassing the steep learning curve associated with new, fragmented hyperscalar software stacks from domestic rivals like Huawei’s MindSpore or Baidu’s PaddlePaddle. The software development and optimization on custom chips are the major bottleneck,” said Neil Shah, vice president at Counterpoint Research.
Geopolitical pressures, domestic strategy
Alibaba has been using Nvidia’s AI chips for a long time, but increasing US export restrictions over the last few years have prompted Alibaba to accelerate its domestic semiconductor strategy.
In October 2022, the US imposed restrictions on advanced semiconductors exported to China. To this, Nvidia and AMD responded by scaling down the GPU versions, tailored to stay within export compliance. But later, even these chips faced licensing barriers.
In April this year, under President Donald Trump’s administration, Nvidia was informed about securing an export license to sell its H20 processor in China. Barely three months later, the US administration announced the resumption of the sales of H20 AI chips to China as part of a rare earth critical minerals deal. Later, China’s Cyberspace Administration (CAC) summoned Nvidia representatives regarding serious security issues related to potential tracking and remote shutdown capabilities embedded in the H20 chips.
“In 2023, Alibaba Chairman Joe Tsai, after blaming uncertainties created by US export restrictions on advanced computing chips for halting Alibaba’s cloud unit’s spinoff, made a bold vision about how it will handle the setback. He focused on developing a sustainable growth model based on emerging AI-driven demand for networked and highly scaled cloud computing services,” Faruqui said. The new AI chip by Alibaba, he said, is the outcome of this sustainable growth model to counter US sanctions.