Nvidia built itself into a $2 trillion company by supplying the chips essential for the incredibly complicated work of training artificial intelligence models. As the industry rapidly evolves, the bigger opportunity will be selling chips that make those models run after they are trained, churning out text and images for the fast-growing population of companies and people actually using generative AI tools.
Right now, that shift is adding to Nvidia's blockbuster sales. Chief Financial Officer Colette Kress said this past week that more than 40% of Nvidia's data center business in the past year - when revenue exceeded $47 billion - was for deployment of AI systems and not training. That percentage was the first significant indication that the shift is underway.
Kress's comments allayed some concerns that the shift toward chips for deploying AI systems those that do what is called "inference" work threatens Nvidia's position because that work can be done with less powerful and less-expensive chips than those that have made Nvidia the leader of the AI boom.
"There is a perception that Nvidia's share will be lower in inferencing vs. training," Ben Reitzes, an analyst at Melius Research, said in a note to clients. "This revelation helps shed light on its ability to benefit from the coming inferencing explosion."
Many rivals believe they have a better shot in the AI market as chips for inferencing become more important.
Intel, which makes central processing units that go into data centers, believes its chips will be increasingly appealing as customers focus on driving down the cost of operating AI models. The kinds of chips Intel specializes in are already widely used in inferencing, and it isn't as critical to have Nvidia's cutting-edge and more expensive H100 AI chips when doing that task.
This story is from the February 27, 2024 edition of Mint Mumbai.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the February 27, 2024 edition of Mint Mumbai.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber? Sign In
Think Tesla Is In Trouble? Pity Even More Its Wannabe EV Rivals
The combined market value of six prominent wannabes hit 400bn in 2021, but today they are worth 65bn
Has The Growth Of Our Economy Translated Into Domestic Jobs?
While the covid shock and other setbacks got in the way, data indicates that employment in India is on a firm recovery path
Financial Sector Reforms Plan To Be Unveiled Post Elections
The govt will cut its stake in five PSBs this fiscal to comply with Sebi’s listing guidelines
Generative AI Is Not Ubiquitous In The Business World-Not Yet
While some AI tools racked up users, some firms are proceeding with caution, or not at all
Wipro’s CEO switch was not about its share price
Shareholder value data does not explain the firm's change on top. In a flux-filled field like infotech, business performance counts for more and Wipro's challenge still seems quite steep
How not to blow a major chunk of your travel budget on visas
Rejection of visas can impact your travel costs, especially when you have to cancel flight and hotel bookings
Wheat output at 106 mt to fall short of govt estimate: Survey
This decline in output comes at a time India confronts rising food inflation
Ghosh won't stay on Bandhan Bank board
Board may even look at appointing an interim CEO post his tenure
Biocon leads Indian charge into weight loss drugs as patents lapse
Biocon Ltd. is pivoting to anti-obesity therapies as patents for the blockbuster medications start to expire, unleashing a wave of generic supply for the market that's expected to touch $100 billion by 2030.
Aakash names Deepak Mehrotra as managing director and CEO
Aakash Educational Services Ltd (AESL), a subA sidiary of embattled startup Byju's, has appointed Deepak Mehrotra as its managing director and chief executive officer.