That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-year-old intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
This story is from the March 30, 2024 edition of Techlife News.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the March 30, 2024 edition of Techlife News.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber? Sign In
US GROWTH SLOWED SHARPLY LAST QUARTER TO 1.6% PACE.REFLECTING AN ECONOMY PRESSURED BY HIGH RATES
The nation’s economy slowed sharply last quarter to a 1.6% annual pace in the face of high-interest rates, but consumers — the main driver of economic growth — kept spending at a solid pace.
ORACLE'S LARRY ELLISON SAYS PLANNED NASHVILLE CAMPUS WILL BE COMPANY'S 'WORLD HEADQUARTERS'
Oracle Corp.’s planned campus in Nashville, Tennessee, will serve as the business software giant’s world headquarters, placing it in a city that’s a center for the U.S. healthcare industry, company Chairman Larry Ellison said.
FTC SENDS $5.6 MILLION IN REFUNDS TO RING CUSTOMERS AS PART OF VIDEO PRIVACY SETTLEMENT
The Federal Trade Commission is sending more than $5.6 million in refunds to consumers as part of a settlement with Amazon-owned Ring, which was charged with failing to protect private video footage from outside access.
AS BIDEN CELEBRATES COMPUTER CHIP FACTORIES VOTERS WAIT FOR THE PROMISED PRODUCTION TO START
President Joe Biden has a great economic story to tell voters a decade from now, less so in 2024.
US ADVANCES REVIEW OF NEVADA LITHIUM MINE AMID CONCERNS OVER ENDANGERED WILDFLOWER
The Biden administration has taken a significant step in its expedited environmental review of what could become the third lithium mine in the U.S., amid anticipated legal challenges from conservationists over the threat they say it poses to an endangered Nevada wildflower.
TENSIONS BETWEEN BEIJING AND WASHINGTON ARE THE BIGGEST WORRY FOR US COMPANIES IN CHINA.REPORT SAYS
Simmering tensions between Beijing and Washington remain the top worry for American companies operating in China, according to a report by the American Chamber of Commerce in China released this week.
MICROSOFT & AMAZON FACE SCRUTINY FROM UK COMPETITION WATCHDOG OVER RECENT AI DEALS
British competition regulators said this week they’ll scrutinize recent artificial intelligence deals by Microsoft and Amazon over concerns that the moves could thwart competition in the AI industry.
OLYMPIC ORGANIZERS UNVEIL STRATEGY FOR USING ARTIFICIAL INTELLIGENCE IN SPORTS
Olympic organizers unveiled their strategy to use artificial intelligence in sports, joining the global rush to capitalize on the rapidly advancing technology.
WHAT YOU NEED TO KNOW ABOUT WRAPPING YOUR CAR
Gaze around the next time you’re stuck in traffic and see if you’re not surprised, maybe even a little saddened, by the monochromatic sea around you.
TIKTOK MAY BE BANNED IN THE US. HERE'S WHAT HAPPENED WHEN INDIA DID IT
The hugely popular Chinese app TikTok may be forced out of the U.S., where a measure to outlaw the video-sharing app has won congressional approval and is on its way to President Biden for his signature.