That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-yearold intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
Bu hikaye AppleMagazine dergisinin March 29, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber ? Giriş Yap
Bu hikaye AppleMagazine dergisinin March 29, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.
Already a subscriber? Giriş Yap
TIKTOK SUES US TO BLOCK LAW THAT COULD BAN THE SOCIAL MEDIA PLATFORM
TikTok and its Chinese parent company ByteDance are suing the U.S. over a law that would ban the popular video-sharing app unless it's sold to another company, arguing that it vaguely paints it as a threat to national security to get around the First Amendment.
DISNEY'S STREAMING BUSINESS TURNS A PROFIT IN FIRST FINANCIAL REPORT SINCE CHALLENGE TO IGER
India, Disney+Hotstar, it expects its combined streaming businesses to be profitable in the fourth quarter and to be a meaningful future growth driver for the company, with further improvements in profitability in fiscal 2025.
INSTACART PARTNERS WITH UBER EATS TO OFFER RESTAURANT DELIVERIES
Grocery delivery company Instacart is partnering with Uber Eats to offer a new perk to its customers: restaurant delivery.
RYAN GOSLING AND EMILY BLUNT ARE GREAT FUN IN 'THE FALL GUY
One of the worst movie sins is when a comedy fails to at least match the natural charisma of its stars. Not all actors are capable of being effortlessly witty without a tightly crafted script and some excellent direction and editing.
FRENCH CYBERWARRIORS READY TO TEST THEIR DEFENSE AGAINST HACKERS AND MALWARE DURING THE OLYMPICS
Just like the Olympic athletes, the cyberwarriors that will be crucial for the success of the Paris Games are deep into training for the big event.
NINTENDO TO ANNOUNCE SWITCH SUCCESSOR IN THIS FISCAL YEAR AS PROFITS RISE
Japanese video-game maker Nintendo said this week that it will make an announcement about a successor to its Switch home console sometime before March 2025.
US SEEKS INFORMATION FROM TESLA ON HOW IT DEVELOPED AND VERIFIED WHETHER AUTOPILOT RECALL WORKED
Federal highway safety investigators want Tesla to tell them how and why it developed the fix in a recall of more than 2 million vehicles equipped with the company’s Autopilot partially automated driving system.
SLOW TO EXPAND, INTERNET CASINO GAMBLING IS THE FUTURE OF US BETTING, INDUSTRY EXECS SAY
Internet casino gambling is legal in only a handful of states, but the industry is convinced it is the future of betting, even as some worry about cannibalizing physical casinos.
US LOOSENS SOME ELECTRIC VEHICLE BATTERY RULES, POTENTIALLY MAKING MORE EVS ELIGIBLE FOR TAX CREDITS
The U.S.government loosened some rules governing electric vehicle tax credits, potentially making more EVs eligible for credits of up to $7,500 but leading critics to accuse the Biden administration of helping China.
FTX WILL RETURN MONEY TO MOST CUSTOMERS LESS THAN 2 YEARS AFTER CATASTROPHIC CRYPTO COLLAPSE
FTX says that nearly all of its customers will receive the money back that they are owed, two years after the cryptocurrency exchange imploded, and some will get more than that.