Be on the look out for fraudulent investment scams.

CA-EN Advisors
CA-EN Advisors

War of the Words – The Battle for AI Language Supremacy

March 30, 2023
Share
Share on facebook
Share on linkedin
Share on twitter
Share on email
Share on print

As AI applications begin to show near-human abilities, a battle is erupting between technology giants to show who will be the first to integrate these technologies into their existing infrastructure. The stakes are incredibly high as seen with the massive market capitalization moves seen as technology bellwethers Microsoft and Google show early concepts of their new search platforms.

We asked Malcolm White, BMO Global Innovators Fund’s Portfolio Manager, to provide his unique insights given that he has been studying AI for over six years now and has personally used many of these next-generation language tools for industry applications. He comments on the underlying innovations but more importantly why a myopic view of ChatGPT solely as a search technology misses the more important investment ramifications.

This image depicts two boxers facing off, illustrated by artificial intelligence.

Figure 1 – AI Boxers Drawn by Author Using Generative AI via Stable Diffusion 

(Source: Author, generating using NightCafe)

This is What We Were Talking About

We made some bold statements last October that 1) new generative AI applications were excellent 2) they were ready for commercialization and 3) and we believed that these AI-based applications can be the foundation of the next industrial revolution. We backed these claims up by showing amazing images generated by AI (just like the graphic under our introduction – Figure 1) and by highlighting medical applications using AlphaFold that can predict protein structures. But we lacked that knockout application that would cement our points.

Then came ChatGPT.

This AI application took the world by a storm and became our holiday gift. It not only validated our key theses but it also validated another that we would not see the lost decade of innovation that occurred post the dot.com crisis. This was because we spent the last ten years building incredible infrastructure to deploy technology: data centres, cloud computing, and 5G wireless networking infrastructure. If a technology was worthy of capturing the world’s attention – it would do so in record time. ChatGPT certainly did this by achieving the incredible milestone of reaching 100 million monthly active users in only 2 months (see Figure 2); the popular Instagram in comparison took over 2 years to achieve the same milestone1.

Figure 2 – Time Required for an Application to Reach 100 Million Global Users (in Months)

This chart shows the amount of time it takes to reach 100 million social media users, in months.

Source: UBS / Yahoo, as of February 22, 2023

What is ChatGPT? Just ask ChatGPT

If you aren’t part of the 100 million active monthly user base and have managed to avoid the onslaught of media coverage around ChatGPT and still wonder what ChatGPT is, we recommend asking ChatGPT itself, “What is ChatGPT?” The AI application would generate the following reply2:

ChatGPT is an open source chatbot created by OpenAI. It is a conversational AI system that uses a large-scale pre-trained language model to generate intelligent, human-like responses to user input. ChatGPT is based on the GPT-3 language model and is capable of generating human-like responses in multiple languages.

Can ChatGPT Get a Wharton MBA?

Now we can remember the days when AI was so bad it was comical – see aiweirdness.com – so we do have a healthy perspective on the subject. But these days we have to hold back our excitement on how good AI is. ChatGPT is good – too good. It is so good that universities are banning it, studying it, or both. A professor at Wharton discovered it could pass an MBA exam (achieving a B to B-) and others speculate it might be able to pass legal or other exams3. Wharton Professor Christian Terwiesch went on to further elaborate in his research paper4 that ChatGPT:

… has shown a remarkable ability to automate some of the skills of highly compensated knowledge workers in general and specifically the knowledge workers in the jobs held by MBA graduates … [and] has demonstrated the capability of performing professional tasks such as writing software code and preparing legal documents

But for those who think that humans no longer have to think again, he notes ChatGPT:

… makes surprising mistakes in relatively simple calculations at the level of 6th grade Math. These mistakes can be massive in magnitude

So human intelligence is in no danger of being replaced as feared. Instead, our thesis is that AI applications such as ChatGPT are incredible productivity tools that will benefit the humans that adopt it. We call this process Cognitive Automation and believe it will power the next industrial revolution.

War of the Words - The Tech Titans Have Awoken

Given that ChatGPT has been the fastest technological adoption curve ever recorded (Figure 2), it is no surprise that it has caught the attention of the technology titans. Just as we had knowledge of these incredible capabilities of these new Large Language Models (LLM) such as ChatGPT, they too knew that the day would come when the public became aware of these applications.

The bid for AI language supremacy, specifically ChatGPT, has become a vicious competition by technology bellwethers Microsoft and Google to see who can produce the most compelling vision of consumer-oriented products based on ChatGPT.
Google (Alphabet Inc.) responded to a rumoured Microsoft threat, that they would be the first to launch these tools, by revising its Search, Lens and Maps products. These products are enhanced by in-house AI products that understand language, images and music (Imagen, LaMDA, MusicLM and PaLM).

However, a subtle error in the output from their chatbot powered by these models (Bard) triggered a crisis in confidence that triggered a wave of selling, erasing $100 billion in market capitalization for Google in one day (Feb 8, 2023).

Microsoft took advantage of the vulnerability of Google by previewing their upcoming version of their Bing search engine, powered by ChatGPT technology. Microsoft’s successful demo and their prescient $10 billion investment in privately held OpenAI, the developer of ChatGPT, made them the winner by decision for investors in the first round of this fight.
At stake is the nearly $200 billion in revenue derived from the global search market. Google has approximately 93% share while Microsoft has 3%. Investors are correct that the stakes are high and that there is much to lose. Wall St has been enthralled by this gladiatorial fight and the past few weeks have seen daily calls jam-packed with institutional investors trying to understand the investment ramifications.

It is easy to get caught up in the hype of this spectacle that we are calling the War of the Words. But if you don’t understand the underlying technology, it is also easy to get misled. Fortunately, we have been using AI-based natural language models for several years now including using Google’s advanced Natural Language Processing (NLP) model called BERT, GPT-3 and its successor ChatGPT. This has given us a unique and informed perspective on this battle.

Hype Alert - ChatGPT is Not a Search Engine

We first need to burst the bubble surrounding ChatGPT – it is not a search engine. Zealots may want to argue with us so we will back this up with an example. Ask ChatGPT – “Who won the Superbowl?” It will provide a very accurate description of how Kansas City won, provide detailed statistics about its quarterback, etc. But the problem is it will describe the win over the San Francisco 49ers and not the most recent win over Philadelphia Eagles. Why? OpenAI has fully disclosed the reason for the error – ChatGPT cannot process information after its last training date, which is 2021. Although this won’t affect tasks such as writing an essay on Shakespeare etc., a lack of knowledge of current events is one reason why using ChatGPT as a search engine could be problematic.

There is an important technical difference between a search engine and a generative AI application such as ChatGPT. A search engine takes a user query “Who won the last Superbowl” and breaks down the sentence to try to understand what each word means: 1) Who (a sports team) 2) won (had the highest score) 3) last (most recent as of today’s date 4) Superbowl (an iconic American football championship held at the end of the season to determine the overall winner of the NFL. Google’s underlying AI-based technology BERT excels at this task. It can break down the words in a sentence to understand relevant entities and their respective meaning. It then processes this information to find the best web page that can answer the question. It generally points to the top-ranked pages and typically does not generate the answer in its own words5. This whole process is called Natural Language Processing and Understanding, namely understand the intent of the query and then get the computer to do something (e.g. search) based on what was asked.

ChatGPT is the other side of the spectrum. It is a Natural Language Generation (NLG) tool. It has read nearly everything on the internet and stored it in its massive brain. This “brain” has 100s of billions of nodes in it called parameters that act like neurons in a human brain. This gives it near perfect memory of what it has read. When a user types in a request, ChatGPT will perform some rudimentary understanding of the request and then try to emulate what a response should look like from its memory. It tries to autocomplete a long sequence of words based on prior words. This gives it uncanny abilities to create what looks like a cooking recipe, movie script, computer code, academic essay etc., as it regurgitates what it remembers. But the drawback is that the response is a recreation of what you desire – it may or may not be accurate like our Superbowl example.

Figure 3- Natural Language Understanding Versus Generation

This image shows how natural language understanding, or online searches, results in a simple output such as a ranked list of potential search links. Natural language generation (e.g. ChatGPT) takes this one step further by reading massive amounts of text on the internet and provides a response based on a recall of what was seen.
Source: BMO GAM

Cost is the Catch – These are Large Brains to Train

The good news is that the industry is developing amazing new language models that will delight consumers and businesses alike (and annoy teachers). The catch is the industry secret that while ChatGPT and other generative AI tools produce amazing results, they are very expensive to host. That is because the language models they serve are enormous and have grown orders of magnitude larger, as shown in the following graphic (Figure 4). This means that you must use much more advanced hardware to run these applications. The problem with that is that there is no free lunch – more advanced hardware comes at a much higher cost that will make it more challenging to monetize these AI-based applications. Vendors that give away popular services for free are likely losing large amounts of money in the short-term hosting these applications.

Figure 4- The Increase in Size of AI-based Natural Language Models

This bar chart demonstrates the # of parameters required in relation to language models covering BERT, RoBERTa, GPT-2, T5, Turning NLG, and GPT-3.

To illustrate this, we have provided some pricing comparisons of current hardware used to run web services (e.g. CPUs) vs newer hardware (e.g. GPUs). We note pricing is still nascent and will vary by provider but what is important to note is the magnitude of pricing differentials. CPU-based inference is priced in pennies per hour; GPU-inference is priced in dollars per hour – nearly 100 times more. The pricing in Figure 5 – Comparative Pricing for Hosting AI Applications – CPU vs GPU even understates the gap as ideally for ChatGPT, one would use an NVIDIA A100 configuration or ideally an H100 configuration that could cost $8-$12 dollars per hour. This is much more expensive than the pennies per hour of compute cost that would typically power search or other basic text applications.

Figure 5 – Comparative Pricing for Hosting AI Applications – CPU vs GPU

This chart shows the comparative pricing and memory bandwidth for hosting artificial intelligence applications between CPU and GPU.

CPU instances

Provider
Architecture
vCPUs
Memory
Hourly rate
aws
Intel Xeon – Ice Lake
1
2GB
$0.06
aws
Intel Xeon – Ice Lake
2
4GB
$0.12
aws
Intel Xeon – Ice Lake
4
8GB
$0.24
aws
Intel Xeon – Ice Lake
8
16GB
$0.48
azure
Intel Xeon – Ice Lake
1
2GB
$0.06
azure
Intel Xeon – Ice Lake
2
4GB
$0.12
azure
Intel Xeon – Ice Lake
4
8GB
$0.24
azure
Intel Xeon – Ice Lake
8
16GB
$0.48

GPU instances

Provider
Architecture
GPUs
Memory
Hourly rate
aws
NVIDIA T4
1
14GB
$0.60
aws
NVIDIA A10G
1
24GB
$1.30
aws
NVIDIA T4
4
56GB
$4.50
aws
NVIDIA A100
4
80GB
Coming soon
aws
NVIDIA A10G
4
96GB
Coming soon
aws
NVIDIA A100
8
640GB
Coming soon

Investment Ramifications

There are many important investment ramifications that we believe are lost as a ChatGPT debate between Google and Microsoft. We highlight other ramifications below:
Microsoft – Aside from search, Microsoft is in an excellent position to monetize ChatGPT in different ways. ChatGPT is excellent at converting languages and generating text. Imagine these capabilities in their Office Suite – Word could embed ChatGPT to assist users with writer’s block, users could ask Excel or PowerPoint to format their documents using natural language commands or one could query a database the same way. Help could also be improved. These are all excellent applications that Microsoft could use to update users to higher price points in the core productivity applications. This is beneficial even if they do not gain market share in search.

Google – Don’t write Google off. The saying in AI is that the one with the most data is the winner. Google has this and should easily be able to recover from their poor demo. Additionally, Google is well aware of the “catch” with AI, namely the cost of hosting these applications. That is why they developed their own in-house chips (TPUs) to lower the cost of training an AI application and serving it (inference). Even if Google is behind OpenAI they are likely the first to be able to provide a cost-effective solution.

Baidu and other Chinese Internet Companies – There is also other opportunities for AI-away companies that will recreate ChatGPT in their local languages such as Mandarin and Cantonese.

Semiconductors – As mentioned with the “catch” – the world will need much more advanced computing capabilities to serve these models. Not to mention other cloud vendors, e.g. Amazon, that will be buying these chips and selling cloud-based hosted compute instances.

Private Companies – There are a large number of amazing private companies offering a compelling way to develop these new AI applications. We have been using huggingface.co for over a year now and are huge fans.

Conclusions - The Bing vs The Bard

So who will be the winner in the War of the Words (Bing vs Bard)? It is too early to call, and a simple debate misses the larger investment ramifications (see Investment Ramifications). We believe that in the future we will see hybrids of both models (NLU+NLP+NLG) doing what they do best. Ultimately, we believe this will come to market from both Google and Microsoft. This should be a very compelling offering. We also note that based on the roadmap for the next version of GPT (GPT-4), it could also better handle other types of information, such as images etc. Again this will provide other applications not currently available or known. We eagerly await the future of these technologies. We think the real winner of the War of the Words will be delighted consumers who use generative AI to achieve amazing results.

1 https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/#:~:text=Feb%201%20(Reuters)%20%2D%20ChatGPT,a%20UBS%20study%20on%20Wednesday.
2 Response from ChatGPT. Source: https://platform.openai.com/playground
3 https://www.cnn.com/2023/01/26/tech/chatgpt-passes-exams/index.html
4 Christian Terwiesch, “Would Chat GPT Get a Wharton MBA? A Prediction Based on Its Performance in the Operations Management Course”, Mack Institute for Innovation Management at the Wharton School, University of Pennsylvania, 2023.
5It has more recently generated small snippets that answer commonly asked questions around your query

Disclosures

Not intended for distribution outside of Canada.

 

Certain of the products and services offered under the brand name BMO Global Asset Management are designed specifically for various categories of investors in a number of different countries and regions and may not be available to all investors. Products and services are only offered to such investors in those countries and regions in accordance with applicable laws and regulations.

 

This communication is intended for informational purposes only and is not, and should not be construed as, investment, legal or tax advice to any individual. Particular investments and/or trading strategies should be evaluated relative to each individual’s circumstances. Individuals should seek the advice of professionals, as appropriate, regarding any particular investment. Past performance does not guarantee future results.

 

The viewpoints expressed by the Portfolio Manager represents their assessment of the markets at the time of publication. Those views are subject to change without notice at any time. The information provided herein does not constitute a solicitation of an offer to buy, or an offer to sell securities nor should the information be relied upon as investment advice.  Past performance is no guarantee of future results.  This communication is intended for informational purposes only.

 

Any statement that necessarily depends on future events may be a forward-looking statement. Forward-looking statements are not guarantees of performance. They involve risks, uncertainties and assumptions. Although such statements are based on assumptions that are believed to be reasonable, there can be no assurance that actual results will not differ materially from expectations. Investors are cautioned not to rely unduly on any forward-looking statements. In connection with any forward-looking statements, investors should carefully consider the areas of risk described in the most recent simplified prospectus.

 

Commissions, trailing commissions (if applicable), management fees and expenses all may be associated with mutual fund investments. Please read the fund facts or prospectus before investing. BMO Money Market Fund is not covered by the Canada Deposit Insurance Corporation or by any other government deposit insurer. There can be no assurances that the Fund will be able to maintain its net asset value per security at a constant amount or that the full amount of your investment in the fund will be returned to you. Past performance may not be repeated.

 

For a summary of the risks of an investment in BMO Mutual Funds, please see the specific risks set out in the prospectus. 

 

BMO Mutual Funds are managed by BMO Investments Inc., which is an investment fund manager and a separate legal entity from Bank of Montreal.

 

BMO Global Asset Management is a brand name under which BMO Asset Management Inc. and BMO Investments Inc. operate.

 

®/™ Registered trademarks/trademark of Bank of Montreal, used under licence.

Recommended

article collection

Mutual Funds

Insights

Top view of the forest and construction site with three trucks
Top view of the forest and construction site with three trucks
Climate
May 29, 2023

Seeing the Forest through the Trees – How Investors Can Assess Biodiversity Risk

How investors can leverage tools and frameworks to assess their biodiversity-related risk exposure
Men
Sadiq Adatia
Weekly Commentary
May 23, 2023
May 2023

Readying for a Real Estate Rebound

Is the recent spike in bankruptcies a warning sign for equities?
Men
Sadiq Adatia
Weekly Commentary
May 15, 2023
May 2023

Is It Game Over for the Greenback?

With tensions between North America and China rising, how should investors evaluate risk? Are we witnessing the end of the Greenback era of dominance in global finance?
Men
Sadiq Adatia
Weekly Commentary
May 8, 2023
May 2023

Defense Wins Championships

How do Fed Chairman Powell’s recent remarks affect markets’ interest rate expectations? In the wake of First Republic’s collapse, how will markets respond to the PacWest crisis?
Hand Coin tree. The tree grows on the pile. Saving money for the future. Investment Ideas and Business Growth
Hand Coin tree. The tree grows on the pile. Saving money for the future. Investment Ideas and Business Growth
Climate
May 3, 2023
May 2023

Why Climate Action Matters for Investors

The risks—and opportunities—of the transition to a net-zero emissions economy.
Men
Sadiq Adatia
Weekly Commentary
May 1, 2023
May 2023

First Republic is Gone. Now What?

Does the collapse of First Republic Bank create broader risks for the banking sector? With earnings season underway, what does the profit picture look like?