Can Google's PaLM challenge GPT-3?

Plus the generative AI landscape for 2023

Good Morning Santa believers,

Google has been quietly working on response to OpenAI's GPT-3:

It's called PaLM (Pathways and Language Model)

Christmas came early for those with an OpenAI account. With the release of ChatGPT earlier this month, Google apparently issued a "Code Red" in response to user feedback and speculation that it may end up being the first real threat to the web search, a sentiment reinforced by the creator of Gmail himself, Paul Buchheit

But is Google on red alert, or do they just have a reputation to protect from the spicy results LLMs give from suggestive prompts?

One of OpenAI's advantages is that they are a private company (technically, a for-profit wrapped in a non-profit) and relatively new to the public eye, allowing for them to rollout their beta version of ChatGPT for user testing and be able to withstand public scrutiny that Google (Alphabet) might not want to bear as a public company.

Google has likely been conducting massive internal tests to scrub PaLM of any offensive, suggestive, or NSFW responses. They may have learned their lesson from when Microsoft's AI chatbot started praising Hitler after learning from its users. 

So what do we know about PaLM? It's reported to contain 540 billion parameters, more than three times that of OpenAI's GPT-3:

  • PaLM claims to have an advantage because it can process multiple senses at the same time.

  • Most AI models can only handle one data type at a time, like text, images, or speech. PaLM boasts that it can handle all three at once.

  • This is a big differentiator because current models make mistakes and have biases because they can't fully understand the "world" when they're only processing one type of data.

Think of PaLM as a "multi-sensory" model instead of just a "language" model.

Combining the image-generation capabilities of DALLE-2 or Stable Diffusion with the textual syntax of ChatGPT could result in an AI synesthesia that might start to mimic AGI, which is loosely defined as general intelligence based on the capacity for efficient cross-domain optimization.

How might a user experience PaLM? Last week, released their version of AI chat-assisted search, which gives us a glimpse into how Search (and ads) would integrate into chat, and vis versa.

PaLM's assumptive placement in the Google product line is to integrate into Search, which currently makes up 80% of Google's revenue through Ads. Rumors are that we'll see something in Q2 of 2023.

The Generative AI Landscape for 2023

Sequoia Capital

For developers who had been starved of access to Large Language Models, the floodgates are now open for exploration and application development.

OpenAI's API allows for developers to utilize the power of GPT-3 and ChatGPT to integrate them into their own programs and applications.

Sequoia Capital, one of the biggest investors in OpenAI, released a graphic to help navigate the growing landscape of new startups.

That's all for now. We keep it brief, like BriefBot. See you next week.

Technically, not wrong.