ChatGPT is 'not particularly innovative'

Good Read - Post1

• ChatGPT is 'not particularly innovative,' and 'nothing revolutionary', says Meta's chief AI scientist.
• The ChatGPT program is a case less of scientific breakthroughs than it is an instance of decent engineering, said LeCun

My Views

• Yes it is a gradual evolution from CNN - RNN - Transformer - Large Language Model
• Earlier we had next character prediction, Now we have sentence level 2048 token
• Alexa is a simple Q&A Bot vs Boston Dynamic Robots. Solutions need to solve the problem no need to be revolutionary.
• Facebook had data but never came up with this LLM :)
• GPT is lead to hybrid variations of chatbots, Alexa, Edge Devices, and Personalized Assistants.

Using GPT for Facts / Data related note retrieval is much better than asking it to solve a maths problem. Remember GIGO (Garbage In, Garbage Out), It may not be able to reason or solve but it can give you templates, formulas for you to get started, We do not read to remember the syntax but focus on solutions.

ChatGPT passes MBA exam given by a Wharton professor

• Amazing job at basic operations management and process analysis questions including those that are based on case studies
• Remarkably good at modifying its answers in response to human hints
• Remarkable ability to automate some of the skills of highly compensated knowledge workers in general and specifically the knowledge workers in the jobs held by MBA graduates including analysts, managers, and consultants

Why ChatGPT was able to create impact ?

• Solving a Niche problem
• Unparalleled user experience
• Plug and Play infra - API
• Human in Loop 
• Reinforcement learning along with Transformers

"Original Thinking / Looking at different way hybrid ideas not just one way" matters

"Perfect vs Good Enough Solution"

Ref  - Link

Good one, 

We can become better writers with ChatGPT

• Knowledge pointers
• Blending creative thought 
• Add your own perspective for the insight
• #Google democratized information. With #ChatGPT #Reasoning / #knowledge / #Facts is getting democratized. 

Why didn't DeepMind build GPT3?

• Organisational-level risk taking involved in building GPT3 - Brand Impact
• Build systems that appear to have intelligence when interacted with.

Keep Exploring!!!