Language Models - Reasoning / Learning Abilities / Self Learning Way Forward

• AI systems teaching themselves
• Models developing unexpected capabilities
• Programs showing signs of emergent behavior

But the scariest part? pic.twitter.com/AzeU7xA2bt

— Baptiste (@BaptisteVicini) November 19, 2024

 

• Many copies of Network
• Look up data
• Share the Learning
• Apply the Logic

Very much focused agents on each Topic can make magic if trained well :)

Keep Exploring!!!

Why big companies failed to build LLMs

 

How Alexa dropped the ball on being the top conversational system on the planet
—
A few weeks ago OpenAI released GPT-4o ushering in a new standard for multimodal, conversational experiences with sophisticated reasoning capabilities.

Several days later, my good friends at PolyAI…

— Mihail Eric (@mihail_eric) June 11, 2024

• Data was poorly annotated. Documentation was either nonexistent or stale.
• Experiments had to be run in resource-limited compute environments. 
• That meant for months our internal annotation team had been mislabeling thousands of data points every single day
• antagonistic mid-managers that had little interest in collaborating for the greater good
• Duplicated efforts due to no shared common ground 

Keep Exploring!!!

LLM Perspectives - Familiarity vs Randomness

 

There's a big difference between solving a problem from first principles vs applying a solution template you previously memorized. It's like the difference between a senior software engineer and a script kiddie that can't code.

A script kiddie that has a gigantic bank of scripts… https://t.co/l2W8FUnwj8

— François Chollet (@fchollet) June 10, 2024

Keep Exploring!!!