GenAI Reality Check: That RAG Use Case?

 

Keep Thinking!!!

❌ Increased Bugs and Defects

Some CTOs observed that aggressive GenAI adoption led to higher defect rates and an increased support burden post-release.

Here's a simplified view:

• ✅ GenAI-First CTO + Trained Team + Established Best Practices = Productivity
• ✅ GenAI-Ready CTO + Trained Team + Piloted Projects = Stability
• ❌ GenAI-Aware CTO + Aggressive GenAI Adoption + AI-Aware Team = Chaos

Ref - Link

Keep Going!!!

Agents = All Business Logic in AI Tier

Satya Nadela explains the AI Agentic Future.

The business logic is all going to these Agents.

-----

Video from Bg2 Pod Youtube Channel (link in comment) pic.twitter.com/CCzcvPvmZ5

— Rohan Paul (@rohanpaul_ai) December 14, 2024

• Business Logic in Agents
• All Logic in AI Tier
• More AI Native Business Apps
• Data Analyst = AI Native Excel Apps (Visualization, Analysis)

Keep Creating Agents!!!

Incremental GenAI Adoption - Buy and Build

• Ratio of Building vs Buying
• Get Data Maturing, Model Skills
• Start with Adoption, Learn to Finetune

“You age it, you age it, you age it…”@satyanadella just explained the business model for AI to everyone in plain sight.. holy shit pic.twitter.com/Fss6jR2vZ0

— JJ (@JosephJacks_) December 13, 2024

Happy Learning!!!

Intelligence with GenAI

When learners can see 'Intelligence with GenAI'. It is very heartening to see solutions built during the session :)

Some feedback after the 12-hour GenAI session:

• We have a lot of data; we can use LLM to add intelligence. A lot of IoT sensor data is present, but only fixed reports are available.
• I have only used #ChatGPT; now I see a ton of tools to explore.
• Infra intelligence - LLM is used to understand the complete ecosystem of servers, leverage logs + intelligence to find server owners, and alert on reallocation / upgrades.
• Automate Data Analyst work to analyze keywords, user query patterns. This saves 65% of my efforts.

Keep Exploring!!!

Supply Chain Expertise and GenAI Insights

I have worked for Microsoft Xbox supply chain and UPS. Now If I have to add a GenAI lens to my past. Here are my perspectives.

At Microsoft's Xbox division, I managed both forward and reverse supply chain logistics, covering repairs, refurbishment, and warranty services. By integrating GenAI, we can significantly enhance product defect detection, implement targeted product improvements, and streamline supplier communications, elevating overall efficiency and product quality.

At UPS, I collaborated with the team to develop and pitch AI/ML strategies for third-party logistics, focusing on operational efficiencies, visibility, planning, forecasting, and optimization. With the infusion of GenAI, the potential applications could extend to sophisticated chatbots and digital assistants, further refining company policies, fostering broader AI adoption, and enhancing supplier communications.

I am committed to pushing the boundaries of supply chain management with innovative GenAI-driven solutions and look forward to collaborating with startups/product companies in this space. If you are an SMB, have historical data, looking to onboard in AI, Let's connect sivaram[at]phygitalytics.com. 

Keep Learning!!!

    

Data is not the new oil - Alexandr Wang

Great Talk, Lot of good insights

• Oil is a commodity and everyone has same access to oil
• Not all data has same level of value
• Every type of data fintech / insurance / healthcare has different 
• Data has multititude 
• Multiple frameworks / thoughful strategy to stitch data
• Building block for next move is quality code / automated code
• Earliest is Autonomous cars
• Raw data to labelled data is First step towards quality data
• Data = New Oil, Scale = Refinery
• Most capabilities are taught by large scale data
• Data Engine = Refinery for data
• Teach a model how to access one answer better than other with a bunch of examples

Opportunity for Enterprises

• Total data available - 99% - Private
• Messages / Emails will never end up on internet
• Enterprises have a lot of unused data
• Tune General purpose model for Enterprises
• Customer care / Legal Apps
• Focus on big problems that matter to your business

Questions

• Unique Data Assets
• Better than Anyone else 
• Unique capabilities / Differentiators
• Cost Reduction / Customer Care / Optimization
• AI = Productivity enhancer
• Meaningful chunks of work
• Health care / Financial Services
• Data & Compute Limiting Factors
• AI <> Replacement for humans
• Economically viable human systems
• There is no future here 2 years back vs This is a threat
• Model improvement is going to get better
• Need broader cooperation
• Inequality with jobs / upskilling with new jobs
• AI misuse is punished / handled severly
• Testing and Evaluation for Systems and use case
• Fit for purpose vs primetime
• FDA for drugs similar regulation options, Apps approved after scruitiny
• Public evaluation of models
• Testers in public / private / regulators
• Ideas + Accountability decentralized

Ref - Alexandr Wang: 26-Year-Old Billionaire Powering the AI Industry

The Truth About Building AI Startups Today

• GPT Wrappers
• AI Agents 
• High Beta Opportunities
• Idea Maze
• Once in a Life time opportunity
• AGI / Multimodal / Videos
• Workflow Automation
• RPA - Search/ Form Filling
• Sweet Spot - Pivot LLMs Automate Government Contract
• Dev tool companies
• Fine Tuning LLM Models
• Something more than Finetuning
• Customize to private datasets (Healthcare / FinTech)
• Cybersecurity to Cloud -> Cybersecurity for LLM
• LLM to data access Mapping
• Purpose trained models / Run Locally models
• Prototype with close source LLM Models
• Collect data in parallel for domain context
• Partner and build private models
• Closed source AGI = Monopoly / Dangerous
• AI Ethics + Regulation + Measuring it

My Take

• Prototype with close source LLM Models
• Collect data in parallel for domain context
• Partner and build private models

Product #1 - Syncly

• With AI feedback analysis, Syncly instantly categorizes feedback and reveals hidden negative signals. 
• Centralize all your feedback and take proactive actions based on real time insights to elevate your five-star customer experience.

Product #2 - Cradle

• Protein engineering without the guesswork

Keep Exploring!!!