"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

March 03, 2024

Custom Chatbot vs OpenAI Chatbot

Build vs Develop on LLM

Custom Chatbot

Time- Data collection, labeling, classification, NER models

Build

  • Preprocessing
  • Lower case
  • Stemming, Lemmatization with POS Tags
  • Entities, NER

Inference

  • Intent
  • Topic Classification
  • Frame a response

Context - Limited to corpus

LLM Chatbot

Time - Prompts / Responses / Store / Retrieve

OpenAI

  • Prompt
  • Inference answers

Challenge

  • Air Canada hallucinations use cases
  • Context vs Hallucination


Keep Exploring!!!

No comments: