Custom Chatbot vs OpenAI Chatbot

Build vs Develop on LLM

Custom Chatbot

Time- Data collection, labeling, classification, NER models

Build

• Preprocessing
• Lower case
• Stemming, Lemmatization with POS Tags
• Entities, NER

Inference

• Intent
• Topic Classification
• Frame a response

Context - Limited to corpus

LLM Chatbot

Time - Prompts / Responses / Store / Retrieve

OpenAI

• Prompt
• Inference answers

Challenge

• Air Canada hallucinations use cases
• Context vs Hallucination

Keep Exploring!!!