"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

November 20, 2023

The New Stack and Ops for AI

Consistency, User Exp - LLMOps Best practices

  • Framework
  • Repeatable/precise ways
  • AI augments human capabilities
  • User Experience
  • Keep humans in loop
  • Iterate and improve
  • Communicate capabilities
  • Suggestive prompts








  • Consistency

  • Output from JSON grammar


  • Seed parameter


  • Ground Truth



  • Microservice and Keeping track
  • Function Calling

  • DB / Browse data

  • Evaluate performance







  • Semantic Cache
  • Lookup if already in the cache







Keep Exploring!!!


No comments: