"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

October 21, 2024

The Evolving Landscape of ML Hiring: A Veteran's Perspective

 


Job interviews often miss true talent. They reward rehearsed responses over candidates who can persistently build practical, context-aware solutions beyond just technical know-how

As someone in the trenches of data science hiring for over 7 years, I've watched our field transform dramatically. Recently, a job description for an ML role caught my eye - and not necessarily in a good way. It got me thinking about how our industry's hiring practices often need to catch up to the reality of our work. Let me share some observations:

The Commodity of Code

  • LLM can generate working solutions / provide ideas / get started on any topic as long as you have good basic skills and coding knowledge. Now, I ask interns hiring assignment tasks to focus on accuracy and bugs. Code has become a commodity. The real value lies in understanding models, and limitations, bridging the gap between visions and technical realities, and architecting solutions that solve real-world problems.

The Kitchen Sink JD

  • This particular job description reads like a wish list for a tech superhero. Data structures, algorithms, AI/ML, coding, system design - oh, and don't forget a dash of product sense! While it's great to aim high, this scattergun approach often misses the mark. We need specialists with deep expertise, not generalists who've dabbled in everything.

The Interview Gauntlet

  • The hiring process outlined was a marathon: write-ups, HackerEarth assessments, coding tests, multiple rounds with the ML team, and then more conversations. In a market where top talent is scarce and in high demand, do we really need to put candidates through such a lengthy ordeal?

The Missing Pieces

  • What struck me most was what the JD and process didn't emphasize. Where was the assessment of a candidate's ability to translate business problems into technical solutions? How about evaluating their capacity to stay ahead of rapidly evolving trends in ML?

A Call for Pragmatism

  • To my fellow hiring managers and HR teams: let's get practical. The perfect candidate who ticks every box on your mile-long list probably doesn't exist - and if they do, they're likely happily employed or running their own startup.

Instead, focus on core competencies that drive real value:

  • The ability to understand and translate business needs
  • A knack for architecting scalable, efficient solutions
  • Adaptability and a passion for continuous learning
  • Strong communication skills to bridge technical and non-technical stakeholders

The ML landscape is changing faster than ever. Our hiring practices need to keep pace. Let's move beyond the "code on a whiteboard" era and design processes that identify true innovators who can propel our field forward.

Another Good Read - Why We Don't Interview Product Managers Anymore



Got Something worthy Today to post



This JD Rocks - Link
  • Focus on practical software engineering, not algorithm challenges.
  • Work through a system design problem relevant to your daily work.
  • Talk about your perspectives on building a great product.
  • Deep dive on engineering practices and culture 

Keep Exploring!!!

October 12, 2024

Ethical AI vs. Agentic Autonomous AI: Navigating the Complexities of Modern AI Systems

  • Human Oversight vs. AI Independence: Ethical AI frameworks typically advocate for human-in-the-loop systems, ensuring human oversight. Agentic Autonomous AI aims to minimize human intervention, raising questions about responsibility and control.
  • Short-term Gains vs. Long-term Consequences: The push for rapid AI advancement (often seen in Agentic Autonomous AI) may overlook long-term ethical implications. Ethical AI approaches tend to prioritize careful consideration of potential future impacts.
  • The Reasoning Conundrum: While Large Language Models (LLMs) demonstrate language understanding and generation capabilities, they still lack true reasoning abilities. This limitation is crucial when considering the ethical implications of deploying AI systems in decision-making roles.
  • Ethical Constraints vs. Autonomous Agency: The core tension between Ethical AI and Agentic Autonomous AI lies in balancing moral safeguards with the desire for increasingly independent AI systems. Ethical AI prioritizes human values and safety, while Agentic Autonomous AI pushes for greater AI self-direction.
  • Transparency Trade-offs: Ethical AI often demands explainability and interpretability, potentially limiting model complexity. Conversely, highly autonomous AI systems may sacrifice transparency for increased capabilities, raising ethical concerns about accountability and trust.
  • Data Ethics in AI Development: Ethical AI emphasizes the importance of unbiased, representative datasets. Agentic Autonomous AI, however, may prioritize data quantity over quality to enhance its learning capabilities, potentially perpetuating or amplifying societal biases.
  • Continuous Learning and Ethical Drift: Agentic Autonomous AI systems that engage in continuous learning pose risks of ethical drift over time. Ethical AI frameworks must grapple with how to maintain moral constraints in evolving systems.
  • Global Ethics vs. Local Autonomy: As AI systems become more autonomous, they may encounter scenarios where global ethical standards conflict with optimal local decisions. This tension between universal ethics and situational autonomy remains a critical challenge.
  • Responsible AI Adoption in Practice: Implementing either Ethical AI or Agentic Autonomous AI requires a deep understanding of models, data, and their limitations. Superficial adoptions of either approach can lead to irresponsible and potentially harmful AI deployments.
  • The Role of Human Values: Ethical AI explicitly encodes human values into AI systems, while Agentic Autonomous AI may develop its own set of values through learning. The alignment (or potential misalignment) of these values with human ethics is a crucial area of ongoing research and debate.

Technology will continue to change the world. A thoughtful approach is needed to prioritize use cases that offer broader positive impacts over those that primarily lead to monetization. This way of thinking can help align AI adoption with human values and ensure a more substantial positive impact on humanity.

Keep Going!!!

October 05, 2024

Prompt Caching Analysis

Prompt Caching Analysis

Caching is enabled automatically for prompts that are 1024 tokens or longer. 

Prompt Caching is enabled for the following models:

  • gpt-4o (excludes gpt-4o-2024-05-13 and chatgpt-4o-latest)
  • gpt-4o-mini
  • o1-preview
  • o1-mini

Usage Guidelines

1. Place static or frequently reused content at the beginning of prompts: This helps ensure better cache efficiency by keeping dynamic data towards the end of the prompt.

2. Maintain consistent usage patterns: Prompts that aren't used regularly are automatically removed from the cache. To prevent cache evictions, maintain consistent usage of prompts.

3. Monitor key metrics: Regularly track cache hit rates, latency, and the proportion of cached tokens. Use these insights to fine-tune your caching strategy and maximize performance.

Ref - Link1, Link2

Keep Exploring!!!


October 02, 2024

The Harsh Realities of GenAI Startups: AI Advisor Perspective

  • 🔓 Open Source Paradox: There's a push to leverage open-source models and frameworks, yet expectations for state-of-the-art accuracy remain unrealistically high.
  • 🧩 Holistic Product Development: Successful GenAI products require a synergy of innovative ideas, domain expertise, and high-quality training data - not just algorithms.
  • 💰 Resource Constraints: Computational costs are a significant factor in GenAI development, often underestimated by founders.
  • 🎈 Hype vs. Reality Gap: Many founders lack a deep understanding of the technical challenges and limitations in GenAI implementation.
  • 🖥️ Infrastructure Costs: Even minimal GPU requirements for model training and inference can be daunting for bootstrapped startups.
  • ⚖️ Resource Optimization Fallacy: Attempts to minimize costs across all aspects of development often lead to suboptimal results in model performance and product quality.
  • 🏎️ Performance-Aesthetics Mismatch: Many startups focus on creating visually appealing UIs but struggle with the underlying AI engine's capabilities, resulting in a "sports car body with a scooter engine" scenario.
  • 🚀 Democratization vs. Expertise: While AI tools are becoming more accessible, creating truly groundbreaking GenAI applications still requires deep technical expertise and innovation.
  • 🌊 Depth vs. Breadth Trade-off: Founders who aren't willing to invest time and resources in deep technical development risk creating superficial, easily replicable products with limited longevity in the market.
Keep Exploring!!!

September 26, 2024

🚀 Celebrating a Year of GenAI Use Case Success in Retail! 🎉

It's been over a year since my Retail adoption #GenAI use case went live for a leading U.S. specialty retailer on August 17, 2023. 

The results? Double-digit improvement in user page conversions! 📈

🔍 Key Insights:

Innovation Over Integration: Initially, I didn't showcase #GenAI use cases to the #CTO. Instead, I presented a #ReimaginedWorkflow for:

  • Customers
  • Support analysts
  • Procurement teams
  • Digital Asset Management

Rethinking AI/ML Implementation: It's not about wrapping AI around existing processes. True impact comes from:

  • New engagement models
  • Innovative interactions
  • Blending creative solutions

Success Factors in Production:

  • Data Quality 🏆
  • Innovative use of GenAI
  • Tailored solutions (not patchwork fixes)
  • Rigorous testing in production environments

Beyond Demos: Real adoption comes from solving genuine user needs, not just showcasing capabilities.

  • 💡 Lesson Learned: To make #AI truly impactful, we must explore new ways of engagement, foster creativity, and innovate by combining diverse ideas.
  • 👥 Collaboration Opportunity: Are you working on similar AI strategies or use cases? Let's connect and collaborate! Share your experiences in the comments.

#AIStrategy #RetailInnovation #DataDrivenDecisions #DigitalTransformation #AIAdoption #TechLeadership #InnovationInRetail #AISuccessStory

Who else is seeing success with GenAI in their industry? Let's discuss! 👇


September 23, 2024

🚨 4 Overlooked Pillars of AI Ethics: Profits vs. Principles 🚨

In the rush for AI dominance, we're neglecting crucial ethical foundations. Here are 4 pillars often sacrificed at the altar of profit:

These policies will shape the future of AI. We can't wait - the time to act is NOW.

🧠 Data Sovereignty Rights

  • Overlooked because: User control cuts into valuable data assets
  • Reality check: Our digital lives aren't corporate property

🏥💰 Regulatory Oversight in Critical Sectors

  • Overlooked because: Slows time-to-market in lucrative industries
  • Reality check: Unchecked AI in healthcare/finance risks lives & livelihoods

📚 Transparent AI Lineage

  • Overlooked because: Transparency can expose flaws & biases
  • Reality check: Black-box AI erodes trust & accountability

🎨 Recognition of Human Creativity

  • Overlooked because: Crediting sources complicates IP claims
  • Reality check: AI thrives on human ingenuity – let's honor that

These aren't just ethical niceties – they're essential for sustainable, trustworthy AI. Short-term profits shouldn't overshadow long-term societal impact.

We need AI that serves humanity, not just shareholders. It's time to realign our priorities. Which pillar do you think is most crucial? Why is it being overlooked?

#AIEthics #ResponsibleAI #TechForGood #AIAccountability #DigitalRights

Tag a tech leader who needs this wake-up call 👇

Keep Advocating ResponsibleAI!!!

TechForGood vs TechForProfits !!!

September 17, 2024

Understanding Index RAG: Data Storage vs. Retrieval

In the realm of information retrieval and artificial intelligence, Index RAG (Retrieval-Augmented Generation) has emerged as a powerful technique. To fully grasp its potential and limitations, it's crucial to understand the distinction between data storage and retrieval, particularly in the context of indexing strategies. This post will explore two different indexing approaches and their implications for handling queries, especially multipart questions.

The Indexes

Index 1: Broad and Diverse

Composition: 20 pages from history + 20 pages from geography + 20 pages from maths

Strengths:

  • Versatility: Covers multiple subjects, enabling efficient responses to multipart questions
  • Diversity: Offers a well-rounded breadth of content across different fields

Index 2: Deep and Focused

Composition: 200 pages focused solely on history

Strengths:

  • In-Depth Knowledge: Provides comprehensive depth on history, ideal for complex historical inquiries
  • Rich Content: More pages dedicated to one subject increases potential for detailed responses

Trade-offs

Breadth vs. Depth

  • Index 1: Offers breadth across subjects but may lack depth for in-depth analysis
  • Index 2: Delivers depth in history but falls short on breadth for interdisciplinary queries

Complexity of Queries

  • Index 1: Can handle complex, multipart questions effectively due to subject variety
  • Index 2: May struggle with multipart questions spanning multiple disciplines

Information Quality

  • Index 1: Information may be less densely packed with specialized detail
  • Index 2: Provides rich historical data but lacks subject diversity

Challenges with Multipart Questions

Consider a multipart question involving history and mathematics:

Using Index 1:

  • Pros: Can provide relevant information across both subjects
  • Cons: Detail may not be as profound, potentially leading to surface-level insights

Using Index 2:

  • Pros: Historical aspect might be well-covered
  • Cons: Absence of mathematical content results in an incomplete answer

Implications for RAG Systems

Query Processing:

  • RAG systems using Index 1 may need sophisticated algorithms to balance information from different domains
  • Systems using Index 2 might require additional steps to supplement missing interdisciplinary information

Content Generation:

  • Index 1 allows for more flexible content generation across topics
  • Index 2 enables deep, nuanced responses within its specialized domain

System Architecture:

  • Index 1 might benefit from a modular architecture that can efficiently combine information from different subjects
  • Index 2 could leverage specialized language models fine-tuned for historical content

Conclusion

The choice between a broad, versatile index (Index 1) and a deep, focused index (Index 2) significantly impacts the retrieval effectiveness of an information system. Understanding these dynamics is crucial for users and developers alike to create effective RAG systems.

When designing or using RAG systems, consider:

  • The nature of expected queries (single-domain vs. interdisciplinary)
  • The required depth of information
  • The system's ability to synthesize information from multiple sources

By carefully weighing these factors, one can optimize the balance between data storage and retrieval capabilities in Index RAG systems, ultimately enhancing the quality and relevance of generated responses.

GenAI Two Use Cases - Two Lessons

Creative and Learning Use Case



Wrong Guardrails Applied, Content for opinions

What other options

  • Provide Factual data
  • Do not provide recommendations for entities
  • Reason for bias
  • Do not rely on Guardrails

Keep Going!!!

September 15, 2024

Multimodal data platform

ETL and data pipelines are redefined in #GenAI Applications. Your #ETL now will support 

  • #images, #docs, #numbers, #pdfs. Extracting and storing insights/vectors / structured databases 
  • Everything together creates the new #GenAI #Multimodal data platform. 
  • #Multimodal #insights from all forms of data
  • #Proplens is working to align this perspective for our customers for richer insights and perspectives. #productlessons #genai #data
Keep Loading and Learning!!!