"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

April 30, 2022

Mass content engaged zombies

Time wasters / Dopamine boosters

  • Inescapable Internet / Constant Content Engagement / Content amplification Systems
  • Inescapable Youtube / Whatsapp / Facebook / Telegram / Instagram / TV
  • Content for all age group / genders
  • Crave for new content every day - Programmed by Constant Usage
  • End up consuming more unwanted content and less quality content

What do we think/feel is right?

  • Slim body
  • Acne free skin
  • Attention seeking machines

Results of Social media 

  • Depression / Anxiety
  • Deep Dive Engagement 
  • Addiction

Loss of Personality

  • Manipulative / Biased / Personalized targeted ads
  • Exploit human tendencies of feedback / Sensitized to bias 
  • Top 10 Happiest Countries <> Top 10 Countries spending time in Social Media

Social Media can be an addiction, It can make you feel lonely. We are not monitored for mental health. Talk more, Walk more. Quit Social Media!!!!

Happiness is not spending time on Social Media or watching others' Lives

mere-exposure effect

  • The mere-exposure effect is a psychological phenomenon by which people tend to develop a preference for things merely because they are familiar with them. In social psychology, this effect is sometimes called the familiarity principle.
  • The fact that you liked a song because of mere exposure to it, is something that products all over the world is trying to leverage
  • Higher the frequency of the usage -> higher the familiarity -> higher the likeness of the product -> higher the ‘share of mind’ of the user -> higher the ‘share of wallet’!

Ref - Link


Keep Thinking!!!

Agile = Clarity = Experience = Experiments

Basics

  • Can you develop something perfect in 4 weeks?
  • What determines your estimates ?
  • How well you know things you are doing ?

Depth of learning comes from

  • How to use / How it works
  • What are the pros and cons
  • What are other alternative approaches
  • Know-how, How a Tool/Language works
  • Experiments and lessons learned from implementation

Good estimations come with experience and clarity

  • Clarity comes from awareness and connecting different learning
  • The ability to learn a new topic and find the relative comparison or connecting dots is key

Being agile is not about pressure and deadlines, It's more about clarity, prioritizing over priorities on what to learn, focus and continuous experimentation, reuse your experience to build basics right.

Keep Thinking!!!

April 27, 2022

Retrospect / Connect your work

To understand how much Am I aligned in my current role/competency. A few questions :)

  • Projects - Clarity towards how it aligns with product/ customer /org needs
  • New ideas/initiatives - Did I pitch / experiment / got support/time to work on it
  • Conversations - Task focused conversation vs personal learning discussions with mentors 
  • Recognize situations when you were struck what I reflect upon it, Ask for help / Support / Learning outcome?
  • How do I balance/align towards increased workload/urgency / Am I able to manage WLB / learning?
  • What work I do not feel comfortable doing
  • What recent work I like/feel happy about from tech skills/outcome
What got you here, won't get you there
Every next level needs the next version of you

Keep Thinking!!!

April 26, 2022

Elon Buys Twitter

  • He is visionary, Twitter will transform into a competitive challenger for social media platforms
  • Twitter spaces would evolve into a more collaborative platform
  • The Twitter edit option will become a reality :)
  • More than Twitter, Facebook would be worried about this deal :)
  • This may leave some users worried with constant experiments but Twitter may evolve into something more engaging/collaborative platform
  • Twitter shareholders would see more returns in the coming months as Elon himself is a brand :)

Keep Thinking!!!

Roles vs Contributions vs Experience vs Collaboration

Sometimes you need titles to influence/evangelize a decision
Selling bottom-up has lot more challenges, You have to convince every level
Ideals will get transformed based on the buyer's mindset
In many cases, startup is the best way if you truly believe in your ideas
Learning needs time, Expertise needs a lot of experiments, Selling needs MVPs and Influencing needs collaboration and connections
Balancing code vs ideas vs prototypes vs unblocking needs different mindsets and multiple learning goals
Every Level can influence up to +2 levels and beyond that, it's really tough :)

Keep Thinking!!!

April 25, 2022

Scrutinize, Prioritize, Focus

Invisible Trap of Time wasters

  • Inescapable Internet / Constant Content Engagement / Content amplification Systems
  • Inescapable Youtube / Whatsapp / Facebook / Telegram / Instagram / TV
  • Content for all age group / genders
  • Crave for new content every day - Programmed by Constant Usage
  • End up consuming more unwanted content and less quality content

Reality

  • We have limited time
  • Picking the right items to focus
  • Deep Dive Engagement 
  • Iterations of Learning
  • Focus, Build your perspectives

Think Again

  • Employed vs Employable both are different
  • Expertise vs Familiarity both are different
  • Awareness vs Opinion is different

When you recognize you will know you need to spend time on collecting more experience/experiments not on watching things. Be aware/alert and change your habits/focus/priorities. Mass thinking machines or Mass content engaged zombies, Whar are we?

Keep Thinking!!!

April 22, 2022

Vision Object Counting - Line based counting

These two ideas and the key technique 

  • Region / Line-based counting
  • This is much easier to avoid duplicates
  • Count items crossing the line
  • Eliminate duplicate dedication by centroid tracking. The movement of the center point of the image. 
  • Less than the midpoint, After the midpoint
  • Sample every second to avoid duplicate
  • The crux is the field of view and how you track / vertical or horizontal line for the need / How we remove duplicates crossing the line, tracking that region to avoid duplicates
  • If tracking is enabled, Centroid > midpoint track
  • Centroid < midpoint - new item arrived, Enable Tracking



Keep Thinking!!!

April 20, 2022

AWS Lambda Day #1

Basic example getting started with AWS lambda.

Goto AWS Lambda functions


In AWS Lambda console


Pick from Template of Examples


Select the Test Code


Demo Test Results


This is a basic example. Need to put few more posts with Vision Examples!!!

Deploying FastAPI on AWS as a lambda container image

Keep Exploring!!!

April 19, 2022

MediaPiple - Explored

Many interesting examples have been posted in mediapipe. Google Vision library for many vision tasks.

Bookmarking python examples link

  • Mediapipe Objectron provides pre-trained models for shoe, chair, cup and camera
  • Mediapipe pose estimation
  • MediaPipe Face Detection Solution API
  • mediapipe_face_mesh - Face Landmarks

Example Code 





Keep Exploring!!!

April 18, 2022

Guide / Mentor / Manager - Discussions, Deliverables, Alignment, Vision

Taking inspiration from link

Adding my perspectives/answers for the questions

1. First question is always: “What do you think?”

  • Get all perspectives

2. Frequently called upon to be coach, sounding board, or devil’s advocate.

  • Data-Driven Decisions

3. Has shipped code with different development processes.

  • Waterfall
  • Weekly Sprint
  • 3 Week Sprint
  • 3 Month Cycle
  • Customer-focused releases

4. Has examples of things that have failed but they’ll try again.

  • Data Issues
  • Lack of coordination between Teams

5. Has strong opinions but is willing to change their mind.

  • Data Driven
  • Referenced Answers not opinions
  • Tried opinions vs Read Opinions

6. Unblocks all issues (not just engineering ones).

  • Need to be a Review / Idea provider
  • Ask first principles deep questions

7. Regularly identifies and destroys time wasters.

  • Pick priority items from a list of priorities

8. Says things like “This will take three weeks, but if we make this change we can test in two days.”

  • In consulting its all hacking work, So yes time vs delivery is a key

9. Lets the customer own the problem but take ownership of the solution.

  • Think of a long term cascade effect not a short term fix

10. Takes all of the blame and none of the credit.

  • Failure teaches more, It's ok to fail

11. Available during a crisis.

  • Consistent connect to explore / discuss options

12. Can dive deep into a few things per quarter.

  • Build on your core interests and deliver quality ideas/patents

13. Can try solutions to problems they’ve never encountered before.

  • Many times had to stretch its ok to try new avenues

From Link 

Liked this key definition

  • Process: What occurs when?
  • People: Who’s involved and how are they motivated?
  • Technology: What will we use to get there?
Career = Sum of Multiple Perspectives
  • Career as Dev - Managing XBOX supply Chain DB. 1TB database 15 years back. Building Warranty Engine, Touchpoint integration
  • Support - Application Support Analyst for Nestle handling 100+ Enterprise Apps
  • Testing/performance - Load Testing for Holiday Season, API Testing, DB Blocking / Perf Tuning
  • Data Science - Recommendations, Feature Lake, Vision, Retail, Multiple MVP
  • Domains - Retail, Ecom, SupplyChain
Build your portfolio across multiple perspectives. Taking knowledge vs Field knowledge vs Willing to deep dive and solve all are different skills :)

I didn't build a career with Tools knowledge :)

Be Curious, Unlearn, Relearn and Be open to keep yourself learning new things. Be better everyday :)

Keep Exploring!!!

Learning Cycle vs Aging vs New Tech

  • 1986 - Backprop paper was published by Hinton
  • 1993 - CNN Digit recognition was demonstrated 
  • 2022 - Data Science is at peak / More focus / Upskilling here

36 years back someone worked on a tech that is hot today. In another 20 years what will be peak, we don't know. Be open to learning. 

The key is not learning what is needed in the market but also being able to unlearn/relearn as the technology evolves. 

Be prepared to relearn every 10 years :)

Keep Thinking!!!

Skills = Coding + Product + Architecture + Market

Multiple things you need to focus on to get a 360 perspective.

  • Product Skills - Find your strengths, API, Data Science, Data Analytics, Core skills, Secondary skills
  • Market Opportunity - Awareness of consumer/market trends/products to build
  • MVP Skills - Identify blocks for building a working product version 1
  • Coding Skills - Pick, Identify best practices with scale/architecture
If you don't have you will have this problem link

Objective
  • Money
  • Career growth
  • Fun, enjoyment
  • Appreciation
  • Kick
Reality
  • Deadline pressure
  • Ambiguous requirements
  • Production issues
  • Technical debt
  • Disrespect
Career = Sum of Experiences
  • Support Function - Working for Nestle supporting 100+ Enterprise Apps, Upgrades, Weekend updates
  • Test Function - Working on Windows98 Customer reported issues, Testing, Service packs
  • Development - Migrating SQL 2000 to 2008 Xbox Supply Chain platform, Migrating new engine of 220 million serial numbers
  • Performance - Testing and validating Holiday jobs/loads and ensuring the system up for the holiday season
  • Data Science - Solving Vision, Data, Text building from several iterations
  • Data - Creating Cloud / BI / Migrating Inprem to cloud variations
We forget, remember, know some issues, know production lessons. A career is a sum of heterogeneous experiences. Try different roles, and build your own perspective. Everything will sum up and be more empathetic from the customer's point of view.

Keep Exploring!!!

April 16, 2022

Vision Use cases - Self Checkout

Product - Mashgin

  • Detect, Identify and Pay
  • Came Angle - Top View
  • Extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images.
Self Checkout Vendors List1, List2

Product - Zippin

  • Scan from your Phone
  • Overhead Camera
  • Shelf Level Sensors
  • Billing based on RFID / Other methods Tags 
How it works - Link
  • Overhead cameras follow customers' movements as they move around the store—without using face recognition - Maybe Phone Signals
  • Cameras and smart shelf sensors track when and which products are picked up or put back. - Weight sensors
  • Combining these two inputs allows Zippin to place the right items in the right shoppers' virtual carts. - Phone + Shelf Activity
  • On leaving the store, customers receive a receipt detailing their charges. Watch this video to see Zippin in action.
My Feedback - It is a combination of Tech, It could be weight sensors + RFID + Vision. One key takeaway is to look at each tech as a complementary tech. I usually see only Vision-based / RFID-based. True value comes not by replacing one with another but by bringing and leveraging the best out of all tech.

Keep Exploring!!!

April 15, 2022

Zero Shot Learning

Zero Shot Learning

My Summary 

  • Extract Attributes from Data (Images - Edges, Corners, Contours, Fetaure vectors)
  • Textual embedding or feature vector
  • Using this Classify known or unknown Class

Zero-Shot Learning - Feature / Attribute extraction and prediction based on those features of known class and heard features of unknown class

Feedback - Good concept, For all these cases we need reasonable data to extract, build features, and discriminative features.

Some conceptual notes/papers

  • CNN learning algorithm to learn to detect the features of the word-embeddings like stripes, animalness, and whiteness in images as well.
  • Replace the label of the image with its word-embedding during training.
  • Pre-trained word-embeddings can be downloaded and used with the object recognition CNN model.

ZSL

  • Zero-shot methods basically work by combining the observed/seen and non-observed/unseen categories
  • There are two common approaches used to solve the zero-shot recognition problems.
    • Embedding based approach
    • Generative model-based approach
  • Zero-shot classification model is trained on both seen and non-observed category images at train time

From classification - Set of X, Not belongs to X, Belongs to set ox X class vs Not belongs to X set

Zero Shot Learning 

  • Zero-shot classification refers to the problem setting where we want to recognize objects from classes that our model has not seen during training
  • Seen classes: These are classes for which we have labelled images during training
  • Unseen classes: These are classes for which labelled images are not present during the training phase.
  • Auxiliary information: This information consists of descriptions/semantic attributes/word embeddings

If I had to sum up ZSL in a few words, I’d say that it is:

  • Pattern recognition without training examples
  • Based on semantic transfer

Representation Learning

Zero-shot learning approach

  • Training is the process of capturing knowledge about the qualities.
  • Inference where the information is utilized to classify examples into a new set of classes.

Rethinking Zero-Shot Learning: A Conditional Visual Classification Perspective

  • Classifying visual features based on the classifiers learned from the semantic descriptions
  • Highly discriminative classifiers for seen classes and the generated classifiers for unseen classes to classify visual features of all classes

Zero-shot Learning with Deep Neural Networks for Object Recognition∗

Keep Exploring!!!

CNN Learning Tools - Deep Learning Tools

  • Interactive Visualization - Link
  • CNN Interactive Explorer - Link
  • Tensorflow Playground - Link
  • Embedding Projector - Link
  • Sketch RNN Demo - Link , Link1

Keep Exploring!!!

April 14, 2022

Federated Learning - How - Why - When

Summary from Quick 5 mins Tutorial

  • Client trains on data available at the device
  • Decentralized data 
  • Start with a model shared from server to clients
  • Clients which have sufficient data / Models deployed to them
  • Trained on local data and model sent to the server
  • Weights / Biases are shared with server
  • The server averages all the weights and creates final model
  • A collaborative and decentralized approach

Link - Session

Questions / Next Steps

  • Server Configuration, Tools, Package required
  • Client Configuration, Tools, Package required
  • How to train / run 
  • How the model gets updated between multiple clients
  • Similar to data synchronization need to investigate on infra needs to run

TensorFlow Federated (TFF) is an open-source framework for experimenting with machine learning and other computations on decentralized data. TFF runtimes to become available for the major device platforms

Code Example - Link

Tensorflow Federated Tutorials

Code - Link

Observations for code Walkthrough

  • Federated learning requires a federated data set
  • TFF repository with a few datasets, including a federated version of MNIST
  • Would simply sample a random subset of the clients to be involved in each round of training
  • Constructing an instance of tff.learning.Model

Research paper - Communication-Efficient Learning of Deep Networks from Decentralized Data

Key Notes

  • Decentralized approach Federated Learning.

Ideal problems for federated learning have the following properties: 

  • Training on real-world data from mobile devices provides a distinct advantage over training on proxy data
  • This data is privacy sensitive or large in size (compared to the size of the model)

Federated optimization has several key properties

  • Massively distributed, Limited communication 

There are two primary ways we can add computation: 

1) increased parallelism, where we use more clients working independently between each communication round; and, 

2) increased computation on each client, where rather than performing a simple computation like a gradient calculation, each client performs a more complex calculation between each communication round

Tensor Processing Units (TPUs) are Google's custom-developed application-specific integrated circuits (ASICs) used to accelerate machine learning workloads

From Link

  • Differential Privacy - Adding Noise to Ensure Privacy
  • Secure Aggregation - The server can only see bulk updates
  • Privacy is paramount in Federated learning
  • IID - Independently Identifiable Data
  • Privacy and Fairness are in the opposite direction

CPU vs GPU vs TPU

  • CPU - Small models with small, effective batch sizes
  • GPU - Models with a significant number of custom TensorFlow/PyTorch/JAX operations that must run at least partially on CPUs. Medium-to-large models with larger effective batch sizes
  • TPU - Models that train for weeks or months. Large models with large effective batch sizes

Federated Learning in Vision Tasks | Umberto Michieli, PhD@Uni of Padova, Intern@Samsung Research

My Feedback - let's collect minimal data and build models, Before we start to run, let's learn to crawl and walk :)

Keep Exploring!!!

April 12, 2022

How do you succeed in building impactful Data Science Use cases / Solutions ? Beyond Kaggle things to Learn ?

How do I find the most impactful use cases and have quick wins? Some guidelines / potential questions to give you the perspective.

I have participated in Kaggle and achieved a good ranking. I have a good understanding of Data Science, Let's build solutions. If all you have is a hammer, everything looks like a nail. Let's see beyond Kaggle what things we need to understand.

Impact #1 - What are the current challenges / business problems ? Identifying impactful / Potential Ideas ? 

Solution - Collaborate work with your business to understand, and get their vision, and priorities. Your use case has to be aligned with business needs / current challenges they are solving. A measurable ROI will always help to prioritize and deploy it to production.

ML Applicability #2 - Is this a Data Science use case, Does this need to change/introduce a new process, introduce new touchpoints, or is it a data or data science problem or Insights

Solution - Apply your domain lens, Data science lens, and take a transparent decision. Don't over-engineer for sake of it. If it makes sense do it.

Data Availability and Readiness #3 - If the first two parts are true, you spot problems, you see the feasibility of data science, evaluate what minimum you can build with the available data

Solution - Work with your Data/BI team, partner to build the required data for your MVP solution. The gap between reality vs expectations, What more data do you need to add more, integrate into the system you will get the clarity in this step.

You need to potentially collaborate with the business, product, and data team effectively to spot a successful opportunity. A lot of collaboration, and teamwork to spot the best use cases. Apply these questions and spot your opportunities.

Kaggle and other learning platforms work on the aspect of Feature Engineering, Model building, Beyond Kaggle this is the reality you need to look to apply Data Science in practice. Data science is #Teamwork. You need multiple lenses and participants to work to build impactful use cases.

Feel free to add other questions/guidelines as well.

Keep Exploring!!


April 02, 2022

My Perspectives of IT and Business Team Collaboration

If all my ideas have worked I would have climbed a few steps more. For the things it worked, Why it works? Why does it take so long to sell an idea? Does collaboration really work in action vs wishes of leadership expectations? To understand I wanted to look back at some paths in my history.

Sometimes when we look back we know why certain initiatives took so long, Why it works the way it works. This goes back to my Microsoft days XBOX supply chain Team. I was working with Program Management, Product Management, Support, and QA Team. The Product Management Team works closely with the Business Team.

Every Team has its own priorities.

  • Product management - Support Release Xbox, Xbox360 new type consoles with required code changes
  • Business - Setup new plants, identify new vendors, reduce Red Light Repair issues, Increase Warranty
  • Support Team - Reduce the number of customer issues
  • IT Team - Support all the priorities for business / qa / features etc

One issue of the customer writing an email about the warranty in the system is not correct. After a few executive-level escalations. It boils down, We spot there are issues with the way we store. To sort out the issue we provide a free warranty.

When I moved to Amazon, the Initial few days I was listening to another Team debating a similar workflow of repair order flow. I was thinking that everywhere edge cases are the big discussion items.

As we go along keep fixing, and adding new features. This system was one good enough system that tracks cradle to death of Xbox. Manufacturing, shipment, repair, fulfillment, sales, warranty, refurbishment, scrap. Everything was there about the console.

Every time when I hear these in JDs / Ecom Supply chain / Repair functional roles. I feel long back we had done all this as an in-house product. 

The core of it is warranty tied to a customer is a much better approach than a warranty mapped to a console. The order of transactions when they are out of sequence is created out of sequence status and we could keep track of update sequence vs delayed delivery of transactions.

I was able to work with my mentor Roji to build a prototype. It took so long release over release to recommend it to put in production. It had data migration, and a core engine but overall the changes were worth it. After a year when there were no priority projects, An initiative like that picked up this item. At least I didn't see any other announcement of a free warranty extension :) post-implementation.

I was wondering why did it take so long, Idea is necessary, we know dirty records in the system due to the sequence of transactions. There is effort and impact. The priorities across each function, business vs selling / pushing new ideas across functions take time.

What other options could have made it work?

  • If each function thinks about its own priorities it is not effective collaboration.
  • Sometimes when we solve a problem we need to think beyond fixing the current fire.
  • Everything is driven by a cost center. Fix now, Move on let's check later. The perspective of how the next customer should not go through the same issue needs a collective lens, not a function-based
  • Innovation in a way is looking beyond daily functions and seeing what matters more from a customer perspective
  • Keeping every function busy, planning back to back new items vs slow and steady everything has its own tradeoff/results
  • Sometimes even pushing idea visibility with title / connecting with leadership helps
  • If every team thinks from a customer point of view there would be more consumer-focused collaborative efforts than thinking based on individual function priorities.

The true essence of collaboration needs closer coordination, understanding, and planning across functions with customers as the epicenter of focus. 


Keep Thinking!!!