"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;
Showing posts with label Data Story. Show all posts
Showing posts with label Data Story. Show all posts

January 11, 2020

Decode your personality - Social Media Unplugged

  • Google - will you everything about you. Regular search, restricted search, places visited
  • Gmail - Your friends and their locations, Your communication and type of person you are
  • Facebook - What is your social circle, your financial status from the place you live and place you work
  • Linkedin - Your average compensation can be estimated with your education, company and years of experience
  • Whatsapp - All your mood swings, emotional discussions and your relationship with the outside world
  • Mobile Number - Your average calls, the number of contacts in friends/blood relationships
  • Bank Account - Spending patterns, places you visit. Average expenses across food/shopping/travel
  • Uber - Where you traveled, What was your pattern for the last month
We do not have ownership of your data shared. There is no expiry date for the data collected. This data is good enough to decode a person.

Google Sued for Secretly Amassing Vast Trove of User Data
  • Consumer browsing history
  • Web activity data 
  • Invasion of privacy and violations
  • Storing geolocation data with its mobile apps
Today Attended Aljazeera discussion on Cambridge Analytica Scandal. (April 8th)
Founder - BRITTANY KAISER of ownyourdata 
  • 87 million Profiles were screened in facebook
  • Data science to classify/label possible persuaders
  • Leverage all their behavioral data 
  • Identify their interests (Climate change, national security, Refugee issues) based on their Facebook groups/feeds
  • Targeted Ads and convert them into positive voters / Compromise Integrity / Privacy
Sounds Scary :( :( Manipulating data



Tech Talk Link

What Swiggy knows about you?


Single vs Family, Brand Centric, More than what I could think of :(

What a Better Social Network Would Look Like
  • Make social networks nonprofits
  • Ban algorithmic amplification
  • Restrict personal data collection and behavioral advertising
  • Let a field of smaller social networks bloom
  • Stop putting white men in charge
New Age Social Media - My Perspective
Social media has to be more realistic to reflect on our life. Our daily thoughts only our first level circle immediate relationships need to know. Our social thoughts or tagged social should be reflected in the second-level circle. About education, professional it needs to reflect in the connected circles
Everything needs to be within the limits to avoid information overload. Today data is business and connections are the business value of the individual. In the long run, both businesses and consumers will lose value. Companies focused on rapid market share without ethical values will end up creating zombies than responsible citizens.

Awful AI Projects - Link

Keep Thinking!!!

September 15, 2019

The Business of Facebook


When we think everything in terms of Data. We would need to look at Data Goals, Business Goals, the story behind data.

High-Level Aggregated Metrics - What would be the data metrics in Facebook
  • Number of new users added
  • Number of new places added
  • Number of pics uploaded, Growth of data video, pics
  • Number of conversations for new users
  • Average time spent by users across ages, professions, country, ethnicity
  • Most viewed content across age groups
  • Most viewed contents across domains / Professions
  • Number of new advertisers added
  • Sale / Conversion / Influencers 
Individual User Specific Information
  • Your likes/dislikes
  • Your background, education, ethnicity
  • Behavioral traits
  • Your app usage 
Unconsciously we do reflect a lot of our interests in social media. This makes us more aligned/biased if we are suggested based on our historical data. Always keep changing your patterns of thinking, learning, experimenting. Instead of Facebook, I prefer to chose to share things in my own private blog. I don't believe pics reflect the emotions of a person. I remember the lines in Macbeth "Fair is Foul, Foul is Fair"

Your bits and bytes are tracked and recommendations are given. Always timeslice your tasks. We are here only for a limited time. Sometimes we need to create those moments by experimenting, taking our learning to the next level. This Life is precious to get carried away with selfies and pics. Look beyond and find what we can do, learn to make the world a better place.

July 04, 2019

Day #261 - Setting up Spark on my Ubuntu - Big Data Setup - Part V







Happy Data Thinking!!!

Data in Motion - Knowledgebytes


  • Streaming Data - Kafka
  • Consolidate Streaming Data and Analyze - Spark
  • Store Transactional Data Received from Streams - HBASE / RDBMS
  • Historical Data Analysis - HDFS / Map Reduce
#Knowledgebytes

June 23, 2019

Outside Retail, RFID in Smart Cities

Past few years I have looked at RFID in retail perspective - Inventory Management. We work on RFID solutions that enable real-time inventory management and improving stock efficiency by tracking
  • Restock
  • Misplaced Items
  • Replenishment Items 
RFID is a major player in Retail for Inventory Management. Millions of items are tagged and tracked using RFID based Inventory Solutions.
I had an opportunity to visit smart city solution provider. The solutions they covered were
  • Waste Management
  • Parking Management
  • Smart Lighting
  • Video Monitoring
  • Environment Management
  • Surveillance
  • Command Centre
Waste Management - The bins are equipped with volume sensors and RFID tags, They are designed with batteries lasting 10 years. They provide details when the Truck and the bin connects, the RFID event is alerted

Intrusion Detection - Sensors placed for Motion detection during the area to alert if Someone comes closer to the area

Environment Management - This is basically measuring pollutants in the air and reporting the trends/patterns

Traffic - This is more of heat maps to reflect the patterns / crowded areas

Command Centre - All the calls are routed/tracked here. Provides a lot of data on issues/queries/ complaints / accidents / reporting any incidents.

Parking - This is based on sensors placed above / below parking lots

State of Art - All of this implementation are mostly based on sensors / RFID. This visit provided a lot of insights into data collection, framework, real-time alerts of end-to-end infrastructure.

Where is Video Analytics here?
Before the visit I was under the assumption a lot of video analytics, people counting use cases would be there. Actually, most of the things are achieved with RFID, sensor-based events. Video Analytics is yet to make a mark in implementation. But down the line in the next few years, we would see a lot of video analytics on the data collected.
  • Crowd Detection
  • Use of Drones for Monitoring
  • Gender Detection from Surveillance Cameras
  • Vehicle Number Detection and Reporting
  • Face Detection and Indexing at Landmarks
  • Loitering
  • Audio-based analytics to detect gunshots/sounds/ accidents
A lot of use cases, RFID + Video Analytics will further strengthen Smart Cities Solutions portfolio.
Happy Learning!!!

June 08, 2019

Day #259 - Setting up Kafka on my Ubuntu - Big Data Setup - Part IV

Finally Setting up all Big Data Tools in my Linux Setup. Rough Steps and my reference notes




Happy Data Thinking!!!!