Big Data and SQL Journey

I have been a silent observer of Big Data Journey.

• In 2010 - Ran SQL Queries on RDBMS for Committed Data
• Entity Framework came into the picture, heated debate Stored procedures are no longer needed
• Hadoop came, I queried on HBase, Hive for the Real-time / Analytics queries for Current Data and Historical data
• After a few years now I see the queries in Spark SQL and KSQL for Streaming Passing Data
• SQL queries are shifting all the way from Database - Real-time - Real-time Stream Querying
• SQL Skills are coming to every layer of the data processing stack

Querying now goes for - incoming data, passing data, current data, historical data

• Kafka SQL - SQL for Incoming data
• Spark SQL - SQL for Passing data
• HBASE - SQL for Real-time data
• HIVE - SQL for historical data

All Hail SQL!!!

Happy Learning!!!