Technology / Job Trends

It appears like boom but many Skills will Converge in the next 5 years.
10 Years Back

• OLTP - Real-time
• OLAP - BI

Past 5 Years to till Date

• Real-time OLAP - Columnstore Databases - Vertica
• Data Aggregation - Across SQL, NoSQL, Data lake
• In-memory Real-time machine learning - Spark
• Data Science - Forecasting, Clustering, Anamoly, Churn, CLV, Recommendations - Built on top of Data lakes
• Features Stores - Evolving / Embracing products - Feast, Hopsworks

Now to Next 5 Years

• Real-time analytics - Translytics (Microservices + Shard Data) - Newer forms of data store / Analytics
• Dockerized + Kubernetes + KfServing - Everything as API
• Leverage more analytics at every stage of data pipeline - KSQL (Kafka SQL, Spark ML
• Unified FeatureStores to access - Realtime, Trends, ML Features, More and more tools will automate everything

The gaps between Database Developer, BI Developer, Data Scientist will start to overlap and create a new set of roles.

Interesting Read - ML feedback 

Keep Thinking!!!