"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

July 10, 2021

Technology learning

 Technology learning - Sometimes we overrate what we don't know. The fundamentals remain the same. Many times we do not connect past learning's. Many times Spark, SQL Server lessons we look through conceptually, examples, Implementation. Making data immutable RDDs etc..I liked this comparison - "Keep in mind spark uses memory much in the same way as sql server uses the buffer pool by storing frequently used objects in memory it reduces overall I/O and improves performance in large joins, sort and aggregates contrast this with a traditional hadoop based architecture which relies heavily on writing data out to disk between steps." Every concept technical maps as an advancement or some sort of limitation which existed in place. We need more connected learnings!!!



No comments: