Weekend Reading Notes

Note #1 - SQL Server Database Engine Performance Tuning Basics - Must read for every TSQL Developer
Key Learning's

• Perf counter values analysis
• Temp Db configuration
• Enable Lock pages in memory
• Interpreting Avg. Disk Sec/Read values

Note #2 - Microsoft SQL Server Versions and Editions

Key Query  - SELECT SERVERPROPERTY('productversion'), SERVERPROPERTY ('productlevel'), SERVERPROPERTY ('edition')

Note #3 - One more NOSQL DB that supports ACID transactions - FoundationDB

Note #4 - SQL Server 2014 In-Memory OLTP: Memory Management for Memory-Optimized Tables

Key Learning's

• Memory optimized Tables(MOT) reside in memory not in disks
• Steps to estimate memory for MOT
• Garbage collection of older version of records (similar to snapshot / read committed isolation levels)

Happy Learning!!!

Data Science Basics Learning Series - 2

Bayesian methods are very important concepts as part of learning. Some basic examples and simple explanations from Quora.


Read Quote of William Chen's answer to Big Data: What are the advantages of Bayesian methods over frequentist methods in web data? on Quora


Read Quote of Michael Hochster's answer to Probability: What is an intuitive explanation of Bayes' Rule? on Quora

Read Quote of Anonymous' answer to Mathematics: I have burned 200 disks and I want to make sure that they are all in perfect working order. What is the smallest size sample I could test in order to be relatively confident that 98% of all the disks are fine/burned correctly? on Quora

More Reads
How Not To Sort By Average Rating
What are the advantages of Bayesian methods over frequentist methods in web data?

Happy Learning!!!

DataScience Basics - Part I

Welcome to series of posts to learn Data Science basics. This video is a good starting material to get started

Link

Key Learnings

• Data Science term defined by Peter Naur
• How Role of Statistician differs from Data Scientist
• BI Tools vs Data Science perspectives

More Reads

• How to Think Critically VI: Bayes' Rule
• Knowing How to Change Your Mind: A Three Minute Guide to Bayesian Reasoning
• DataMind Beta Course
• R - Fiddle
• Tutorial: Basic data processing with R
• One R Tip A Day
• What method did Nate Silver use to predict US Presidential election in 2012?
• How can I use Nate Silver's methods to accurately predict future events?

Happy Reading!!!

Getting Started with Python Visualization

This post is about getting started with visualization using python. This took less than an hour to see visual data representation

Below are the steps involved for our first example

Step 1 - Install Enthought Python Distribution (EPD) from link. Download was around 230MB, This took a couple of minutes

Step 2 - This post was pretty useful on installation on Windows

Step 3 - Post Installation below setting was done

Step 4 - The first example is from python book page 37

Step 5 - Create a new file, type the code, Save and Run it

Step 6 - Below is the output 

More Examples
Pandas timeseries plot setting x-axis major and minor ticks and labels


Happy Learning!!!

Create Dummy Files to consume diskspace - fsutil command

This post is about creating dummy files to consume disk space and mimic scenarios with reduced disk space. On windows server 2008 fsutil command was useful to create files to consume disk space

Example Usage

C:\Users\Administrator>fsutil file createnew c:\dummydata5.bat 1240171806

File c:\dummydata5.bat is created

Happy Learning!!!