ETL Testing
Reposting from my Answer from SQA stackexchange
Sharing my learning's on ETL Testing
- How errors are logged in case of failures in pulling data. Example - Network connectivity is lost while pulling data, does the job retry ?
- Is it possible to configure toggle select only few tables to pull data to be pulled by ETL jobs
- Test with real production data. Typically volume of data in BI system is Tera Bytes of Data
- Look for Data Quality Issues - How Application handles nulls, blank data, Duplicate data
- Slowly Changing Dimensions - How Changes to dimension tables are handled, Depending on type SCD 1, SCD 2 you can decide to test it the way it works
- Manually when you have failure in pulling data in one of tables, How does it behave. Example - from source system one of table is dropped. SSIS package is not updated. In this scenarios how error is handled
- Adventures with Testing BI/DW Application:On a crusade to find the Holy Grail - This is an awesome article and summarizes 360 degree view of BI testing
- SSISUnit
- Reporting Services Unit Testing Framework
- Unit Testing Report within Reporting Services: My Theory
- How to test SSis package and what are the things i need to test it ?
- Just What Are Cubes Anyway? (A Painless Introduction to OLAP Technology)
- Load Testing Reporting Services
- SSAS Cube Testing
- Load Test Your SSAS Instance
- What are some real world strategies for testing ETL and data warehouse applications
- QA your own ETL process – no more, no less
- Load Testing BI Solutions
- Good Read - Architecting Data Warehouse
- Considerations for using Snowflake schema : Star schema vs Snowflake schema
- Star & Snow Flake Schema
- Snowflake schema
- How to learn SSIS / SSAS / SSRS / Data Warehousing and start a career in Microsoft Business Intelligence
- Designing the Star Schema Database - Good Read
- SQLU SSAS Week: Dimension Design 101
- SQLU SSAS Week: Why Do I Need a Cube & How Do I Get Started?
- Creating a Solid SSIS ETL Solution
- High Performance Dimensional Data Loads With SSIS Presentation
- MDX Gotchas Presentation Materials
- ETL Framework Design 4 Part Series
- SQL Server BI Health Dashboard
- BIDS Helper
- Indexing fact tables
1 comment:
good
Post a Comment