Introduction:

Research the concepts and technology of data ETL (Extraction, Transformation & Loading) and document the process from start to finish using Microsoft SSIS (SQL Server Integration Services) as the basis of your study.

Learning Outcome(s) Being Assessed:

1. Describe the operation of a data warehouse in support of business intelligence.

2.

3.

4.

5.

Details of Task:

ETL is an important process in the construction of Data WareHouse solutions. It consists of the following three primary phases, you must research each as well as the more specific steps contained within:

- Extracting Data
o From one or more external data sources.

- Transforming Data
o Ensure consistency and satisfy business requirements.

- Loading Data
o To the resultant Data WareHouse.

Microsoft SSIS provides a collection of tools to support ETL including:

- Data Flow Engine.
- Scripting Environment.
- Data Profiler.

"SSIS also acts to glue together the various servers and engines that make up SQL Server".

You must discuss the various tools that SSIS provides and relate them to the phases within ETL. You should also provide suitable examples from case studies (such as AdventureWorks & AdventureWorksDW) to reinforce your discussions.

Guidelines:

- Correctly reference resources that you use.
- You may also wish to compare & contrast other ETL solutions.

Resources Required:

You may use the computing laboratories on the 6th & 7th floors and the university's database servers (ask the lecturer for details).

You should make use of these specific tools & resources:

- Microsoft SQL Server 2012.
- SQL Server Books Online.
- The Internet.

Extenuating Circumstances:

If something serious happens that means that you will not be able to complete this assignment, you need to contact the module leader as soon as possible. There are a number of things that can be done to help, such as extensions, waivers and alternative assessments, but we can only arrange this if you tell us. To ensure that the system is not abused, you will need to provide some evidence of the problem.

More guidance is available at:

https://www.ljmu.ac.uk/about-us/public-information/student-regulations/guidance-policy-and-process