Migrating To A Cloud Data Warehouse

Introduction

OVERVIEW

For most companies today the attraction of cloud computing is too tempting to ignore and one of the areas that is high priority is analytics. Many companies are looking take advantage of new technologies available on the cloud for real-time analytics, machine learning and analysis of huge volumes of multi-structured data, to add to what they already know. However, given that their core analytical systems are data warehouses and data marts sitting in their data centres. it’s not surprising that migrating these systems to the cloud is high on the agenda.

This 1-day course details what is involved in migrating data warehouse and data marts to cloud based Analytical Relational DBMSs such as Amazon Redshift, Google Big Query, Microsoft Azure SQL Data Warehouse, IBM DB2 Warehouse on Cloud, Oracle Autonomous Data Warehouse, Snowflake and Teradata Vantage on Cloud.


What You Will Learn

  • What should be in a Data Warehouse migration plan
  • Pre-migration preparation
  • Defining a data warehouse migration strategy
  • The risks that can threaten the chance ofsuccess and how-to de-risk a project
  • How to migrate a data warehouse schema, dataand ETL jobs and security while minimisingimpact on business users
  • Understanding SQL differences
  • Whether you should you migrate an existingdata warehouse ‘as is’ or try to make changesduring migration?
  • Existing data warehouse DBMS specifics youneed to know about in a migration
  • Migration tools to help you

 

MODULE 1: The Data Warehouse Migration Challenge

  • Why Migrate Your Data Warehouse to the cloud?
    o BusinessCase
    o Technology
  • Planning for Data Warehouse Migration
  • Pre-Migration Preparationo Roles and responsibilities
    o Skills and training
    o Assessing your existing datawarehouse
    o On-premisespreparation
    o Cloud preparation
  • Defining a migration strategy
  • De-risking your data warehouse migration project

 

MODULE 2: Design and Performance considerations in a DW Migration

  • Defining schema migration scope
  • Preparing for schema migration
    o Options for migrating existing data warehouse schema to the cloud
  • Options for migrating existing data mart schema to a cloud-based data warehouse
  • Performance options on your target cloud- based data warehouse
  • Existing data warehouse database design migration specifics

 

MODULE 3: Migrating Data, ETL processing and Loading

  • Migrating your historical data to a cloud-based data warehouse
  • Migrating your ETL jobs to a cloud-based data warehouse
  • Migrating load processing to a cloud-based data warehouse
  • Existing data warehouse database data, ETL and loading migration specifics


MODULE 4: Data Warehouse Security and Operations Migration

  • Beyond SQL DDL and DML migration
  • Azure, AWS and GCP security overview
  • Database authorisation and access control
  •  Automating migration of privileges from an existing system
  • Dynamic Data Masking
  • Connecting to cloud-based data warehouses
  • Data Encryption in cloud-based data warehouses
  • High Availability (HA) and Disaster Recovery (DR) in cloud-based data warehouses
  • Existing data warehouse database security migration specifics

MODULE 5: Migrating Data Visualisation and Reporting

  • Migrating reports and visualisations – the challenge
  • Minimising the impact of DW migration on BI tools and reports using data virtualisation
  • Identifying high priority reports to migrate first
  • Migration incompatibility issues that can impactreports and visualisations
  • Testing report and dashboard migration to yourcloud-based data warehouse
  • Migrating BI tool semantic layers to your cloud-based data warehouse
  • Conclusions and recommendations

MODULE 6: Minimising SQL Differences during migration

  • SQL issues that can occur when migrating to a cloud-based data warehouse
  • SQL Data Definition Language (DDL) differences and workarounds
  • SQL Data Manipulation Language (DML) differences and workarounds
  •  SQL Data Control Language (DCL) differences and workarounds
  • Extended SQL differences and workarounds

MODULE 7: Cloud Data Warehouse vendor and 3rd Party Migration tools

  • Cloud Data Warehouse vendor migration tools
  • Third party data warehouse migration tools
  • Third party data warehouse automation tools

MODULE 8: Beyond Data Warehouse Migration – moving to a modern DW on the cloud

  • Beyond data warehouse migration – new capabilities on cloud-based Data Warehouses
  • Modernising your ETL processing in a cloud environment
  • Integrating you’re your cloud-based Data Warehouse with data science technologies on the cloud
  • Integrating live streaming data into your cloud- based Data Warehouse
  • Creating a logical data warehouse using data virtualisation

 

+ Read more

Educator:

MIKE FERGUSON

Managing Director, Intelligent Business Strategies Limited

Mike Ferguson is Managing Director of Intelligent Business Strategies Limited. As an independent IT industry analyst and consultant, he specialises in BI / analytics and data management. With over 40 years of IT experience, Mike has consulted for dozens of companies on BI/Analytics, data strategy, technology selection, data architecture, and data management. Mike is also conference chairman of Big Data LDN, the fastest growing data and analytics conference in Europe.  He has spoken at events all over the world and written numerous articles. Formerly he was a principal and co-founder of Codd and Date Europe Limited – the inventors of the Relational Model, a Chief Architect at Teradata on the Teradata DBMS. He teaches popular master classes in Data Warehouse Modernisation, Big Data Architecture & Technology, Centralised Data Governance of a Distributed Data Landscape, Practical Guidelines for Implementing a Data Mesh (Data Catalog, Data Fabric, Data Products, Data Marketplace), Real-Time Analytics, Embedded Analytics, Intelligent Apps & AI Automation, Migrating your Data Warehouse to the Cloud, Modern Data Architecture and Data Virtualisation & the Logical Data Warehouse.

Read more

Migrating To A Cloud Data Warehouse

Theme:
Data Control
Educator:
MIKE FERGUSON
Language:
English
Duration:
1 day
Location:
Remote training

Koulutusohjelmalla / kurssilla ei ole aktiivisia aloituspäivämääriä, jos olet kiinnostunut kurssista ota yhteyttä.

Contact

Please contact:

 

  • This field is for validation purposes and should be left unchanged.

 

More than one participants from same company?

We also organize company-specific courses.

Course for company

You might be interested in

+