Transcript Double-Take ® SHARE 5.0

Double-Take® SHARE 5.0
Technical Overview
Multi-platform real-time change-data-capture
Last updated: February 8th 2012
Leaders Have Vision™
GA October 2011
visionsolutions.com 1
Double-Take® SHARE 5.0
Real-time DBMS level replication with transformation
Move data from where it is to where it needs to be…
Change data capture (CDC) – data captured real-time
Column level selection – granular data selection
Data manipulation – flexible data transformation
Heterogeneous – multiple source/target DBMS/OS support
Semi-synchronous delivery – Fast and reliable delivery
Point-to-point architecture – proven to be most flexible architecture
Replication Schema Language (RSL) – flexible data management
Director - graphical modeling console
Enterprise Data Movement Model (EDMM) – replication schema
MonCon – graphical monitoring console
Request Scheduler - Automated data synchronization
Non intrusive – does not impact existing business applications
Source only licensing – affordable and flexible licensing model
No programming – eliminates the need for expensive custom code
Multiple Use – data integration, workload balancing,
audit databases, offload query, data warehouse loads
more..
Helps any DBA become a multi-DBMS expert
DBMS = Database Management System
Over 500 licenses sold to over 300 customers
Leaders Have Vision™
visionsolutions.com 2
What Is Double-Take SHARE*(1) ?
DATA WAREHOUSE LOAD PROJECT
Examples of Double-Take Share Projects
eCommerce (web site)
Back Office ERP
HP-UX Oracle
IBM i, DB2/400
DTS
DTS
Customer Orders
Payment Details
Data Warehouse
Windows, SQL Server
Sales data
(all regions)
DTS
Product Catalogue
Price List
APPLICATION INTEGRATION PROJECT
OFFLOAD QUERY & REPORTING PROJECT
Regional sales data
Double-Take Share is an easy to use real-time, multi-platform
change data replication tool.
DTS
DTS
Double-Take Share replicates columns in changed rows in real
time between MS SQL Server, DB2/400, DB2/UDB, DB2/zOS,
Oracle, Informix and Teradata.
Data columns can be easily mapped and transformed while
replicated (no programming required).
This tool is typically used by development to greatly simplify
internal projects that require real-time movement of data.
Reporting database
Windows, SQL Server
*(1) Formerly known as Vision Replicate1
Leaders Have Vision™
visionsolutions.com 3
How Does Change Data Capture Work?
Administration & Monitoring
(Director, MonCon & Console)
Source
Target
Listener
Listener
(Agent)
(Agent)
LAN / WAN
XML
Metadata
Kernel
XML
Metadata
Kernel
(Engine)
(Engine)
Data path
Replication
data path
Source
Metabase
Copy
data path
(periodic &
initial synch)
Change
Queue
Target
Metabase
Change
Selector
(Log Based)
(Triggers/journals
/logs)
Change Data
Capture (CDC)
Source
Data
Leaders Have Vision™
Target
Data
visionsolutions.com 4
Transforming Rows With Column Mappings
Source Host - server connected to the TCP/IP network
Target Host - server connected to the TCP/IP network
Eg. IBM i server
CUSTPF
E.g. Windows server
Database Server
Database Server
E.g. DB2/400
E.g. SQL Server
File / table mapping
Field Name
CUNUM
CUCLM
CUNAM
CUAD1
CUAD2
CUAD3
CUAD4
CUTEL
customer_master
(SQL table)
(Physical file)
Data Type
Numeric (10)
Numeric (10,2)
Alpha-numeric (20)
Alpha-numeric (25)
Alpha-numeric (25)
Alpha-numeric (25)
Alpha-numeric (25)
Numeric (10)
Column Name
Customer number
Customer name
Customer address line 1
Customer address line 2
Customer address line 3
Customer address line 4
Customer address line 5
Customer telephone
Customer credit limit
Data Type
Numeric (10)
Alpha-numeric (10)
Alpha-numeric (25)
Alpha-numeric (25)
Alpha-numeric (25)
Alpha-numeric (25)
Alpha-numeric (25)
Numeric (10)
Numeric (10,2)
Field / column mappings
Leaders Have Vision™
visionsolutions.com 5
Manipulating Data
Target Column Expressions
Fast way to specify simple and medium complexity data
manipulations
Join Tables
It’s possible to join tables together and build a
new table on the target.
Eg. Join the invoice header table with the
customer master table to get address columns
Replication Scripting Language (RSL)
All data manipulations are stored in a easy to read
scripting language, which can be exported, edited
and imported for advanced manipulations by
power users. Also a big time saver in
sophisticated enterprise environments with lots of
tables.
Leaders Have Vision™
visionsolutions.com 6
Double-Take Share Components & Monitoring
EDMM
All data replication rules including data mappings and
data manipulations are stored internally using a
scripting language in an Enterprise Data Movement
Model.
MonCon
The monitoring and control interface is one of several
ways to monitor the status of replication in real time.
MonCon lets you do this locally through a graphical
monitor. There is also WebMonCon that allows
monitoring through a web browser.
Leaders Have Vision™
visionsolutions.com 7
Flexible Replication Topologies
Rep1
Rep1
One Way
Cascade
Rep1
Rep1
Distribute
Consolidate
Rep1
Rep1
Two Way
Leaders Have Vision™
Bi-Directional
visionsolutions.com 8
Supports Most Databases and Operating Systems
8i – 11g
2000 - 2008
IBM i/OSV5R4 – V7R1
z/OS 1.8 – 1.11
12.5 – 15.x
AIX 5.2 – 6.1
Solaris 2.8 – 2.10
Double-Take SHARE
HPUX 11i – v3 64bit
5.0
DB2/IBM I V5R3 – V7R1
DB2/ zOS 8.1 - 9
DB2 UDB 9.1 – 9.5
2000 – 2008
(32 and 64 bit)
V2R6.2bf – V13bf
DS 9.x – DS 11.x
Red Hat Rel 3 - 5
SuSe (x86) 9.2 - 10
Flat File target
Leaders Have Vision™
visionsolutions.com 9
Double-Take SHARE 4.0.8 New Features
Name change from ‘Vision Replicate1’ to ‘Double-Take Share’
New Platform Support
Sybase 15.x
UDB 9.1 and 9.5
UDB 9.7 as target only
DB2 9 for z/OS
Informix 10.x and 11.x
Oracle Change Selector Performance
Now uses memory to reduce I/O
Change Selector rotating logs parameters
New parameters to control log rotation
GA August 16th 2010
Leaders Have Vision™
visionsolutions.com 10
Double-Take SHARE 5.0 New Features
1. Performance
1.1 Log Based Capture For MS SQL Server 2008
2. Packaging and Documentation
2.1 Rebranding to Double-Take SHARE
3. Data Transformation
3.1 Expressions Now Support Unicode Data Type
3.2 DB2/400 32K Character Length
3.3 Ten Character Flat File Delimiters
4. RDBMs & Java
4.1 Java 6 Support
Four Areas Of Focus
Six* New Features
* Some of these can be broken down into more sub features
GA October 2011
Leaders Have Vision™
visionsolutions.com 11
Double-Take Share Customer Story
AGC Automotive
BI-DIRECTIONAL APPLICATION INTEGRATION
AGC Automotive is a global company which
mainly produces and sells automotive glass
for new vehicles and aftermarket
replacement glass
System i
Enterprise
Unit
Shop Floor
Unit
Double-Take Share replicates data bidirectionally between the enterprise LPAR
which runs Mapics and Future3 and the shop
floor LPAR which runs in-house applications.
This interface helps both business units know
what the other is doing in real time
Double-Take Share replicates data bidirectionally between the in-house applications
on System i and two MS SQL Server
databases in two Machinery Units (in different
buildings). Any product defects detected result
in updates to the MS SQL Server databases
and this data is replicated back to the shop
floor database
Leaders Have Vision™
LPAR1
LPAR2
Machinery
Unit 1
Machinery
Unit 2
Windows SQL Server
visionsolutions.com 12
Customer Story – Millennium BCP - Luxembourg
APPLICATION INTEGRATION PROJECT
Online Banking
IBM System i DB2
Microsoft SQL Server
1 Customers enter new
1.
banking transactions on line.
They get captured in SQL
Server
22. DoubleTake Share
replicates the
transactions
in real time to
DB2/400
Bi-directional replication
5. Customers view
5
processed transactions
on-line
44. Double-Take Share replicates
the processed transactions back
to SQL Server in real time.
Leaders Have Vision™
3
3. A back-office
batch application
processes incoming
transactions and updates
data.
visionsolutions.com 13
Customer Story – Duke Realty - USA
DATA WAREHOUSE LOAD PROJECT
Real Estate
Production System
Double-Take Share
Data Warehouse System
Real time CDC replication
with transformation
IBM System i DB2
MS SQL Server 2005
Tip: Customer migrated from Integrator 2.1
and was impressed with the extra performance
and functionality of Replicate1
Business intelligence
Leaders Have Vision™
visionsolutions.com 14
Customer Story – Pinnacle Entertainment Group - USA
DATA WAREHOUSE LOAD PROJECT
Gaming
Casino 1
Casino 2
Casino 3
Casino 4
Casino 5
Casino 6
IBM System i
DB2
IBM System i
DB2
IBM System i
DB2
IBM System i
DB2
IBM System i
DB2
IBM System i
DB2
Double-Take Share
Real time CDC replication
with transformation
Customer loyalty
Amounts paid
Amounts won
Time at the table
Time at the machine
Single Data Warehouse Database
Windows 2003 Cluster
MS SQL Server 2005
Business intelligence
Leaders Have Vision™
visionsolutions.com 15
Customer Story – Red Wing Shoe Company - USA
OFFLOAD QUERY & REPORTING PROJECT
Manufacturing
Production System
Double-Take Share
Many cost effective tools available
on MS SQL server
platform for query reports
Offload Query System
Real time CDC replication
with transformation
Query reports
Data Warehouse load
IBM System i DB2
Lawson M3 (Movex)
Reduce CPU and I/O overhead
on production system
improve user response times
Leaders Have Vision™
MS SQL Server 2005
Data is already partially
‘scrubbed’ and available
for loading data warehouses
and data marts without
performance impact on
production system
visionsolutions.com 16
More Business Uses
•
LOAD DATA WAREHOUSES - Extract data from different OLTP databases,
scrub it and deliver it to the data warehouse platform, ready for loading.
•
MIGRATE ERP DATABASES – Map current ERP schema to new ERP version
or new ERP on same or different platform and migrate data without downtime.
•
INTEGRATE APPLICATION COMPONENTS – Develop applications on different
platforms and share data between them in real time.
•
OFFLOAD QUERY – Create a Query database on a different partition or server
or platform. Avoid running Query over production data, improves performance
•
CREATE TEST DATA – Extract realistic test data from production to test
environments.
•
CREATE LIVE AUDIT DATABASES – Extract log of changes to critical database
tables and create a live audit database.
Leaders Have Vision™
visionsolutions.com 17
Partial Customer List
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Dorel (Netherlands)
Disney Corporation (USA)
Milenium BCP (Luxembourg)
Alabama DOT (USA)
Anadigics (USA)
Ethan Allen (USA)
RCN Corporation (USA)
JD Irving (USA)
Reliant Insurance (USA)
Koopman International (Netherlands)
Compass Group (USA )
AIC Group of Funds (USA)
Cooley Godward (USA)
Georgia Pacific (USA)
Old Mutual (South Africa)
Johnson Matthey (UK)
Allianz (UK)
Leo Pharma (Denmark and Ireland)
Enstar Insurance (UK)
Red Fuel Cards (UK)
Rexel Electrical Supplies (UK)
Irish Dairy Board (Ireland)
Leaders Have Vision™
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
IBM Ecuador (Ecuador)
Insight Communications (USA)
JR Cigars (USA)
Kingston Technology (USA)
Mohawk Fine Paper (USA)
Massimo Zanetti Berverage (USA)
Northwest Natural Gas (USA)
Ryerson Coil (USA)
Parsons (USA)
Vanda Group (USA)
Vertex Business Systems (USA)
Duke Realty (USA)
EOG Resources (USA)
Belgium Ministry of Defense (Belgium)
Groupama Insurance (Spain)
Ecclesiastical Insurance (UK)
IFDS (UK)
iForce (UK)
La Repubblica (Italy)
Wyeth Nutritionals-Pfizer (Ireland)
MIO (Sweden)
ESAB (DK, UK, SE)
Tamro (Finland)
visionsolutions.com 18
Thank you
Leaders Have Vision™
visionsolutions.com 19