Transcript Slide 1

Realtime BI를 위한
실시간 데이터 통합 방안
백철호
기술이사
TSG
DNISoft Co., Ltd.
Agenda



Data Integration Quadrant
Real Time Business Intelligence
Real Time BI Infrastructure
Data Integration Quadrant
Analysis
Real-time
Batch
Operation
Data Integration Quadrant
Analysis
ETL
HUB
Real-time
Batch
Sync
EAI
Migration
Operation
ETL – Basic Building Blocks


Code-generation & Engine-based
Performance







Multi-thread & Multi-task
Pipeline & Partition
DBMS bulk-load
Extensibility
Transformation
Metadata Management
Data Cleansing
ETL - 특성




Data integration is the goal; user interface
enables making dramatic changes to data
that is used by other applications
Requires scheduled loads of bulk data
from one database to another
Transformations of data is a key function,
data needs to be aggregated, and joined
with other data to create new applications
Metadata is important, as definitions of
metrics are constantly in flux
EAI – Basic Building Blocks

Communication Model
 Sync
: request/reply, one-way, polling
 Async : message passing,
publish/subscribe, broadcast

Method of Integration
 Messaging

& Interface
Middleware
 MOM,
DOT, TPM
EAI - 특성




Business process integration is the goal; EAI
user interface enables building collaborative
processes across applications
Requires real-time transfer (from one application
to another), of application messages (i.e.,
generation of a purchase order)
Transformation of messages is a key component
because applications use different message
formats
Metadata requirements are not as important
because message transformations are not as
complex and do not change like the data
transformations required for data warehousing
ETL-EAI 통합
ETL +
EAI
Analysis
Real-time
ETL
ETL
Batch
EAI
Operation
Real Time BI
What It Is
We define Real Time BI as:
Improving speed and quality for decision ,
through managing process exceptions and opportunities,
by delivering contextual, right-time information
for continuous business process improvement.
Process Exceptions and
opportunities

Real Time BI allows you to monitor your key performance
indicators (KPIs) in reaction to change or events, either:
 unexpected:
errors, outages, new orders, competitor maneuvers,
surges in volume, rate changes, etc.
 or planned: policy changes, adjacent process changes, marketing
promotions, mergers & acquisitions, etc.

Monitored events can be:
 abrupt,
requiring immediate response,
 or gradual, making them hard to detect;
 threats,
disrupting revenue or increasing costs,
 or opportunities, offering upside within a limited window.

Business and system event data is captured in real-time,
with zero latency.
Contextual Information

Real Time BI places monitored activities in context:
and seasonal context – what is normal for right now?
 Business context – is this critical? where are we in the process?
 Organizational context – who cares about this development?
 Historical

Real-time data without full context is like knowing your position
but not your direction or velocity.
Inventory is
dropping towards
threshold – send an
alert?
600
500
400
Inventory
Weekly Avg Inventory
300
Scheduled Deliveries
200
100
0
8:00
9:00
10:00
11:00
In context,
inventory is above
normal and
delivery of a new
order is imminent.
Right-Time Information

BAM filters and processes the real-time data for timeliness
and relevance so that only right-time information is
delivered.
 Timing
The timing of alerts and dashboards must match the
frequency of the “appropriate-response cycle”:
Value of Information

is everything to avoid “business-system thrashing.”
Payroll Processing
Production Scheduling
Knowledge Management
Annually
Quarterly
Monthly
Daily
Hourly
Frequency of Information

BAM reports an event only when and where it will have a
directly-actionable impact on the business process.
Continuous Business
Process Improvement
 Real
Time BI enables you to act in order to close the
loop, increasing business agility and responsiveness.
 It
is not the strongest of the species that survives, nor the
most intelligent; it is the one that is most adaptable to change.
Charles Darwin
 KPIs
are derived directly from the execution of the
processes themselves, ensuring accurate targets.
 Business processes are continuously extended, tuned,
and modified in reaction to new patterns of activity.
Real Time BI
What It Means

In Finance:



In Logistics:


Predicting and preventing late orders before they happen.
In Insurance:


Optimizing order provisioning and activation processes by shifting resources on the fly.
In CPG/Retail:


Rerouting in-transit vehicles to handle new orders for maximum load factors.
In Telecommunications:


Monitoring settlement in real-time and addressing problems well before close.
Finding patterns of money laundering across millions of transactions.
Monitoring liquidity and solvency in real time as capital markets change.
In Homeland Security:

Alerting airport security to suspicious itineraries as travelers check in.
Real Time BI Infrastructure
Comprehensive Integration Architecture
BizTalk Integration Server (EAI)
Portal
BizTalk
BPM
Business
Process
Management
(BPM)
• Management
• Monitoring
Informatica PowerCenter RT (ETL)
Points of Integration
Data
• INFA DW
Warehouse • Analytic App’s
PA
• Reporting
• OLAP
Reduce development time (design time integration)
 Reduce operating expense (run time integration)

Real Time BI Infrastructure
Apps
Informatica
Op’l Data
Store
Informatica Alerts
ETL
Databases
Data
Warehouse
BizTalk Manager
Documents
BizTalk Workflow
Legacy
BizTalk
Integration Server
INFA Analytics
Real Time BI Infrastructure
Software Component
Application Integration
Business Intelligence
Data Integration
Systems Monitoring
Business Process
Monitoring
Utility for Real Time BI
Provides deep connections into underlying application systems and
manages the stream of messages that flow among them.
Provides the framework for real-time monitoring and analysis, and
analytic tools to calculate and display key business performance
indicators.
Offers a historical/trend analysis perspective, which helps provide the
context for action — (e.g., how significant is the current real-time
value compared to historical trends?).
Integrates systems management data from a variety of sources,
interpreting the relationship between that data and the business
processes it impacts.
Provides an overall business process framework so that events can
be analyzed and responded to in the context of the “state” of the
business process.
Real Time BI Infrastructure
Technical Feeds
Business Feeds
Event Absorption Layer
New Events
Valid Event(s)
Event Processing and Filtering
Data Analysis
Real Time
Tuning
Modeling
Event Delivery and Display
Logical Architecture
Technology Components
Real Time BI Infrastructure
Informatica PowerCenterRT provides
context through sophisticated data
integration and retrieval.
The BizTalk provides modeling of
enterprise processes at the business
level for business context.
The BizTalk Integration Platform provides
application integration and access to all your
business data in real-time.
Informatica PowerAnalyzer provides rich
analytics to deliver actionable information
to the right person at the right time.
The Real Time BI infrastructure provides full interoperability between all components and
functions, common management tools, and consistent meaning through shared metadata.
Real Time BI Infrastructure
BizTalk
Process Integration
Your IT Assets
The Integration Server accesses the
ODS as the table of record for
transaction validations and lookups
Real-time events are
subscribed by
PowerCenterRT
and become input to
the ETL process
The Integration Server calls an
ETL service to execute a batch
load or transformation
Data Integration
PowerAnalyzer presents righttime information via dashboard
and alerts
BizTalk Server for Real Time BI
BizTalk® 2004 ?








기업 전산 환경을 위한 Integration 솔루션
XML/웹 서비스 표준 기반으로 제작
Visual Studio.NET 통합 개발
오피스 솔루션을 이용한 View & Analyze
이기종 시스템들의 통합 및 연계 (EAI)
협력업체 및 파트너 통합 및 연계 (B2Bi)
Biz. Process Management (BPM)솔루션
통합 인증과 확장성의 제공
Standards

XML웹 서비스 지원은 BizTalk 2004 기능의 핵심


XML foundation






WS-I basic profile, WS-Security plug-in
W3C XML 표준 기반의 스키마
W3C XSLT 기반의 스키마 매핑
Business Process Execution Language (BPEL)
Microsoft, IBM, BEA : 자유로운 Biz.프로세스 호환성
비즈니스 프로세스를 위한 최선의 모델
기술정의서(Specification)가 OASIS에 제출됨
Business Process Interop
pure BPEL4WS
BPEL4WS
Microsoft Orchestration
Runtime optimized for the
.NET Framework
3rd party runtime engine
BizTalk End-To-End Architecture
Other
Apps
Orchestration
Activation & Instance Management
Administration
Correlation & Content-based Routing
Deployment
Business
Intelligence
MessageBox
Process
Management
Trading Partner
Management
Reporting
Monitoring
Message Pipeline
Decode
Encode
Decrypt
Encrypt
Authenticate
Parse
Sign
Serialize
Extract
Properties
Transport Handlers
HTTP
SOAP-RM
MQSeries
MSMQ
SAP
….
BizTalk Solution Flow
Universal MessageBox
Architecture







SQL Server 기반의
Scale-out 확장성 제공
Pub/Sub아키텍처
Stateless servers
대용량 메시지 처리
빠른 메시지 처리와
라우팅
플러그 방식 어답터
보안과 감사 기능
Orchestration
Activation & Instance Management
Correlation & Content-based Routing
UNIVERSAL MESSAGEBOX
Message Pipeline
Decode
Encode
Decrypt
Encrypt
Auth
Sign
Parse
Extract
Serialize Properties
Adapters
HTTP
Web
MQSeries
Services
MSMQ
Adapters
….
Authentication Trust
Host 2
(SvcAcct2)
Host 1 (SvcAcct1)
Host 3 (SvcAcct3)
Transport
Decrypt
Transport
Parse
인증되지 않은 호스트의
메시지 SID/PartyId 를
차단하는 역할
Resolve
Party
Serialize
PartyID, Guest
Message메시지가 없는
Box 메시지를 차단
Sign
Encrypt
Scaling Out Processor
Machines
Network Load Balance
Machine
Host
Machine
Host
Machine
Host
SQL Server
Message box
Stored procs
Data (messages, subscriptions, etc.)
Machine
Host
Scaling Out Storage
Network Load Balance
Machine
Machine
Host
Host
SQL Server Machine (Master)
Machine
Machine
Host
Host
SQL Server Machine
Message box
Message box
Stored procs
Stored procs
Data
Data
© 2003 Microsoft Corporation. All rights reserved.
This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.