Transcript Session-1_HANA_Overview_and_Capabilities_v2

HANA Overview
and Capabilities
Dr. Bjarne Berg
Why In-Memory Processing?
Focus
Technology
1990
2012
Improvement
CPU
0.05
304.17
MIPS/$
MIPS/$
6083x
Memory
0.02
52.27
MB/$
MB/$
Addressable
Memory
216
264
248x
Network
Speed
100
100
Mbps
Gbps
1000 x
Disk
Data Transfer
5
620
MBPS
MBPS
2614x
124x
Source: 1990 numbers SAP AG, 2012 numbers, Dr. Berg
Source: BI Survey of 534 BI professionals, InformationWeek, 2010
Disk speed is growing slower than all other hardware components,
while the need for speed is increasing.
2
In Memory Processing — General Highlights — BWA
3. Queries are routed to BWA
by the Analytical engine
SAP BW
BI Analytical Engine
2. Indexes copied in
to RAM on blades
InfoCubes
1. Indexing and
compression
stored on a file
system
DSOs
BWA = SAP BW Accelerator
SAP HANA — In Memory Options
•
SAP HANA is sold as an in-memory
appliance. This means that both
Software and Hardware are included
from the vendors
•
Currently you can buy SAP HANA
solutions from Cisco, Dell, Fujitsu,
IBM, and Hewlett-Packard
•
SAP HANA currently indexes the data
from a variety of sources, including
ERP and BW and store the result on a
dedicated server
•
The future of SAP HANA is to replace
the databases of ERP and BW and run
these on the in-memory platform
Source SAP AG,2011
SAP HANA has the potential to
radically change the way
databases operate and make
systems dramatically faster.
The Different Editions of HANA
Looking Inside SAP HANA — In-Memory Computing Engine
(IMCE)
AAAA
Metadata Manager
Authorization
Transaction
Manager
Manager
SQL Script
SQL Parser
Disk Storage
Data Volumes
Log
Relational Engine
-Row Store
-Column Store
Calculation
Engine
Session
Manager
MDX
Volumes
Load Controller
BusinessObjects Data Services
Replication Server
Inside the Computing Engine of SAP HANA we have many different components that
manage the access and storage of the data. This include MDX and SQL access, as
well as Load Controller (LC) and the Replication Server.
Row based index
Row- vs. Column-Based Indexing (cont.)
•
As we can see, there are only 7
unique states and 3 unique
customer classes in the data.
This allows SAP HANA to
compress this data set
significantly
•
By including the Row ID in the
column-based index in SAP
HANA, the “ownership” of the
values in the index can still be
mapped back to the record
Row ID
Name
1
Jane Hansen
2
Olav Petersen
3
Peter Johnsen
4
Thomas Berg
5
John Beatty
6
Jim O'Brian
7
Jeff Pinolli
8
Carol VanZyck
9
Fredrick Davidson
10
Tone Leffler
11
Carol Hansen
12
Jim Petersen
13
Jeff Johnsen
14
Peter Berg
15
Thomas Beatty
16
John O'Brian
17
Olav Pinolli
18
Jane VanZyck
19
Tone Davidson
20
Fredrick Leffler
State
NC
TX
FL
TX
FL
NC
NY
NY
FL
CA
CA
NY
CA
FL
IN
IN
CA
FL
NC
SC
Class
Gold
Silver
Platinum
Gold
Platinum
Silver
Platinum
Platinum
Gold
Platinum
Silver
Gold
Platinum
Platinum
Silver
Gold
Gold
Platinum
Silver
Gold
Birth date
8/7/1959
2/24/1963
1/1/1959
2/13/1981
12/26/1958
6/11/1977
5/9/1971
3/13/1969
9/8/1980
2/10/1955
9/9/1980
2/23/1974
3/10/1978
12/14/1981
10/25/1954
11/27/1970
10/1/1955
6/27/1960
11/19/1958
12/21/1973
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
Column-based indexes on fields with repeated values often leads to
better compression ratios and thereby lower size of the indexes (as
we can see, there are few values repeated in the rows).
Income
71,927
35,633
144,077
85,087
123,456
76,506
73,503
68,987
100,600
105,943
112,096
41,080
118,481
50,900
78,304
38,809
157,105
151,067
63,169
65,628
SAP HANA — Virtual Marts and Applications
•
Virtual data marts and new applications were built that run on SAP
NetWeaver BW, which is again enabled by SAP HANA in-memory
processing
Applications developed by SAP
1. Planning & consolidation
2. Customer revenue performance mgmt
HANA (in-the works)
ERP
Database
Virtual
Data
Marts
Virtual
Data
Marts
Virtual
Data
Marts
Virtual
Data
Marts
Applications
Databases
Files
3. Predictive segmentation & targeting
4. Trade promotion management
5. Merchandise & assortment planning
6. Sales & operations planning (SOP)
7. Demand signal repository
8. Profitability analysis
9. Dynamic cash management
10.Strategic workforce planning
11.Smart meter analytics (power companies)
This provides much tighter integration with the source system (less data
latency) and much faster query response time for high-volume analysis
The Hardware – IBM Example
Client Demo
11
SAP HANA — Loading the Application and Performance
You can load the application based on the logs in the source system, ETLbased (Extract Transform and Load) loads, and SAP trigger-based
replication
Tool
Purpose
BusinessObjects Data Services 4.0
– ETL-based replication
Sybase replication server & Load Controller – Log-based replication
SAP Landscape Transformation (LT)
– Trigger-based replication
Log based replication is possible on IBM DB 2 LUW/UDB, MSFT SQL Server
Enterprise Edition, Oracle Enterprise Edition, and Sybase ASE
Some Reported SAP HANA Performance Achivements
Compression
Query speed improvements
Project
(data)
Max
Min
Average
Bank
1 : 6.3
521.6
258.8
369.5
HANA POC (SAP)
1 : 5.2
484.3
301.4
350.3
Opening HANA
Admin
Adding New
System in HANA
Adding New
System in HANA
Creating HANA
system
connection
Setup HANA
Security
Authentication
Changing a HANA
password
Creating HANA
Security questions
Creating HANA
Security questions
Your HANA
System in the
Navigator
Searching for a
table in HANA
The table
definition
inside HANA
All HANA tables
Open a
HANA table
Browsing data in
a HANA table
Opening HANA
Admin
HANA memory
usage
Creating a New
HANA Table
Creating a New
HANA Table
Creating a New
Products
HANA Table
Defining a new
Sales
HANA table
Accessing Data
Services to Load
data to HANA
Accessing Data
Services to Load
data to HANA
Linking Data
Services to HANA
datastores
Linking Data
Services to HANA
datastores
Linking Data
Services to HANA
datastores
Our new Data
Services HANA
repository
Data Services
HANA repository
objects
Importing HANA
table definitions
Importing HANA
Customer table
definition
Importing HANA
Sales table
definition
Linking data files
to load to HANA
Linking data files
to load to HANA
Defining file
format for loading
data to HANA
Defining data file
format for HANA
data load
Saving file
formats
Customer file for
HANA data load
Replicating
Product file for
HANA data load
Replicated
Product file for
HANA dataload
Replicating
Sales file for
HANA data load
Replicated Sales
file format loading
data to HANA
Create a Project
for Data Services
Create a Project
for Data Services
Create a Batch job
for HANA
data loads
The new batch job
for a HANA
data load
A new dataflow for
HANA data load
Making HANA
tables the data
target
Creating data
mapping to load
data to HANA
Creating data
mapping to load
data to HANA
Detailed data
mapping to load
data to HANA
Detailed data
mapping to load
data to HANA
Execute a HANA
data load
Execute a HANA
data load
Execute a HANA
data load
HANA
data load log
Opening HANA
Studio
Opening HANA
Studio
Opening our
Customer table in
HANA
Our Customer
table in HANA
What can you do with HANA and BO Explorer?
The system looks at the data and formats it based on implied hierarchies (i.e.,
time, geography, customer) as well as measures. Users may navigate and
change measures, graphs, and tables.
New Calculations
Any data panel can be sorted in many ways
We can also add our own
measures
In our example we are adding
the measure “Margin Per
Unit” as total margin divided
by “quantity sold”
Measures used on any graph can be calculated “on-the-fly.”
72
HANA Optimized InfoCubes
Data Store Objects (DSO) In HANA
The DSO in HANA is a ‘closed’
object where you can do:
• Index reads (snapshots)
• Delta reads for updates
• Activate data
• Querying
Read delta, between
snapshot 1 and 2
Delta Index
Index Read
Main Index
Activation
PS! a table, an analytic or calculation view
in a HANA schema can be accessed via a
BW DataSource. This is based on ‘DB
connect’ using a second DB connection to
the underlying HANA DBMS.
Insert
Only Index
History
Index
Source: T. Zurek, SAP AG
Data Load
74
SAP HANA — Test Drive
•
You can see demos and do a test drive at:
https://www.experiencesaphana.com
This site contains a lot of great information and you can also
try the Information Composer and see recorded demos.
Register and Take a Free BI Test Drive with SAP HANA
• You
can register for a free test drive at: https://bi.ondemand.com/session/new
You can also upload your own data and try the tool to see
if it is something for your organization. There is even
quick guides, videos, and wizards to get you started.
76
Questions and Answers
Dr. Berg
[email protected]