Transcript Slide 1

Session1: SAP HANA and Big Data
Dr. Bjarne Berg
Associate professor Computer Science
Lenoir-Rhyne University
Introduction
The introductory session will look at the topic of big
data and new computer capabilities with much faster
in-memory data processing.
We will look at how the explosion in data growth is
changing the way in which data is collected,
analyzed, transmitted, and stored.
We will also explore how SAP HANA is transforming
system landscapes, data warehousing, ERP
processing, and real-time data access.
The session ends with a live demo of SAP HANA and
BusinessObjects dashboards and reporting.
2
Session Agenda
•
Introduction
•
Why Change to In-Memory Processing?
•
The Early Solutions
•
SAP HANA an Introduction
•
Demo
•
New Innovation and Interesting Usages
•
The Future and Big-Data Trends
•
Questions and Answers
3
The Creation of Big Data
90% of all digital
information was
created in the last 3
years.
By 2020 we will have
5,600 GB of data for
every person on
earth (incl. pictures,
movies and music).
That is 40
Zettabytes!
The Issue: How do we store the big data
and how can we access it faster?
4
Where is the data Located and What Drives the Growth?
5
Source: WipPro, 2013
Data is Created Everywhere
Total number of hours spend on facebook each month:
700 Billion
Data sent and received by mobile platforms and phones: 1.3 Exabytes
Number of emails sent each day:
2.5 Billion
Data processed by Google each day:
2.4 Petabytes
Videos uploaded to YouTube each day:
1.7 million hours
Data consumed by each world’s household each day:
357 MB (growing fast)!
Number of tweets send each day:
Number of Products sold on Amazon each hour:
50 Million
263 Thousand
Every day we create 25,000,000,000,000,000,000 bytes of data!
(that is 25 quintillion bytes).
6
Who Benefits the Most of Big-Data Access?
Source: University of Texas
7
Why In-Memory Processing?
Focus
Technology
1990
2013
Improvement
CPU
0.05
304.17
MIPS/$
MIPS/$
6083x
Memory
0.02
52.27
MB/$
MB/$
Addressable
Memory
216
264
248x
Network
Speed
100
100
Mbps
Gbps
1000 x
Disk
Data Transfer
5
620
MBPS
MBPS
2614x
124x
Source: 1990 numbers SAP AG, 2013 numbers, Dr. Berg
Source: BI Survey of 534 BI professionals, InformationWeek,
Disk speed is growing slower than all other hardware
components, while the need for speed is increasing.
8
Why Change to In-Memory Processing?
•
An History Lesson:
•
File systems were created to manage hard disks
•
Relational Databases were made to manage file stems
•
Application Servers were created to speed up
applications that ran on a database.
•
Therefore:
•
Hard drives are DYING!
•
Relational databases are DEAD (they just don’t know it!)
•
Application Servers will become less important
9
Session Agenda
•
Introduction
•
Why Change to In-Memory Processing?
•
The Early Solutions
•
SAP HANA an Introduction
•
Demo
•
New Innovation and Interesting Usages
•
The Future and Big-Data Trends
•
Questions and Answers
10
The Death of Storage and Access Technology is Normal
11
The Rate of Change – Disruptive Technologies
•
Moore’s Law in technology:
•
•
Processing Speed will double every 18 month
Paradigm shifts:
•
SAP HANA queries are executed 400-900 times faster than on
relational databases
The rate of change in Paradigm Shifts
is much faster than the incremental
changes and a much lower cost
12
Session Agenda
•
Introduction
•
Why Change to In-Memory Processing?
•
The Early Solutions
•
SAP HANA an Introduction
•
Demo
•
New Innovation and Interesting Usages
•
The Future and Big-Data Trends
•
Questions and Answers
13
SAP HANA — In Memory Options
•
SAP HANA is sold as an in-memory
appliance. This means that both
Software and Hardware are included
from the vendors
•
Currently you can buy SAP HANA
solutions from Cisco, Dell, Fujitsu,
IBM, NEC, Hitachi and HP
•
The future of SAP HANA is to replace
relational databases of ERP and data
warehouses and run these on the inmemory platform
Source SAP AG,
SAP HANA has radically
changed the way databases
operate and make systems
dramatically faster.
SAP HANA — In Memory Options
There are currently 7 different
certified HANA hardware vendors
with 13 different products.
Memory
Hardware
128GB
Cisco C260
X
Cisco C460
256GB
X
X
X
X+
X
Dell R910
X
X
X
Hitachi CB 2000
X
X
X
X
X
X
X
NEC Express 5800
Fujitsu RX 600 S5
X
Fujitsu RX 900 S2
HP DL 580 G7
X
X
X
HP DL 980 G7
X+
X+
X
X
X
X+
HP BL 680
X
X
X
IBM x3690 X5
X
X
X
X
X
IBM x3950 X5
1024GB
X
Cisco B440
Some boxes can be used as
single nodes with others are
intended for scale-out solutions
for large multi-node systems
512GB
X+
The Hardware – IBM Example
SAP HANA — Available Special Applications
•
New Applications has been built that run on SAP HANA in-memory
processing and you can also build your own
HANA
ERP
Database
Virtual
Data
Marts
Virtual
Data
Marts
Virtual
Data
Marts
Virtual
Data
Marts
Applications
Databases
Files
Applications developed by SAP
1. Planning & consolidation
2. Customer revenue performance mgmt
3. Predictive segmentation & targeting
4. Trade promotion management
5. Merchandise & assortment planning
6. Sales & operations planning (SOP)
7. Demand signal repository
8. Profitability analysis
9. Dynamic cash management
10.Strategic workforce planning
11.Smart meter analytics (power companies)
12. and much more…
This provides much tighter integration with the source system (less data
latency) and much faster query response time for high-volume analysis
SAP BusinessObjects Dashboards for Enterprise Management
Dashboards can be built using the
SAP BusinessObjects Dashboards
tool that takes advantage of the
sub-second speed of HANA.
18
SAP Dashboards Example — Flexibility
•
•
Graphs can be displayed many ways
Navigation can be done and saved as “scenarios
SAP Dashboards — Mobile Example
• Dashboards
are
most useful when
compared to
something
• This
dashboard
is relative to a
business plan
• Notice
that all
graphs can be
displayed many
ways and that
color coding is
consistent across
dashboards
It is all about getting fast performance when
accessing high volumes of data
Formatted Number based Dashboard Example
Dashboards
can also be
highly
formatted and
static with
little user
interaction
The In-Memory capabilities of HANA allows managers to see
all financials in one-place in hyper-fast speed..
Operational Dashboards for Line Managers
•Dashboards
can
be operational
•This
dashboard
focus on billing
disputes and is
used to monitor
closing of cases
•The
users of
this dashboard
are clerks in the
billing office,
not executives
With HANA – Real-time operational dashboards can
by pushed to managers everywhere
22
Link of HANA data to Maps and News Feeds
• Dashboards
are
most useful when
shared with others
• Power
users can
create great
departmental
dashboards that
can be shared
inside smaller
organizational
units
In this dashboard, the data is merged with Google maps and external news
feeds. This makes the dashboard much more interactive and interesting.
23
Session Agenda
•
Introduction
•
Why Change to In-Memory Processing?
•
The Early Solutions
•
SAP HANA an Introduction
•
Demo
•
New Innovation and Interesting Usages
•
The Future and Big-Data Trends
•
Questions and Answers
24
BI Workspaces and Modules
BI Workspaces allows you to link many SAP BI tools in the same area,
without the need to jump between them.
In this workspace, we have 6 Objects with 4 different technologies.
25
New Innovation in Medical Field for Big Data
CAT scans and X-Rays
create an large amount of
data that doctors have to
review and access
CAT Scan of Tumor Patient
X-Ray of Cancer Patient
HANA can store this and provide
high volume and provide almost
instant access to hundreds of
Terabytes of data
26
New Big-Data Innovation in Safety and Security
•
Thousands of hours of video is
taken at airports, banks, casinos,
borders and other sensitive areas
•
Facial recognition software can
identify wanted criminals
•
SAP HANA can store that data
and process the information
27
New Big-Data Innovation – Weather and Fishery tracking
Tracking whether and
execute predictive
models require
significant number of
data points with high
data volume
Modeling resources such as
fisheries and specie
movements also require
significant data volumes and
data points on catch
information across the globe
28
New Big-Data Innovation – Company War Rooms
•
In a multi-national
company, data is
created and consumed
everywhere.
•
With SAP HANA you
can create a corporate
war-room to track
customer demand,
shipments, marketing
success and business
intelligence
This picture is from Sprint phone
company’s war-room to track usage
and transition issues during system
mergers and product launches.
29
New Big-Data Innovation – Pollution Tracking
•
Geo data from
pollution, data
modeling and
tracking creates
hundreds of
Terabytes.
•
SAP HANA can
assist in storing
With Predictive modeling and data visualization
and retrieving
you can build sophisticated models on HANA. You
this data
can even use the R-statistical library
30
New Big-Data innovation – Scientific Discovery
•
The super collider
center CERN, creates
over one PetaByte
every second it
operates.
The new Spectre R telescope
of Russia has 1000 times
higher resolution than
Hubble, generating billions
of bytes of data.
31
Session Agenda
•
Introduction
•
Why Change to In-Memory Processing?
•
The Early Solutions
•
SAP HANA an Introduction
•
Demo
•
New Innovation and Interesting Usages
•
The Future and Big-Data Trends
•
Questions and Answers
32
The Future and Big-Data Trends
Big data is being generated from
micro and macro levels.
Internet usage Map by protocol
From human DNA for each person
to the content of billions of stars in
galaxies.
A Map on the Whole Internet
Computer based human interaction is
getting more common and generating
terabytes of data each second
Big-Data is only get more prominent.
– can computers keep up? 33
The Future and Big-Data Trends – More Imaging
A data explosion visualized – Micro loans made
Companies will start
accessing data
visually instead of by
numbers and text.
Users will have ondemand access to all
movies, songs,
information in subsecond speed
34
Demo 1: HANA Performance with 426 million rows
Demo 2- Live BOBJ on HANA
Summary
•
SAP is a highly innovative company
•
We are removing hard drives and relational databases
•
Processing is going to in-memory
•
SAP HANA can do all this today
•
First we will move all data warehouses to HANA, then all
ERP systems
•
HAHA is much more than ECC and SAP BW (current tools)
•
HANA is a paradigm shift with lower operating costs
•
HANA is available today and is being implemented at
hundreds of companies in regular industries right now.
37
Questions and Answers
Dr. Berg
[email protected]