Transcript Slide 1

The State of Open Source Business Intelligence
Christian Donner
Getting from data to the source of a problem can be hard ...
A czar learned that the most disease-ridden province of
his empire was also the province with the most doctors.
His solution?
He promptly ordered all the doctors shot dead.
(He clearly lacked Business Intelligence)
Folktale from: Freakonomics - A Rogue Economist Explores the Hidden Side of Everything (Steven D. Levitt, Stephen J. Dubner)
www.molecular.com
2
… or easy …
"How would you rate the overall job President George W. Bush is doing as president
-- excellent, pretty good, only fair, or poor?
Excellent or pretty good
90.00%
80.00%
70.00%
60.00%
50.00%
40.00%
30.00%
February
March
May
June
July
August
October
November
December
January
February
March
April
May
June
July
August
September
October
November
December
February
April
June
August
October
December
February
April
June
August
September
October
November
February
April
June
August
November
January
February
March
April
May
20.00%
2001
2002
2003
2004
2005
2006
Source: Harris Poll, published by the Wall Street Journal Online on 5/12/2006
www.molecular.com
3
Poll
•
•
•
Who has implemented something that you would define as
a BI solution before, either in your own organization or for
someone else?
Out of this group, who has used an Open Source BI
product?
Survey on http://cdonner.com (20 responses):
Currently using BI
Currently using OSBI
Evaluated OSBI in the past
Planning to use OSBI
85%
40%
40%
35%
www.molecular.com
4
Why this presentation?
•
2 years ago I started a low-budget BI project
Researched many products and technologies
• OSBI was practically non-existent
• Decided to go with Microsoft DTS and SQL RS
• Today, the landscape has changed dramatically
•
•
I wanted to know: would I go with Open Source BI today?
www.molecular.com
5
Agenda
•
•
•
•
•
What is Business Intelligence?
BI Trends
OSBI Trends
Products
• Pentaho
• Jaspersoft
• OpenI
• BIRT
• Bizgres
• Mondrian
Demo
www.molecular.com
6
Business Intelligence – A Definition
•
•
•
Business Intelligence
• In 1989 Howard Dresner (Gartner Group) created the term "BI“:
“A set of concepts and methods to improve business decisionmaking by using fact-based support systems.”
Wikipedia:
• the technology used for collecting and analyzing business
information
• a set of business processes for this purpose
• the information obtained from these processes
Includes:
• ETL Tools
• OLAP/Data Analysis Tools
• Reporting Tools
• Databases
www.molecular.com
7
Business Intelligence - Components
Reporting
BI Platform
Delivery
Operational Datastore
MOLAP
Aggregation
ROLAP
Extraction
ETL
Storage
Relational Datastore
Multi-dimensional Datastore
www.molecular.com
8
Business Intelligence Platform
•
Integrate with business
processes
•
Manage and schedule
reports
Deliver reports through
multiple channels, push and
pull model support
Maintain user security
Seamlessly integrate via
open standards with portals
and applications
•
•
•
www.molecular.com
9
Agenda
•
•
•
•
•
What is Business Intelligence?
BI Trends
OSBI Trends
Products
• Pentaho
• Jaspersoft
• OpenI
• BIRT
• Bizgres
• Mondrian
Demo
www.molecular.com
10
Forecast: Business intelligence market growth
Actual
$8,000
Forecast
BI services revenue
BI maintenance revenue
BI license revenue
$6,000
$4,000
$2,000
BI market
size
(US$ millions)
$0
Size
Growth
2003
2004
2005
2006
2007
2008
$5,253M
$5,596M
$5,997M
$6,506M
$7,005M
$7,331M
N/A
6.5%
7.2%
8.5%
7.7%
4.7%
Source: Forrester Research, “Business Intelligence Growth Is Driven By Compliance, Standardization, And Performance Initiatives”
www.molecular.com
11
Mainstream BI Theme
Keith Gile, Forrester Research:
“We are witness to a change in BI that shifts the
emphasis away from functionally powerful tools for
power-user “producers” toward context-sensitive BI
solutions for a large community of “consumers” of
information.”
• Paul Doscher, CEO Jaspersoft:
“The big commercial tool providers can handle
performance management applications well, but left
Operational BI behind.”
• License bottleneck
• Lower-level in-house user
• Public web sites
•
www.molecular.com
12
Forrester Wave™: BI Enterprise Reporting, Q1 ‘06
Where are
the Open
Source
contenders?
Source: Forrester Research
www.molecular.com
13
Agenda
•
•
•
•
•
What is Business Intelligence?
BI Trends
OSBI Trends
Products
• Pentaho
• Jaspersoft
• OpenI
• BIRT
• Bizgres
• Mondrian
Outlook
www.molecular.com
14
Why Open Source?
Source: Survey by Computer Economics, Frank Scavo
www.molecular.com
15
The Jaspersoft Story: BI for Everyone
Operational executives are being asked to make decisions more critical to the
Corporation more frequently especially with the added scrutiny of SOX compliance.
Legacy BI Companies have failed to solve the Problem
“We have Business Objects installed on our corporate data
warehouse and 80% of our users only use 20% of the
functionality.”
Michael Heschel, EVP Information Systems and Services, The Kroger Company
“A typical installation for a 1000 users for the full BI suite could run
As high as $450k - $700k for software licenses alone.”
Intelligent Enterprise, August 2005
The full Business Objects product takes
180 CDs to install!!!
This slide © 2005 JasperSoft, Inc.
www.molecular.com
16
Organizational Involvement with OS BI
Don’t Know
Not Considering open
source BI software
9%
8%
43%
Considering open
source BI software
Has deployed open source
BI software
21%
19%
In development with
open source BI software
(c) 2006 Ventana Research Open Source and BI Research
www.molecular.com
17
Comparison of OS BI with Commercial BI
Cost of Ownership
77%
Openness/Flexibility
80%
Database Support
72%
Reliability
69%
Metadata Support
62%
Manageability
57%
Scalability/Performance
61%
Ease of Use
57%
Significantly more Capable
More Capable
Equivalently Capable
Less Capable
Significantly less Capable
Don’t know
(c) 2006 Ventana Research Open Source and BI Research
www.molecular.com
18
Extranet Applications - The “Beachhead” of Open Source BI?
•
•
Technology requirements favor open source
• Pure J2EE offerings provide a better technology fit than legacy
BI technology
Licensing requirements contradict prevailing proprietary models
• “Named user” only – doesn’t map to extranet usage
• Role-based – meaningless in extranets
• >$1,000 USD per name user – cost prohibitive
• Net/net: The “old school” BI licensing model breaks down
www.molecular.com
19
Free software for sale!
•
Community-based vs. for-profit companies
•
Open Source has become a business model
Acquisition of your vendor can change the terms under
which you use OS SW
Example: Bill Venners account of using Jive for Artima.com
•
•
•
•
Example: Snort, Sale of Martin Roesch’s Checkpoint
Software
Whatever you do, factor in that your Open Source product
may not always remain that.
www.molecular.com
20
Example: Jaspersoft Business Model

JasperIntelligence Product Family
•
JasperReports, iReports
•
•

Jasper Decisions, Jasper Server
Soon: JasperAnalytics, JasperETL
Commercial / Dual license
•
Services packages on Subscription basis (JS & JR)
•
•
•
CPU based Pricing plus Support (JD)
Support pricing (JR)
•

Commercial License, Support, Training, Documentation
Incident support plus three annual support options from web based selfservice to comprehensive 24x7x265
Leveraging strong and loyal community
•
SourceForge  JasperForge
This slide © 2005 JasperSoft, Inc.
www.molecular.com
21
Agenda
•
•
•
•
•
What is Business Intelligence?
BI Trends
OSBI Trends
Products
• Pentaho
• Jaspersoft
• OpenI
• BIRT
• Bizgres
• Mondrian
Outlook
www.molecular.com
22
OSBI Explosion
There are about 25 products competing
in this space, about half of which did not
exist prior to 2005.
• Many of them will probably return to
insignificance
• Because we are so early in the maturity
cycle, it is difficult to make judgments
about who will make it.
•
www.molecular.com
23
Open Source Reporting Tools
•
•
•
•
•
•
•
Eclipse BIRT (Actuate)
Jasper Reports
JFreeReport
DataVision
Open Reports
OpenRPT
Agata Reports
www.molecular.com
24
Eclipse BIRT
•
(Business Intelligence) and Reporting Tools
• Eclipse Report Designer (ERD)
• Eclipse Report Engine (ERE)
Eclipse Charting Engine (ECE)
• Web Based Report Designer (WRD)
•
Source: Actuate
www.molecular.com
25
BIRT 2.0 Features
•
•
•
•
•
•
•
Released January 20, 2006
Re-Use Library – A report component environment allows developers
with a range of expertise to share report components or functions for
reuse.
Page-on-Demand HTML- A page-on-demand navigation mechanism
enables the efficient viewing of large report documents over the
internet.
CSS Style Sheets – External style sheets can be used across multiple
report designs, making it easy to establish a common look across all
reports in one application.
Scripting Editor – BIRT supports the ability to code or script the
behavior of reports using a perspective for Java Code Editing for BIRT
reports.
Large, Persistent Reports – Report developers can generate a report
and then distribute a URL to end-users.
Improved Charting Facility, Scripting – BIRT 2.0 includes a wizard
for building common usage charts and advanced capabilities for
including detailed charts within a report design.
www.molecular.com
26
Open Source OLAP Tools
•
•
•
•
•
Mondrian
JPivot
gOLAP
PALO
pocOLAP
www.molecular.com
27
Open Source ETL Tools
•
•
•
•
•
•
•
Clover ETL
CPluSQL
Enhydra Octopus
JetStream
KETL
Kettle
OpenDigger
www.molecular.com
28
Open Source BI Suites
•
•
•
•
•
BEE
Bizgres
Openi
Pentaho
SpagoBI
www.molecular.com
29
JasperIntelligence Architecture
USER
COMMUNITY
Customers
Business Analyst
Domain User
Executive
OUTPU
T
HTML + AJAX
MS EXCEL
PDF
MS WORD
JasperExplorer
HTTP, SOAP, Web Services, Java
API
Cube /
Data Mart
JasperReports JasperDecisions JasperAnalysis
Content Store
JasperETL
Report Definition
JasperServer
Reporting Services Metadata Services
Rendered Content
OLAP Services
ETL Services
Images, Fonts, etc
Meta Data
Operational Data
Source
JasperIntelligence Platform
JDBC, POJO, XML, XML/A
JasperETL
Finance
Purchasing
Inventory
…
CORPORATE
DATA
This slide © 2005 JasperSoft, Inc.
www.molecular.com
30
Pentaho
Source: Pentaho
www.molecular.com
31
OpenI
Source: OpenI/Loyalty Matrix
www.molecular.com
32
OpenI at a Glance
•
J2EE Web Application
•
Standards-based, integrates other Open Source
components
Connectors for Relational (JDBC), OLAP (XMLA), and data
mining data sets (RServe) currenly only XMLA
•
Supports Jasper .jrxml and custom RDL
• JPivot for Pivot tables, JFreeChart
• Supports JSP-168
• Form-based authentication with J2EE Security
•
www.molecular.com
33
Bizgres
•
Sponsored by Greenplum
•
Bizgres is a distribution of PostgreSQL (Open Source DB)
Bizgres includes the following components:
•
•
PostgreSQL 8.1.3 (Open Source RDBMS)
•
Bizgres Loader (Mass data loading utility)
•
Demonstration Programs and Utilities
•
KETL Integration (ETL solution for web log analysis)
•
JasperReports Integration
•
Bizgres Clickstream
www.molecular.com
34
Bizgres Clickstream Architecture
Source: Greenplum
www.molecular.com
35
Who leads the pack?
Downloads by Month
60000
50000
40000
30000
20000
10000
0
Feb- Mar- Apr- May- Jun- Jul- Aug- Sep- Oct- Nov- Dec- Jan- Feb- Mar- Apr05
05
05
05
05
05
05
05
05
05
05
06 06
06
06
Mondrian
JFreeReport
Pentaho
Jasper Reports
Source: sourceforge.net
www.molecular.com
36
Agenda
•
•
•
•
•
What is Business Intelligence?
BI Trends
OSBI Trends
Products
• BI suites
• ETL tools
• OLAP
• Reporting tools
• Databases
Demo
www.molecular.com
37
The State of Open Source Business Intelligence
•
“Business intelligence” is a broad umbrella term
Lot of buzz in the media and from analysts
• Young and growing market
• Immature, but rapidly improving products
• No clear market leader
•
www.molecular.com
38
Thank you!
Q&A
Would I go with Open Source BI today? How about you?
www.molecular.com
39