Phased Submission
Download
Report
Transcript Phased Submission
HUGmn 2010
Jim Heflin
Chris Barbieri
Application Design: the
Foundation of Performance
Hyperion Financial
Management
Metadata design as it impacts
performance
Data volume and content
measurement
Rules performance
measurement
Reading the HFM logs
Designing HFM’s 12 Dimensions
Application Profile
1. Year
2. Period
3. View
System
4. Value dimension,
includes currencies
User controlled
5. Entity
6. Account
7. ICP
8. Scenario
User defined
9. Custom 1
10. Custom 2
11. Custom 3
12. Custom 4
Application Profile
Year
No inherent impact on performance
Cannot be changed after the application is built
Impacts the number of tables that can be created in
the database
Period
The base periods comprise the column structure of
every table, whether you use them or not.
For this reason, avoid weekly or yearly profiles unless
it is key to your entire application’s design
View
No impact, but only YTD is stored and Periodic, QTD
are on-the-fly derivations
What’s a Subcube?
HFM data structure – Year, Scenario, Value, Entity
Database tables stored by
Each record contains all periods for the [Year]
All records for a subcube are loaded into memory together
Parent subcube,
stored in DCN tables
Currency subcubes,
stored in DCE tables
Metadata Volumes (Americas)
Dimension
Average
Volume
Recorded
High
Comments
Accounts
2,132
14,409
Entities
1,165
22,882
16
233
Custom1
388
19,410
use Custom 1 96%
Custom2
153
15,188
use Custom 2 86%
Custom3
61
26,816
use Custom 3 86%
Custom4
39
11,389
use Custom 4 62%
Scenarios
11
78
Entity hierarchies
3
24
ICP Accounts with Plug
41
1,223
use automated intercompany matching 56%
Accounts with Line Item Detail
36
1,667
16% use this, but only 10% have more than 1 account flagged
Consolidation Rules
-
-
Consolidation methods
5
10
Currencies
OrgByPeriod
1 currency 30%
the equivalent of Organizations in Hyperion Enterprise
use consolidation rules 28%
use methods 14%
use organization by period 9%
ICP Members
86
1,407
Entities flagged for Parent Adjs
143
7,698
5
53
Scenarios using Process Mgmt
use only
track intercompany activity 81%
Allow [Parent Adj] or [Contribution Adj] journals30%
use process management46%
Data Design
“Metadata volume is interesting, but it’s
how you
Density
Content
Specifically: zeros
Tiny numbers
Invalid Records
it that matters most”
Loaded Data
What percent of the loaded data is a zero value?
No hard rule, but <5% may be reasonable
No zeros are best, watch ZeroView settings on the scenarios
Watch out for tiny values, resulting from allocations
How much does the data expand from Sub Calculate?
Am I generating zeros, or tiny numbers?
Input Base Records
Total
Input zeros
% zero loaded
Values > -1 and < 1
% values > -1 and < 1
Input Plus Calculated Base Records
2,031,976 Total
18,024 Calculated zeros
0.9% % zeros calculated at base
373,226 Values > -1 and < 1 calculated
18.4% % values > -1 and < 1 calculated
% Increase
From Rules
4,387,520
116 %
413,837
9.4%
2,196 %
593,981
59 %
13.5%
Data Density Using FreeLRU
Survey of data density using FreeLRU method
Number of applications reviewed: 32 Average
NumCubesInRAM
NumDataRecordsInRAM
NumRecordsInLargestCube
2,672
1,502,788
Min
Max
72
10,206
Median
ABC
Customer
1,345
577
247,900 5,627,748 1,170,908
1,107,614
86,415
2,508
593,924
53,089
31,446
Average records per cube
6,309
24
91,418
1,352
2,288
Average metadata efficiency:
average cube/densest cube
7.3%
0.3%
39.7%
3.4%
7.3%
HFM 11.1.1: the magic of 64 bit!
32 bit provides 2 GB of RAM for HFM
Possibility of using 3 GB switch
All versions, including 11.1.1 32 bit edition
Can manage about 1-3 million records in RAM
64 bit provides 128 GB RAM for HFM
Starting with release 11.1.1
Out of the box support for 12 million records in RAM
Ranzal lab and field testing shows
HFM 64 bit white paper available from Chris Barbieri
Measure and Analyze Rules
How much time do I
spend in each rule?
Do some months take
longer than others?
Rewrite the rule for
optimal performance
Let’s focus on
the “top 10”
Is it because they
have more data?
Establish a Baseline
“Performance begins with perception.
Establish this and a baseline before
applying science.”
Chris Barbieri
Sr. Product Issues Manager
Hyperion Solutions
March 5, 2006
Effect of caching
Data cache on database server AND on HFM application server
Caches may be empty during first run
Performance is significantly better when data reads comes from
memory cache rather than disk
This is why cache management is so important
Run the same process 3 times in a row and use the average
“Rules” of Thumb
Most application between 0.25 and 2.0 seconds per
entity, per period
Consolidate all with data for entire hierarchy, full year
Divide by total number of entities (descendents of
selected parent), divided by 12 periods
Most applications are closer to 0.25 seconds
Rules Impact Ratio
Blank rules file, Consolidation Rules = N for baseline
Divide consolidation time with rules by time without
Usually 2-5 times
Data Density <> Calc Time
Average Rule Execution Time in Contrast with Data Volume
900
2.500
800
2.000
700
1.500
500
400
1.000
Seconds
Records
600
300
200
0.500
100
-
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
correlation between density and calc times
Most applications are rules bound
When HFM app server CPU is < 20%, it is
communicating with the database server
The Black Art of Reading HFM Event Logs
Where does HFM store its event information?
Maintaining the logs
How can I view this?
OK, what does it actually tell me?
Understanding HFM Logs
Messages
Messages are informational –start/stop consol, log in, log out etc.
Some messages are purposely out of time order (consol starts get
printed at completion of consol
Warnings
Often due to subcube size issues
HFM Subcube Troubleshooting Guide / Memory Management in
HFM documents
Errors
Access rights
Syntax Issues
Where are the HFM events stored?
Text file containing XML, named HsvEventLog.log
Pre-HFM 9.2.0.2 or 9.3.0
..\Hyperion Solutions\Hyperion Financial Management\Server Working Folder\
Starting with 9.3.1 Oracle moved all product logs to a
common parent folder
HYPERION_HOME\Logs\FinancialManagement
or
HYPERION_HOME\Logs\HFM
How can I view this?
Administration Module
Web: Administrators only
HFM Error Log Viewer utility
Free standing executable
Bundled with HFM under \Consultant Utilities
Web System Messages
Available to administrators
Launch the Utility
Launch
HFMErrorLog
Viewer.exe
System
Message panel
Details panel
Details
Web suppresses
richer details
shown in utility
Find “Registry”
Each server’s registry settings are written during an
application start-up.
Most but not all registry entries are written
We’ll cover the actual entries in another presentation
System Memory at Inception
Page File Size
Increased in 9.2.0.3, 9.3.1 to 130 and 260 MB
Still exists in 64 bit HFM 11.1.1, but likely unused
Paging
Watch “PageOutOps > 0” indicating page file usage
Consolidation start and finish
Summary
indicates
start time
Details have
finish time
Is written
when it
completes
Extracting Log Entries
HFM writes to both the event log and the
database
You can extract the database entries to a text file,
which is preferable to the event logs
Can also truncate the entries using this utility
And split large files (anything > 30 MB is too
large)
Ranzal Performance Lab Team
Co-founded in 2007
Chris Barbieri
Kurt Schletter
Established HFM performance
tuning techniques and
statistics widely used today
Over 20 years in IT
4+ years as Sr. Product Issues
Manager at Hyperion
Member of HFM launch team
in 2001, certified in HFM and
Enterprise
MBA, Babson College
B.S. Finance & Accounting,
Boston College
Hyperion Support Manager at
United Technologies, serving
3,600+ HFM users
5+ years Hyperion product
infrastructure services
MBA, Rensselaer Polytechnic
Institute
B.S. Management with Computer
Applications, Worcester
Polytechnic Institute
Visit www.Ranzal.com/News.htm
for a listing of complete webinars
Chris Barbieri
[email protected]
Needham, MA
USA
+1.617.480.6173
www.ranzal.com