Transcript 1001 Good Reasons to Upgrade Tom Bascom Greenfield Technologies

1001 Good Reasons
to Upgrade
Tom Bascom
Greenfield Technologies
Introduction
Tom Bascom
Greenfield Technologies
http://www.greenfieldtech.com
Simplify your business
tom@greenfieldtech
2
Agenda



Simplify your business

3
History of Progress Releases
The Benchmarks
Data
Summary
Agenda



Simplify your business

4
History of Progress Releases
The Benchmarks
Data
Summary
Just How Old is Version 8?


Simplify your business

5
Or 6 & 7 for that matter?
V9 was released when?
What else was current way back then?
V6 -- 1990



Fuzzy Checkpoints
-spin
PF Files





Simplify your business

UNIX System V r4
RS 6000
Windows 3.0
MS Sales = $1B
10mhz 286 PS/1: $2000
NEC Laptop: $8500
16mhz 386sx
2MB RAM
42MB disk
(color)
[email protected] launched by Ethan Lish
6
V7 -- 1992




Jumpstart
GUI
-mmax
Load ‘n Go!






OS/2 2.0
Windows 3.1
SLS Linux distribution
486DX2 25/50mhz
66mhz PowerPC
HP 9000 725
Simplify your business
50mhz PA RISC
16mb RAM, 512MB disk $18k

Thinkpad 700c: $4,350
25mhz 486sl
4MB RAM
120MB disk
[email protected] taken over by Greg Higgins
Approximately 175 subscribers and 10-12 messages/month
7
V7.3 -- 1995


Persistent Procedures
VBX




Simplify your business

MS Consent Decree
Win95
Linux 1.0 (’94 actually)
Pentium Pro 200mhz
DEC Alpha 300mhz
Something called
“The Web” explodes
onto the world…
Peg.com domain registered
Approximately 700 subscribers and 1000 messages/month
8
V8 -- 1996






Simplify your business

User Defined Functions
VSTs
Variable Block Sizes
App Servers
WebSpeed
Fast Schema Change
-zprofile
[email protected] created in May ‘98
9



NT 4
1GB disks start to appear
Linux 2.0
V9 -- 1999






Storage Areas
Publish and Subscribe
Dynamic Queries
XML
SQL-92
Load ‘n Go actually
works




Simplify your business

Pentium 3 announced
Judge Jackson declares
MS is an “abusive
monopoly”
Windows 2000 released
SCO & IBM start working
on “Monterey”
Fujitsu Lifebook: $2,600
333mhz PII
64MB RAM
6.4GB disk
[email protected] created in May ‘98
10
OpenEdge 10 -- 2004



Data Clusters
ProDataSet
SOAP
Simplify your business
DateTime!!!



The SCO Saga
P4 Xeon @ 3.0ghz
Dell Latitude: $2,500
Pentium M @ 1.2ghz
640MB RAM
40GB disk
PEG has more than 3,000 messages/month and approximately 5,200
subscribers -- they’d all be here but they’ve got important work to do…
11
OpenEdge 10.1B -- 2007





Simplify your business

12
4GL renamed “ABL”
OO Progress
User Table Stat VSTs
64 bit ROWIDs
Magic defragmentation
Unlimited shared
memory



The SCO Saga
Continues!
Dual Core Chips
Everywhere!
Microsoft ships Vista Minimum PC now
requires 4GB of RAM, a
dual core 4GHZ CPU
and graphics to die for
;-)
OpenEdge – Into The Future!



Simplify your business



13
OO 4GL improves
Tighter integration of
products like Sonic,
Apama, EasyAsk etc…
More online
maintenance features
Performance,
performance,
performance…
Bigger database
blocks?
“ABL” renamed 4GL?




The SCO Saga
Resolved?
More Cores
RAM based laptops.
Terabyte disk drives.
History Bonus Slides

Simplify your business

14
Moore’s Law
Disk Performance
Moore’s Law
Simplify your business
In 1965 Gordon Moore famously observed that
transistor counts were doubling every two
years and predicted that this would continue…
15
Moore’s Law
10000
9000
8000
"MIPS" (Intel)
7000
6000
5000
4000
3000
2000
1000
16
Pentium 4
Pentium 2
Pentium
486
386
286
0
8086
Simplify your business
Coupled with
increases in
clock speeds
raw compute
power per
dollar (or euro)
raises very
quickly…
Disk Performance

Disk Performance is Complex!

Capacity
– Increases roughly 100% annually

Bandwidth
Simplify your business
– Increases roughly 40% annually

Access (especially random access!)
– Increases roughly 8% annually
17
Disk Performance



Non-DBA bias is towards Capacity
(beancounters...)
The trade press occasionally pays
attention to Bandwidth.
A DBA’s bias is Random Access.
Simplify your business
Theoretical Time to read whole 3.5’’ disk:
Year
1990
2000
2007
18
Size
100MB
8GB
140GB
Sequentially
4 minutes
12 minutes
+60 minutes
Randomly
1 hour
46 hours
200 hours
Hardware Performance
Summary

Amdahl’s Law! The potential for performance
improvement is limited by the amount of time that the
improved component is being used.
Simplify your business

Constant Workload:
– 10x faster CPU + 10% disk = 5x faster
system.
– 50% of potential improvement is lost.
– 100x faster CPU + 10% disk = 10x faster
system.
– 90% of potential improvement is lost to
disk IO.
19
Agenda



Simplify your business

20
History of Progress Releases
The Benchmarks
Data
Summary
The Benchmarks





Simplify your business




21
ReadProbe
4glProbe
Populate
Workload
Big Report
Dump
Load
Index Rebuild
DB Analysis
Maintenance
Test Platform

“Mid Market” Hardware
– Dell PowerEdge 6600


Simplify your business



22
4x2Ghz Xeon w/HT
2GB RAM
6 disks
Windows Server 2003
Linux AS 2.1
The Database



Simplify your business

23
Sports2000 schema
Randomly generated data
Mix of Table & Record sizes
Some Scatter
Simplify your business
Database Analysis
Table
Benefits
BillTo
Department
Employee
Invoice
Order
OrderLine
POLine
PurchaseOrder
RefCall
Salesrep
State
Supplier
Warehouse
Subtotals:
24
Records
5000
200000
20
5000
1000000
1000000
1500000
8000000
20000
9997
300
50
5000
100
15771467
Size
282.3K
32.0M
1.0K
1.1M
52.0M
168.3M
94.5M
505.6M
920.0K
917.8K
25.3K
3.5K
1.0M
16.0K
1.2G
Min
42
76
36
153
46
98
46
49
33
45
52
44
121
101
20
Max
73
258
74
333
55
263
81
82
61
144
122
102
293
219
409
Mean
57
167
53
236
54
176
66
66
47
94
86
70
210
163
83
Scat
2.5
2.6
1.0
3.0
1.9
2.0
1.7
1.4
2.7
3.1
3.2
1.0
3.1
1.0
2.0
Tuning Parameters


Mostly “Out of the Box”
Basic tuning only
– -B
– -i
– Simple File Placement
Simplify your business


25
Tried not to make this a disk performance
test.
No Heroics
Not Tested



Simplify your business

26
SQL-92
Effects of After Imaging
Client/Server
Exotic Parameters
Feature Focus

Variable Block Sizes
– Introduced with v8
– 1k, 4k & 8k (2k not tested, 4k not shown)

Rows Per Block
– Introduced with v9
– 32, 64, 256 (1 not tested)
Simplify your business

Type 1 vs Type 2 Storage Areas
– Type 1 = 1 block per cluster (aka v9 style
areas)
– Type 2 = 8, 64 & 512 blocks per cluster
– Type 2 areas are a new capability introduced
with OE 10
27
Database Configurations



1k, 4k, 8k db Blocks
32, 64, & 256 Rows per Block
1, 8, 64 & 512 Blocks per Cluster

48 Comparisons in all


Simplify your business
Apples to apples comparisons
Version 8, Version 9, OpenEdge 10
28
Simplify your business
“Issues”

_ActRecord VST is broken in OE10.0a –
making some data gathering difficult (but
does not impact functionality.)
Fixed in 10.0B

9.1d07+ contains many, but not all, OE10
enhancements – which occasionally blurs
the distinction between v9 & OE10

8.3e, 9.1d09, 10.0B (no service packs)
29
Agenda



Simplify your business

30
History of Progress Releases
The Benchmarks
Data
Summary
ReadProbe


Simplify your business

31
Measures the ultimate limit of record read
performance under IDEAL conditions (NO
disk IO).
You’ll never actually get performance this
good.
But you should be able to get close.
ReadProbe -- Linux
ReadProbe -- Linux
200,000
180,000
160,000
140,000
120,000
8.3E
9.1D
100,000
9.1D07
10.0A
Simplify your business
80,000
60,000
40,000
20,000
0
32
1
3
5
7
9
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
47
49
ReadProbe -- Windows
ReadProbe -- Windows
200,000
180,000
160,000
140,000
120,000
8.3E
9.1D
100,000
9.1D07
10.0A
Simplify your business
80,000
60,000
40,000
20,000
0
33
1
3
5
7
9
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
47
49
Results -- ReadProbe




Simplify your business

34
v9 scales better than v8.
9.1d07+ acts a lot like OpenEdge 10 on Linux.
9.1d & 9.1d07 act a lot like OE10 on Windows –
OE10 is about 5% faster.
Linux is a tad faster than Windows (5 to 10%).
Windows has improved a lot since v8.
4glProbe


Simplify your business

35
Ordinary 4gl string manipulation functions
Loop constructs
Measure the time required to complete a
set of these operations.
4GL Operations
4GL Performance
2GHz P4 Xeon
60000
50000
40000
30000
Simplify your business
20000
10000
0
8.3e
36
9.1a05
9.1d
9.1d07
10.0b
Populate


Simplify your business


37
Randomly fills the database with a
configurable number of records.
Target record count is configured per
table.
One or more simultaneous threads per
table.
Field data is randomized.
38
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
1,32,1
Simplify your business
Populate -- Windows
8000
7000
6000
5000
4000
3000
2000
1000
0
39
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
1,32,1
Simplify your business
Populate -- Linux
8000
7000
6000
5000
4000
3000
2000
1000
0
Results – Populate
(Insert & Update)



Simplify your business


40
V9 is a big improvement over v8 under Windows.
Larger block sizes are A Good Thing with v8 and
Windows – v9 likes them too.
More rows per block are A Good Thing –
especially with Windows.
OpenEdge 10 is generally better than v8 or v9 –
especially when using type 2 storage areas.
Windows has improved a lot from v8 to
OpenEdge 10 (between 20% & 60%).
Workload



Simplify your business

41
Starts X sessions
Each session has a tunable target for
Creates, Reads, Updates and Deletes.
Each session randomly fulfills that target
much as a “user” would.
Time spent working is measured and
logged.
Workload 25 -- Linux
50.0000
40.0000
30.0000
10.0000
42
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
0.0000
1,32,1
Simplify your business
20.0000
Workload 100 -- Linux
50.0000
40.0000
30.0000
10.0000
43
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
0.0000
1,32,1
Simplify your business
20.0000
Workload 25 -- Windows
50.0000
40.0000
30.0000
10.0000
44
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
0.0000
1,32,1
Simplify your business
20.0000
Workload 100 -- Windows
50.0000
40.0000
30.0000
10.0000
45
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
0.0000
1,32,1
Simplify your business
20.0000
Results – Workload

Progress® version number is dominant.
– V9 is worst in almost all cases.
– OpenEdge 10 does very well with heavier loads.

Simplify your business



46
More rows per block are usually A Good Thing.
Type 2 storage areas (only available with OE10)
are much better than Type 1 areas.
32 rows per block in a type 1 area is generally
asking for trouble.
Scalability improves as you upgrade from 8 to 9
to OpenEdge 10.
Big Report
Simplify your business

47
Queries a whole bunch of records in
multiple tables.
48
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
1,32,1
Simplify your business
Big Report -- Linux
3000
2500
2000
1500
1000
500
0
49
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
1,32,1
Simplify your business
Big Report -- Windows
3000
2500
2000
1500
1000
500
0
Results -- Reporting


Windows performance has improved a lot.
Otherwise V9 is the slowest.
– OpenEdge 10 Type 1 storage areas are
somewhat performance challenged.
– Large block, row & cluster sizes are A
Good Thing.
Simplify your business

50
It’s easy, and painful (a 30% swing), to
shoot yourself in the foot with v9 &
OpenEdge 10 defaults – planning and
testing pay.
Maintainence



Simplify your business

51
Binary Dump
Binary Load
Index Rebuild
DB Analysis
52
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
1,32,1
Simplify your business
Maintenance -- Linux
3000
2500
2000
1500
1000
500
0
53
8,256,1
8,64,1
8,32,1
1,256,1
1,64,1
1,32,1
Simplify your business
Maintenance -- Windows
3000
2500
2000
1500
1000
500
0
Results -- Maintenance




Simplify your business



54
1k db blocks are a bad idea.
8k blocks @ 32 rpb are a really bad idea.
4k and 8k are generally roughly similar in
performance.
OpenEdge Binary Dump can be much faster (60
to 70%) than v8 or v9 if you use type 2 areas and
64 or 512 blocks per data cluster.
OpenEdge 10 Binary Load does not like 1k db
blocks or 8 block data clusters.
Index Rebuild isn’t much different from 9 to 10.
Index Rebuild is about 40% faster from 8 to 10.
Agenda



Simplify your business

55
History of Progress Releases
The Benchmarks
Data
Summary
Upgrade - Myths



Simplify your business



56
MYTH: Upgrades require more resources.
Truth: Upgrades make better use of your existing
resources if you use the new features.
MYTH: Newer releases are slower than older
releases.
Truth: Upgrades perform better on identical
hardware if you leverage new features.
MYTH: You need to spend the same money for a
new server as the old.
Truth: You can get much better performance for
much less money.
Upgrade -- Con

Simplify your business

57
Conversion with type 1 areas and default
values shows little benefit over v9 (and
may be a step backwards in some cases.)
Straight “convXY” upgrades may be
harmful to performance (especially with 1k
blocks or 32 rows per block.)
Upgrade -- Pro



Simplify your business


58
Day-to-day Workload improvements.
Maintenance Improvements.
Conversion to larger block sizes and row
per block settings can be very beneficial.
Conversion to type 2 areas can be very
beneficial.
Additionally, 4gl performance is getting a
lot of attention.
The Case For Upgrading
Linux
100.00%
75.00%
50.00%
8 -> 9
25.00%
8 -> 10
9 -> 10
Simplify your business
0.00%
-25.00%
-50.00%
Populate
59
Work25
Work100
BigRpt
Maint
The Case For Upgrading
Windows
100.00%
75.00%
50.00%
8 -> 9
25.00%
8 -> 10
9 -> 10
Simplify your business
0.00%
-25.00%
-50.00%
Populate
60
Work25
Work100
BigRpt
Maint
Wrap-up


Simplify your business


61
As a general rule the db is not your
ultimate constraint.
The most advantage comes from
leveraging new features.
Never underestimate the impact of cheap
hardware!
There is a clear positive trend in the
numbers!
Why Upgrade to OpenEdge 10?




Simplify your business


62
How does an aggregate database performance
improvement of 25% sound? (Of course
YMMV…)
As much as 60% faster 4gl performance!
Greater efficiency of DB reads/writes
Great Leaps Forward on Microsoft Windows
Substantially faster maintenance = less
downtime
And that’s only the beginning!!!
Simplify your business
Any Questions
Tom Bascom
Greenfield Technologies
[email protected]
http://www.greenfieldtech.com
63
Resources
http://psdn.progress.com/library/white_papers/benchmarks/index.ssp
http://www.greenfieldtech.com/downloads
Simplify your business
http://www.greenfieldtech.com/articles
64