Title of Your Presentation

Download Report

Transcript Title of Your Presentation

FOCUS Support for the zIIP Specialty Engine

Joel Starkman Director of Operations, FOCUS Division Information Builders, Inc.

September, 2009

zIIP support available in FOCUS release 7.6.10

WebFOCUS release 7.7

What does a term mean? Click on Click it again to remove it.

FOCUS and the zIIP Specialty Engine Why are we interested in the zIIP?

What is important to mainframe FOCUS and WebFOCUS customers?

 

Reduced execution time for batch windows and response time

 

Functional consistency of the application with prior releases New features consistent between FOCUS and WebFOCUS



Solid customer service

Reduce/stabilize cpu charges to IBM

Our enablement of the zIIP Specialty Engine is critical to addressing this key customer concern

FOCUS and the zIIP Specialty Engine So why zIIP?



zIIP does not count toward overall MIPS rating of the machine



May avoid/delay Central Processor (CP) or machine upgrade



No IBM charges for eligible workload CPU utilization on zIIP



Improves resource optimization by reducing latent workload demand which the CP can now absorb



May stimulate some visible performance improvement “zIIP”

: System

z I

ntegrated

nformation

FOCUS and the zIIP Specialty Engine zIIP Reduces FOCUS Usage on Chargeable CPU

**Benchmark* of zIIP Processing (cpusec)**

Values are in CPU seconds Use zIIP No zIIP Benchmark Case zIIP CP CP Offload FOCUS file w/FOCUS sort FOCUS file to EXCEL FOCUS file w/DFSORT VSAM file w/FOCUS sort DB2 file w/DB2 sort Flat file w/FOCUS sort IMS file w/FOCUS sort 36.94 13.73

52.11 7.45

38.74

60.89

65% 88% 18.14 19.35

39.57 18.47

49.22 18.03

45.26 13.22

0.16 69.19

FOCUS zIIP Monitor prevented CP cost overrun due to excessive IMS I/O overhead

27.47

59.56

30% 69% DB2 zIIP usage determined by configuration relative to FOCUS 47.98

73% 69.59

Scenario 1%

(FOCUS had 100% of zIIP capacity)

SUM 4 million records BY down to 184,341 lines

DEFINEs, COMPUTEs

FOCUS and the zIIP Specialty Engine zIIP Reduces FOCUS Usage on Chargeable CPU

**Benchmark* of zIIP Processing (cpusec)**

Values are in CPU seconds Use zIIP No zIIP Benchmark Case zIIP CP CP Offload Executive Summary (roll-up, out to PDF) 2.49 0.91

3.91

77% Operational Report (medium size) 3.18 1.82

5.08

64% Extract File (show 100% of file) 5.99 2.93

8.69

66% Exception Report (extract few records) 1.10 0.86

1.75

51% Scenario FOCUS file 1 million records

FOCUS and the zIIP Specialty Engine Inside the IBM Mainframe CP Central Processor zIIP system

z I

ntegrated

nformation

rocessor IBM System z9 BC IBM System z10 EC or IBM System z9 EC IBM System z10 Business Class

A mainframe comprises many chips, some of which are activated

IBM Mainframe

zIIP chips are available for z9, z10 (IBM has PTFs for z/OS 1.6, 1.7, and DB2 V8)

FOCUS and the zIIP Specialty Engine IBM’s Other Specialty Engines

Other types of chips

Linux Java, XML I/O May run at 100% of capacity Always 100% of capacity

IBM permits 1 zIIP per CP

FOCUS and the zIIP Specialty Engine Workload Manager

Workload Manager Guides the dispatching of work to all processors, based on performance goals set by the System Administrator Oper System TCP/IP 1000’s Jobs DB2 FOCUS Utilities

No OS No TCP/IP No Jobs

DB2 FOCUS Some Utilities zIIP offloads work initiated by the CP

FOCUS and the zIIP Specialty Engine zIIP Allows Central Processor To Do More Work

Central Processor can take on more work Queued workload Work Workload Manager and Dispatcher

FOCUS and the zIIP Specialty Engine Central Processor vs zIIP – Comparison Chart Initiates processes Executes workloads Incurs CPU charges Runs at mfg’s 100% clock speed Runs operating system and TCP/IP Number of chips permitted by IBM Code/enclave runs in: Relative cost to buy from IBM

CP zIIP

Yes All types Always Often/Usually Yes Never Eligible types Never Always No system capacity one per CP TCB mode SRB mode $1.00

$0.25

FOCUS and the zIIP Specialty Engine zIIP Access Controlled by Workload Manager Workload Manager (WLM) controls which workloads get priority access to zIIP FOCUS enables zIIP at startup after several verification steps FOCUS also captures the amount of work that COULD have gone to the zIIP, had more zIIP capacity been available Copyright 2007, Information Builders. Slide 11

FOCUS and the zIIP Specialty Engine zIIP-Enabled Mainframe Products Today

Many mainframe customers already have zIIP processors for other production processing

 FOCUS will most likely not be the first zIIP-enabled product installed at a site  System Administrators are likely to be aware of zIIP-enabling system requirements at their site DB2 Oracle Syncsort

Growing list of zIIP-enabled products

FOCUS and the zIIP Specialty Engine zIIP Reduces CPU Charges on FOCUS Usage

FOCUS customers should experience about a 30-80% cpu cost reduction*

Significant FOCUS execution occurs on the zIIP Computations Report formatting Aggregation Screening criteria Styling Transaction processing zIIP support available in FOCUS release 7.6.10

WebFOCUS release 7.7

FOCUS Activities that are not yet zIIP’able as of 7.6.10

FOCUS and the zIIP Specialty Engine zIIP Reduces CPU Charges on FOCUS Usage

Two types of work must be performed on the CP*

  I/O, including database calls and file access  FOCUS buffers records where possible to minimize the effect Calls to 3 rd -party software (like Syncsort) or non-IBI subroutines  They might actually be enabled and execute on the zIIP

FOCUS will always divert as much as possible to the zIIP.

FOCUS will monitor and adjust for optimum zIIP utilization.

“Usually better, never worse”

*due to IBM specifications

FOCUS and the zIIP Specialty Engine FOCUS Startup and User Control When

SET ZIIP=ON

is issued, FOCUS verifies that: • • • Site’s license says zIIP may be used All concatenated libraries are APF-authorized zIIP is accessible from this lpar (SRB enclave is built)

All criteria pass?

Any criteria fails?

ZIIP is turned ON ZIIP remains OFF; all work will occur on CP  Customer may issue

SET ZIIP=OFF

FOCUS and the zIIP Specialty Engine zIIP Statistics in FOCUS

New &variables &FOCCPU &FOCZIIPCPU &FOCZIIPONCP

time spent on Central Processor (existing &) time actually spent on zIIP (in SRB mode) time enabled for zIIP but not permitted to run there by Workload Manager / Dispatcher

FOCLOG Retention of zIIP Statistics FOCLOG expanded to capture zIIP statistics

 time actually spent on zIIP  time enabled for zIIP but not permitted to run there Captured for

entire session

and for

every command

Site Analyzer

FOCUS and the zIIP Specialty Engine Upgrading to 7.6.10 from prior releases

The FOCUS 7.6 product line is:

 Battle tested by customers for over 3 years  Installed at hundreds of sites worldwide  The most thoroughly tested release ever  Already 20+% faster due to new IBM-C compiler The zIIP further enhances that with a shift of workload

Moving up from 7.3? 7.2? 7.1? 7.0.9? 7.0.8R?

FOCUS and the zIIP Specialty Engine WebFOCUS Console for zIIP Statistics

Let’s look deeper inside the zIIP Specialty Engine                      

Let’s look deeper inside the zIIP engine

Let’s not

Switching from TCB Mode (CP) to SRB Mode (zIIP)  zIIP may be too full right now to access from TCB Island  Look at &FOCZIIPONCP   Pay ‘switch’ toll in both directions Toll may increase or decrease with frequency of travel  Tolls may add up so much that zIIP Monitor says you might as well stay on TCB Island  Island switching for:    Each I/O action Each call to 3 rd party software Each call to non-IBI subroutines

Dispatcher / Workload Manager

End-of-Job Statistics (at IBI) Customer may show their own statistics * INFORMATION BUILDERS * STEP TERMINATION STATISTICS * * STEP NAME FOCUS START TIME 15:38:12.25 VIRT SYS USED 320K

Un-normalized (real speed) No & variable Normalized to CP speed &FOCZIIPCPU

* MAIN STG UNITS 122,822 CPU UNITS 191,474 SRB UNITS 1,212 * ZIIP 00:00:05.93 ZIIP vs CP 00:00:16.44 ZIIP ON CP 00:00:00.00 ******************************************************************************* ***************************************************** PAGE INS 0 STEP CPU 00:00:00.86 *

zIIP’ed but not

NUMBER PAGES 0 SRB TIME 00:00:00.11 *

run on zIIP &FOCZIIPONCP

* * *

CP cpu includes ZIIP ON CP &FOCCPU

I/O UNITS 3,661 COMPLETION CODE R0000 * ZIIP ENCLV 00:00:00.00 IIP DEP ENCLV 00:00:05.93 * ***************************************************** * * INFORMATION BUILDERS * STEP TERMINATION STATISTICS * * STEP NAME FOCUS START TIME 15:38:12.25 VIRT SYS USED 320K * PROGRAM NAME FOCUS STOP TIME 15:39:20.77 VIRT CORE USED 124K * DISPATCH PRIORITY 0 ELAPS TIME 00:01:08.52 SWAP COUNT 0 * LPA+CSA PAGE-INS 0 HIPER+DATA SPACE (HI-WATER MARK) 0M * PERFORMANCE GROUP 0 SERV UNITS 319,169 * MAIN STG UNITS 122,822 CPU UNITS 191,474 SRB UNITS 1,212 * ZIIP 00:00:05.93 ZIIP vs CP 00:00:16.44 ZIIP ON CP 00:00:00.00 ****************************************************************************** PAGE INS 0 STEP CPU 00:00:00.86 * PAGE OUTS 0 JOB CPU 00:00:00.86 * NUMBER PAGES 0 SRB TIME 00:00:00.11 * EXP PAGE-OUTS 0 * TRN TIME 00:01:03.30 * I/O UNITS 3,661 COMPLETION CODE R0000 * ZIIP ENCLV 00:00:00.00 IIP DEP ENCLV 00:00:05.93 * *****************************************************

Installation/Upgrade Issue New FOCUS License File for 7.6.10+      New for FOCUS 7.6.10 and onward Replaces zapped license string -- but not yet Content is encoded, but character-based for portability Also contains unencoded text of what is licensed FOCUS 7.6.10 ships with default license file  User sees error about obtaining license via email  Put license file from email attachment into file named FLICENSE in ERRORS  Do not touch the content. Encoded, highly positional Copyright 2007, Information Builders. Slide 23

FOCUS License File License file identifies:   Expiration Date, if any Grace Period, if any for:      Site Each licensed FEATURE (only for ZIIP right now) Each licensed CPU (none right now) Each licensed LPAR (none right now) “ALL OTHERS” that are not explicitly mentioned, for each of: FEATURE, CPU and LPAR FOCUS will enforce these zIIP license contract conditions Copyright 2007, Information Builders. Slide 24

FOCUS License File

Sample License File

(assume today is 7/24/2009) -* FOCUS license for site 9999.01 created on 07/24/09 at 16.30.32 -*SITECODE 9999.01 LICENSED PERPETUALLY -*UNLICENSED CPUS ALLOWED TO RUN PERPETUALLY -*FEATURE ZIIP LICENSED UNTIL 20091025; GRACE PERIOD UNTIL 20091124 -*OTHER FEATURES LICENSED PERPETUALLY C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 C4E4D4D4E840E3C5E7E3404040404040404040404040404040404040404040404040404040 Encoded lines shown here are not actual encoded strings Unencoded header record Unencoded detail records Encoded detail records Copyright 2007, Information Builders. Slide 25

License Startup Messages YOU ARE USING A NON-AUTHORIZED LIBRARY; ZIIP WILL NOT BE USED CANNOT BUILD ENCLAVE; ZIIP WILL NOT BE USED (FOC32598) LICENSING FILE CONTAINS INVALID INFORMATION (FOC32589) EXECUTION TERMINATED (FOC32599) WARNING! YOU ARE USING AN UNLICENSED PRODUCT: FOCUS (FOC32592) EXECUTION REMAINS ENABLED PERPETUALLY (FOC32588) LICENSE EXPIRATION DATE: 20001231 (FOC32590) EXECUTION REMAINS ENABLED UNTIL: 20991231 (FOC32591) EXECUTION WAS ENABLED UNTIL: 20081231 (FOC32593) WARNING! YOU ARE USING AN UNLICENSED FEATURE: ZIIP (FOC32595) FEATURE REMAINS ENABLED PERPETUALLY (FOC32579) ZIIP WILL NOT BE ACCESSED. LICENSE FOR ZIIP EXPIRED Copyright 2007, Information Builders. Slide 26

APF Authorization   FOCUS module is shipped APF-authorized (AC flag set to 1) All load libraries invoked on the zIIP must be APF-authorized   STEPLIB concatenation USERLIB - All non-IBI user function libraries must be authorized    On startup, if an unauthorized library is detected, FOCUS starts unauthorized, sets ZIIP=OFF and runs everything on CP  Could be done intentionally to force no zIIP TSO - SysAdmin must make “FOCUS” a TSO-authorized command Limitation - If you execute FOCUS from ISPF option 6, you will not be able to issue TSO ISPF or IEDIT from within FOCUS  Suggestion - Customer could keep an unauthorized copy of FOCLIB, just in case Copyright 2007, Information Builders. Slide 27

Simulate zIIP usage to estimate need Don’t have a zIIP at your site?

FOCUS not using enough zIIP?

Put in sys1.parmlib:

PROJECTCPU=YES

SET ZIIP=OFF SET ZIIP=ON

/SIMMAXZIIP

Makes FOCUS think zIIP is there  Auto-turns on SIMMAXZIIP  All zIIP usage goes to &FOCZIIPONCP Simulates job running as if zIIP had full capacity  Monitor allows zIIP usage to continue longer, even though it is not effective at that moment  zIIP usage would have been:  zIIP usage would have been: &FOCZIIPCPU (0) + &FOCZIIPONCP &FOCZIIPCPU + &FOCZIIPONCP Copyright 2007, Information Builders. Slide 28

Workload Manager – Quick Concepts

WLM makes a contract between the user and the OS to run work across a parallel sysplex in distinct service classes and with defined goals. WLM samples the system every 250ms to derive a Performance Index (PI) to measure goal achievement.



Response time goals



Average response time goal

– Average time in which any job must complete (skewed by long running jobs) 

Percentile response time goal

– Percent of all work requests which must complete within a predefined time limit (say 90%)  

Discretionary Goals

– Perform specific workloads only when resources are available, and preempt in favor of other workloads

Velocity Goals

Workload Manager/Dispatcher – Routes work to zIIP

WLM dispatches work to all processors based on a performance goal algorithm, tuned by local system administrator

 Execution Velocity Goal VELOCITY = CPU used / (CPU used + CPU delay) *100  Velocity 100 implies no delay is acceptable; highest priority  Velocity <100 implies potentially longer processing time  Declarable choices for zIIP-enabled work:  Always wait for zIIP; do not run zIIP-able code on CP  Try several times, then give up and run on CP Copyright 2007, Information Builders. Slide 30

FOCUS and the zIIP Specialty Engine Some zIIP-related Terminology

Velocity Preemptible TCB SRB

The acceptable amount of delay a process can be allow to incur when competing for execution among other tasks Allows the Dispatcher to interrupt a task at any time to run other work at the same or higher dispatching priority; Non-preemptible units (such as local SRBs), once dispatched, continue to run until they complete or incur a voluntary interrupt, like suspend/page fault Task Control Block - dispatchable unit (DU) runs at dispatching priority of address space; preemptible (non-zIIP) Service Request Block - dispatchable unit (DU) runs at supervisory priority; not preemptible (zIIP-able)

Enclave Client SRB

Entity that encapsulates the execution units (TCBs and SRBs) which execute programs on behalf of the same work request Created and executed like an ordinary SRB but runs with client (scheduler) dispatching priority and is preemptible

Enclave SRB Enclave Service

Created and executed like an ordinary SRB but runs with Enclave dispatching priority and is preemptible Enable workload manager to create and control enclaves Copyright 2007, Information Builders. Slide 31

FOCUS and the zIIP Specialty Engine Recap from Cruising Altitude       

A zIIP is almost entirely a cost saving mechanism

. CPU usage is not counted toward the maximum observed capacity of an LPAR.

50-80% cost reduction due to zIIP is applicable to both FOCUS and WebFOCUS

on the mainframe.

A zIIP chip is identical to a Central Processor

chip when shipped from the IBM factory. At installation time, its

microcode is changed

to restrict its capabilities to those definable as a zIIP.

A zIIP always runs at 100% speed.

A Central Processor’s speed may be stepped down for cost saving considerations.

I/O is not performed on the zIIP

what it is enabled to perform. . No program runs entirely on zIIP; the zIIP absorbs sub-task work from the Central Processors (CP), and only

FOCUS calls all non-IBI services from CP

(system sort, non-FOCUS database products, all customer-written functions) as if they are not zIIP enabled. They then might execute on the zIIP.

The degree of zIIP usage is largely site dependent.

and on available capacity at that moment. Although a program may be zIIP-enabled, Workload Manager drives the Dispatcher to determine at each execution whether or not to direct any or all of the program to the zIIP, based on settable system performance expectations Copyright 2007, Information Builders. Slide 32

OCUS Support for the zIIP Specialty Engine

Thank You

zIIP support available in FOCUS release 7.6.10

WebFOCUS release 7.7

Title of Your Presentation

Transcript Title of Your Presentation

FOCUS Support for the zIIP Specialty Engine

Reduce/stabilize cpu charges to IBM

Benchmark* of zIIP Processing (cpusec)

Benchmark* of zIIP Processing (cpusec)

FOCUS customers should experience about a 30-80% cpu cost reduction*

OCUS Support for the zIIP Specialty Engine

Directory

**Benchmark* of zIIP Processing (cpusec)**

**Benchmark* of zIIP Processing (cpusec)**