Transcript Presentation Title Verdana Bold 34 pt.

HP OpenVMS
Technical Update:
V7.3-2 and Beyond
Andy Goldstein
OpenVMS Engineering
[email protected]
© 2003 Hewlett-Packard Development Company, L.P.
The information contained herein is subject to change
Agenda
•
•
OpenVMS Directions & Roadmap
2003 Alpha Coming Attractions
–
•
2003 Itanium-based System Plans
–
–
•
OpenVMS Alpha V7.3-2 (Opal)
OpenVMS E8.0 (Itanium EAK)
OpenVMS E8.1 (Itanium EAK)
2004 VAX/Alpha/Itanium Plans
–
7/17/2015
OpenVMS V8.2 (Topaz)
HP World 2003 Solutions and Technology Conference & Expo
page 2
HP OpenVMS Roadmap
02
03
04
05
HP AlphaServer
EV68
EV7
EV79
Sell at least until
2006; support at
least until 2011
Itanium®-based
HP server
Itanium® 2
processor
Madison
Itanium®-based
system upgrades
Itanium®-based
system upgrades
HP
OpenVMS
Alpha
Version
7.3
HP OpenVMS
Industry
Standard 64
7/17/2015
Version
7.3-1
Version
7.3-2
hp OpenVMS I64 V8.2 (2004)
(3rd Release Production Quality)
& hp OpenVMS Alpha V8.2
Boot Jan ‘03
OpenVMS I64 V8.0 H103
Eval. Release
OpenVMS I64 V8.1 H203
Eval. Release
Future releases
providing
continued
enhancement &
support
Platform transition period
HP World 2003 Solutions and Technology Conference & Expo
page 3
HP OpenVMS Operating System
Roadmap
2004
2003
OpenVMS Alpha V7.3-2 (Opal)
Minor Release
FRS: Q403
•Ongoing EV7 platform support
•Performance Enhancements
•Unix® Portability Standards
•Availability enhancements
•DECwindows XllR6 support
OpenVMS I64 V8
Initial Release (V8.0): H103
Update Release (V8.1): H203
2006
2005
OpenVMS V8.2 (Topaz)
Major Feature Release
Platforms: Alpha, VAX
& I64
FRS: 2004
•Performance
•Security
•Storage
•Standards
•Alpha Compatibility with
OpenVMS Clusters for
Integrity Servers
OpenVMS V8.x
New Feature Release
Platforms: Alpha and I64
FRS: 2005
•Performance
•Security
•Storage
•Standards
COE 42P4 on OpenVMS V8.2
HW Update to V7.3-1
V7.3-1 plus HW remedial kit
FRS: Available Now
OpenVMS releases
•EV7 New System Support
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page 4
OpenVMS Service Support Roadmap
VAX
V5.5-2
Prior Version Support
V6.2
Prior Version Support
V7.2
Alpha
Standard Support
Prior Version Support
V7.3
Standard Support
V6.2x
Prior Version Support
V7.2-1
Std. Support
V7.2-1H1
Std. Support
V7.2-2
V7.3
V7.3-1
Standard Support
Prior Version Support
Standard Support
Standard Support
Jan-02 Apr-02 Jul-02 Oct-02 Jan-03 Apr-03 Jul-03 Oct-03 Jan-04 Apr-04 Jul-04
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page 5
OpenVMS Alpha
….2003 Coming Attractions
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page 6
OpenVMS V7.3-2 (Opal)
•
•
•
Field test started the end of June, 2003
Target shipment date = Q4CY2003
Focus Areas:
– System and Hardware Support
– General User Features
– System and I/O Performance Enhancements
– Security Features
– System Management
– More updates for e-Business and integration
– More UNIX Portability features
– Availability Features
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
Alpha
page 7
System and Hardware Support
•
Marvel Enhancements
–
•
Error Log Viewer (ELV)
–
–
•
•
•
32P mixed-speed CPUs support
Easy to use bit-to-text errorlog translation tool
No analysis just decoding
Analyzer Tool for EV7
SDA support for OCLA (On Chip Logic Analyzer)
DS15 Support
–
DS10 follow-on
– Supported on OpenVMS V7.3-1
•
MSA1000
–
–
7/17/2015
Support for new low-end Fibre Channel RAID Array
Supports both switched and arbitrated-loop
HP World 2003 Solutions and Technology Conference & Expo
page 8
General User Features - DCL
•
Blocks to Bytes Enhancements
–
–
–
–
$ SET PROCESS/UNITS=(BYTES,BLOCKS)
$ SHOW PROCESS/UNITS
Allows a process to display information from a variety of DCL
commands as bytes (KB, MB, GB, …)
The DCL commands that honor the units setting are:
• COPY
• DELETE
• DIRECTORY - /SIZE=(UNITS=(BYTES,BLOCKS) to override
• PURGE
• SHOW DEVICE - /SIZE=(BYTES,BLOCKS) to override
• SHOW MEMORY
• SHOW QUOTA
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page 9
General User Features - DCL
•
DCL command size limits increased
–
Interactive DCL commands have been increased from 255
characters to 4095
– DCL commands in a file have been increased from 1024
characters to 8192
– DCL Symbol sizes have been increased from 1024 to
4096
•
The sizes for logical names (255) has not changed
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
10
System Management - Backup
•
New Qualifiers for the BACKUP utility
–
/FILES_SELECTED=filename
• Allows the use of a file to contain a list of files to be selected
when a save set is restored.
• This can be used in place of the /SELECT qualifier
–
/INPUT_FILES=filename
• Allows the use of a file to contain a list of files to be specified
for a BACKUP operation
–
/HEADER_ONLY=(keyword)
• Can be used to specify that only the header of shelved or
preshelved files are saved in a backup
• Avoids unshelving shelved files which is the default behavior
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
11
System and I/O Performance
Fastpath
•
LAN Drivers
–
–
•
PEdriver
–
–
–
–
•
Move off of IOLOCK8 to LAN device specific spinlocks
Allow device interrupts to CPUs other than the primary
Move off of IOLOCK8 to PE specific spinlocks
Allow a specific CPU to be chosen for PEdriver processing
Allows PEDRIVER to process cluster communications on a
single CPU
Reduces CPU cost due to streamlined codepath also for
served block data
Fastpath for Smart Array 5300
–
–
7/17/2015
Backplane RAID controller
Offload IOLOCK8 spinlock, allows CPU selection
HP World 2003 Solutions and Technology Conference & Expo
page
12
System and I/O Performance
WSMAX and BALSETCNT
•
•
Large systems often had to make compromises
between large working sets or a large number of
processes in memory
If you wanted a large BALSETCNT, you often had to
reduce WSMAX or visa versa
–
•
•
These trade offs could result in either increased swapping
activity if BALSETCNT was too low or increased paging
activity if WSMAX was too low
These restrictions have been removed
The BALSETCNT parameter has also become dynamic
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
13
System and I/O Performance
Working Set in S2 Space
•
•
Remove WSMAX and BALSETCNT restrictions
Currently balance slots live in S0S1 space
–
–
–
•
S0S1 is a shared 32 bit space of 2GB in size
Balance Slot size is heavily based on WSMAX
Some customers today must trade-off large number of
resident processes (BALSETCNT) vs. large working set
(WSMAX)
We are breaking balance slots into a balance slot and
working set slot
–
–
7/17/2015
The Working Set List is the major part of a Balance Slot
The working set slot will exist in S2 space
HP World 2003 Solutions and Technology Conference & Expo
page
14
System and I/O Performance
SMP Improvements
•
•
•
•
•
SMP systems synchronize various code with spinlocks
Only a single CPU can hold a specific spinlock and thus
operations that use the same spinlock are serialized
A commonly used spinlock is the SCHED spinlock
A high frequency operation to lookup a process has
been improved to use a “process specific” spinlock for
the necessary synchronization
In addition, the $HIBER and $WAKE system services
have been improved to reduce the usage of the
SCHED spinlock
–
7/17/2015
In some cases – SCHED is no longer required at all
HP World 2003 Solutions and Technology Conference & Expo
page
15
System and I/O Performance
SCHED spinlock
•
NAM_TO_PCB is heavy contributor to SCHED spinlock
–
–
•
Use PCB spinlock
Process control system services (prcnam argument)
$HIBER and $WAKE
–
–
No need for SCHED spinlock to wake current process
PCB$V_WAKEPEN bit in PCB$L_STS synchronized
under SCHED spinlock
– new PCB$V_WAKEPEN bit moved to PCB$L_STS3
– waking up current process from within AST saves 2
SCHED acquire/release
– waking up target process not current on any CPU saves 1
SCHED acquire/release
– Helps multi-threaded processes (i.e. Java apps and
friends
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
16
System and I/O Performance
eXtended File Cache (XFC)
•
•
•
•
•
•
•
•
•
Performance boosts for small I/Os
Support for read ahead hint
Reclaim unused and closed files
Fixed misaligned fields in context block
Usability and debugging improvements
Display files by volume instead of random order (SDA)
Miscellaneous XFC SDA changes to help troubleshoot
More efficient use of memory
More useful and readable displays
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
17
System and I/O Performance
•
Quieter MOUNTVERIFY messages
–
–
Reduces noise on the console and in operator log file
Multiple reasons for mount verifications in a Storage Area
Network (SAN) environment
• Path switch by another cluster node
• Dropped Fibre Channel packets
• Rezone of a SAN, which causes in-flight I/Os to be dropped
–
–
–
7/17/2015
Those messages should not be flagged as errors
Filter real “attention needed” error messages
MVSUPMSG_NUM and MVSUPMSG_INTVL are new
system parameters to control
HP World 2003 Solutions and Technology Conference & Expo
page
18
RAS Features
•
LAN Failover
–
–
•
Multipath Party Intercept
–
–
•
Ability to define multiple network adapters as virtual
network interface
Transparent failover to similar LAN device
Allows multiple DDT intercepts for multipath devices
Primarily for 3rd party disk caching products who try to
intercept I/Os
Component Indictment – CPU
–
–
7/17/2015
Pro-active stop failing CPU
Target audience are customers using Compaq Analyze
HP World 2003 Solutions and Technology Conference & Expo
page
19
Shadowing
•
Dynamic Volume Expansion
–
–
•
Dissimilar Device Shadowing
–
–
•
Initialize device with a “maximum” size to which volume can
expand
Allows a disk to be replaced with a larger one
Disks with different sizes and/or geometrical configurations
can now be members in the same shadowset
Allows larger disks in size to be added, one by one, to a
shadowset to increase and expand its size
SET/SHOW SHADOW
–
7/17/2015
Enhanced commands to view and monitor shadow
environments
HP World 2003 Solutions and Technology Conference & Expo
page
20
Network Enhancements
TCP/IP Services
•
Scalable Kernel
–
•
Multiple dynamic spinlocks
–
•
No more IOLOCK8
Queue KRP (kernel request packet)
–
–
•
Performance and scalability improvements for SMP systems
Handled by fork thread on non-primary CPU
Similar to dedicated lock manager
Improve concurrency
–
–
7/17/2015
Multiple concurrent network I/O
Multiple processes can allocate mbufs, fill in data and queue
requests
HP World 2003 Solutions and Technology Conference & Expo
page
21
Network Enhancements
TCP/IP Services
•
•
•
•
•
•
SSH – secure shell (SSH) client and server
Secure POP – secure socket layer (SSL) for POP
IP address failover (failsafe IP)
New IPv6 software examples using IPv6 APIs
BIND server update to version 9.2.1
BG devices
–
–
•
Maximum number of BG devices increases from 9999 to 32K
Fast BG device creation and deletion
Performance improvements
–
–
–
7/17/2015
INET driver
NFS server
TELNET server
HP World 2003 Solutions and Technology Conference & Expo
page
22
System Management Enhancements
•
The Data Collector (TDC)
–
–
–
Version 2 will be available on the web
Can be used to gather performance data for systems
running V7.1 or later
Collect and stores the following types of data
• Cluster configurations and communications
• CPU utilization
• Disk performance
• System wide performance metrics
• System parameters
• Process utilization
•
Performance API ($GETRMI)
–
7/17/2015
Added a few new items to retrieve per-mode CPU info
HP World 2003 Solutions and Technology Conference & Expo
page
23
Security Enhancements
•
Support standards based security technologies for
secure heterogeneous communication
–
CDSA (common data security architecture)
– Kerberos V5 API’s, KDC (key distribution center) and
GSSAPI V2
– OpenSSL (secure socket layer) expanded to include 64-bit
addressing
– SSH V2 (secure shell) EAK for TCP/IP v5.3 available now
•
Provide Open Source security tools
–
–
7/17/2015
Stunnel (secure tunnel)
GnuPG (encryption for mail and support of digital
signatures)
HP World 2003 Solutions and Technology Conference & Expo
page
24
Security Enhancements
•
•
Expand OpenVMS Authentication
ACME Login (SDK)
–
–
•
ACM$LDAP Agent
–
•
New LOGINOUT and SET PASSWORD image that uses
SYS$ACM system service
Allows external authentication like LDAP
ACM$ agent for authentication against LDAP directory
UNIX Security Interoperability
–
–
–
7/17/2015
UID and GUID security identifiers
Case sensitive passwords
CDE deadman and screenlock
HP World 2003 Solutions and Technology Conference & Expo
page
25
Unix Portability (UP)
•
OpenVMS will be like any other “UNIX flavor” for easy
application portability
C-RTL (delivering UNIX style API’s on OpenVMS)
–
Introduced UP with C-RTL features like UNIX file names, 2 GB files,
POSIX root, 64-bit pointers in signals in V7.3-1
– Currently improving performance of API’s and adding function like
binary tree, Glob
– Work will continue on more UNIX feature like signals, byte range
locking, symbolic links and fork()
•
GNV (providing a UNIX style shell and utilities)
–
–
–
–
7/17/2015
Introduced UP with a UNIX style shell (BASH) and utilities in V7.3-1
Currently improving compiler interfaces (CC and GCC commands)
Adding new tools like BZIP2, GAWK and MAN
Continue to improve configure and MAKE
HP World 2003 Solutions and Technology Conference & Expo
page
26
DECwindows V1.3 For OpenVMS
•
DECwindows V1.3
Alpha
• Available January 2003
• New and enhanced X server extensions
• Support for X11R6.6
• Enhanced font support
– equivalent to Arial, New Times Roman, and Courier New
TrueType fonts
• Inter-client exchange (ICE) and session management
protocols
• Enhanced user-based and new token based access
control mechanisms
• LBX proxy server and proxy management applications
• Multithreading support
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
27
E-Business and Integration
Expanding the OpenVMS eBusiness Offerings!
•
•
•
•
•
•
•
•
•
•
•
•
SWS V1.4 (based on Apache 1.3.x)
– including updates for Perl, PHP, and CSWS_Java (Tomcat)
SWS V2.0 (based on Apache 2.0)
XML V1.1
SOAP Toolkit V1.1
SWB V1.2
Software Development Kit (SDK) v 1.4.1, for the Java platform
NetBeans 4.0
RTR V4.2
COM V1.4
Attunity Connect 4.0 “On Platform” Package
Enterprise Directory V5.3
BridgeWorks V2.2
Applications Shipping With V7.3-2
•
•
•
•
•
•
TCP/IP Services for OpenVMS, V5.4
DECnet-Plus V7.3-2
DECnet Phase IV V7.3-2
Advanced Server V7.3A
PATHWORKS V6.1
DECwindows V1.3
Upgrading OpenVMS Alpha Environments
System Software Upgrade Paths to V7.3-2
•
Direct Upgrade Paths
• V7.2-2 to V7.3-2
• V7.3 to V7.3-2
• V7.3-1 to V7.3-2
• Cluster Upgrade Paths
• Cluster rolling upgrades are supported
from V7.2-2 and V7.3x
OpenVMS Cluster Version Support
Version 7.2x Version 7.3x
7/17/2015
Version 7.2x Warranted
Migration
Version 7.3x Migration
Warranted
HP World 2003 Solutions and Technology Conference & Expo
page
31
OpenVMS
….2004 coming attractions
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
32
OpenVMS V8.2 (Topaz)
•
Target shipment date = 2004
• Candidates:
Alpha
Itanium
VAX
• System & I/O Performance Enhancements
• Cluster Interconnect Enhancements
• Fibre/SAN enhanced support including
Disaster Tolerance Enhancements
• Continued Security Enhancements
• More updates for e-Business and integration
• Alpha Compatibility with OpenVMS Itanium ™
release, including Clusters
• More UNIX Portability features
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
33
HP OpenVMS Industry Standard 64
for Integrity servers ….
2003/2004 coming attractions
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
34
HP OpenVMS Industry Standard 64 (I64)
Release Roadmap
H103
H203
H104
H204
1st Boot on i2000 system, January 31, 2003 3:31 PM EST
Boot on rx2600 system (First Ship platform), March 17, 2003
H103: HP OpenVMS I64 V8.0 “Mako” Evaluation Release
Audience: Selected ISVs and Partners
First Ship
OpenVMS Itanium Operating System, Monitor Utility
Networks: DECnet Phase IV, TCP/IP
Development Tools: Cross Linker, Cross Librarian, Native Debugger
Cross Compilers: C, C++, BLISS, FORTRAN, IMACRO
Shipped on
June 30, 2003 !!
H203: HP OpenVMS I64 V8.1 “Jaws” Evaluation Release
Audience: Key ISVs, Partners, Early Adopters
Limited cluster functionality (4 nodes)
Native Compilers: C, C++, BLISS, FORTRAN, IMACRO,
Pascal, BASIC, COBOL
Additional Language Support: JAVA
Additional Layered Products…Networks, Data Serving,
Security, eBusiness Integration, Application Development
Internal releases
External releases
7/17/2015
Production
Quality
HP World 2003 Solutions and Technology Conference & Expo
HP OpenVMS I64 V8.2
page
35
OpenVMS Itanium Platform
Rollout Plan
2005
Version 8.x
2004
 rx2600
 1-4 way Platform
 1-8 way Platform
 1-16 way Platform
 32 way Platform
 Superdome
Version 8.2
H22003
H12003
Version 8.0
 rx2600 (1-2 way)
Version 8.1
 rx2600 (1-2 way)
 1-4 way Platform
 rx2600
 1-4 way Platform
 1-8 way Platform (H2)
 1-16 way Platform (H2) CPU: Itanium Next
CPU: Itanium Next
Generation
Generation
CPU: Madison (hp sx1000)
CPU: McKinley
7/17/2015
Subject
World
20038,Solutions and Technology Conference & Expo
to change without notice - currentHPas
of July
Note: OpenVMS will not
be supported on the
rx5670
page
36
OpenVMS I64 Option
Rollout Plan
2005
2004
H22003
Version 8.x
H12003
Version 8.1
Version 8.0
Storage
 LSI U160 & U320
(non-shared)
Storage Controllers
 None
LAN (no network boot)
 5701
(10/100/1000) ethernet
 8255x
(rx2600 embedded)
Graphics
 None
Audio
 None
7/17/2015
Storage
 Fibre Channel LP9802
(No boot path)
 LSI U160 & U320
(non-shared)
Storage Controllers
 MSA1000, HSG, HSV, XP
LAN (no network boot)
 5701& 5703
(10/100/1000) ethernet
 8255x
(rx2600 embedded)
Graphics
 ATI 7500
Audio
Version 8.2
Storage
 Fibre Channel
(Boot capability)
 LSI U160 & U320
(non-shared)
 SmartArray (BPR)
Storage
 Fibre Channel
(Boot capability)
 LSI U160 & U320
(non-shared)
 SmartArray (BPR)
Storage Controllers
Storage Controllers
 MSA1000, HSG, HSV, XP
 ATI 7500, Radeon?
Audio
 MSA1000, HSG, HSV, XP LAN (Network Boot)
 570x & 8255x
LAN (Network Boot)
(10/100/1000) ethernet
 570x & 8255x
Graphics
(10/100/1000) ethernet
 TBD
Graphics
Audio
 TBD
 HP-UX Sound card
 None
HP World 2003 Solutions and Technology Conference & Expo
page
37
OpenVMS I64 Clusters
Rollout Plan
2005
2004
Version 8.x
96 Nodes
 Full Functionality
H22003
Version 8.1
H12003
2-4 Node Clusters
Cluster Interconnect
Version 8.0
Limited Clusters
available!
7/17/2015
Gigabit Ethernet
10/100 Ethernet
Alpha V7.3-1
Alpha V7.3-2
Alpha V7.2-2
Version 8.2
Cluster Interconnect
4-8 Nodes
Gigabit Ethernet
Fibre Channel
 Expanded Functionality
V8.2 (Warranted)
Cluster Interconnect V7.3-X (Migration)
Gigabit Ethernet
Fibre Channel
V8.2 (Warranted)
Alpha V7.3-X (Migration)
HP World 2003 Solutions and Technology Conference & Expo
page
38
Current Itanium Porting Status
•
Cross Tools
–
C, C++, Bliss, iMacro, IA64 Assembler cross compilers
– Cross Linker
– Cross SDA allows for IA64 dumps analysis on Alpha
•
Console
–
•
Serial line (no graphics, no keyboard, no mouse yet)
Booted on
–
–
–
–
7/17/2015
i2000 (Merced) from IDE disk (swappable HD)
rx2600 (McKinley) from SCSI disk (U160 & U320) and
CDrom IDE
zx2000 (McKinley) from SCSI (U160 & U320), CDrom IDE
and swappable HD
1-4 way system
HP World 2003 Solutions and Technology Conference & Expo
page
39
Current Itanium Porting status
•
What is working
–
–
–
–
–
–
•
Almost all of the base OS is working
Editors (EDT, TPU)
DEBUG
SMP
Native MONITOR
Mixed Architecture Clusters
Layered Products
–
–
–
–
–
7/17/2015
DECnet Phase IV
TCPIP (telnet, ftp)
DECdfs
DECwindows Client
DECset tools (CMS, MMS, DTM, LSE)
HP World 2003 Solutions and Technology Conference & Expo
page
40
Current Itanium Porting status
•
What is not yet working (July 14th)
–
–
–
–
Edit/Teco
Delta Debugger
System Code Debugger (SCD)
INSTALL performance features
– Security Server
– Registry Server
– ACME Server
– Shadowing
– Fibre Channel Boot
– Cluster Satellite Booting
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
41
Current Itanium Porting status
•
OpenVMS I64 and OpenVMS Alpha are built from a
common code base
–
About 95% of the code is common
•
The OpenVMS I64 V8.0 evaluation kit shipped to a
limited ISV audience with all of the features in the
OpenVMS V7.3-2 field test kit.
•
Any enhancements or performance improvements
made to OpenVMS benefit both platforms
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
42
HP OpenVMS
Still Exceeding Expectations
Boot to 4 processor server
July 2, 2003
OpenVMS V8.0 Evaluation Release
June 30, 2003
1st Application Port & Mixed Cluster
May 15, 2003
Boot to rx 2600 server
March 17, 2003
OpenVMS
1st Boot to Itanium® system
January 31, 2003
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
43
7/17/2015
HP World 2003 Solutions and Technology Conference & Expo
page
44