Transcript Progress Executive Industry Overview_Banking

From technology to solutions:
Customer Centric Testing
@ Silicon India Software Testing Conference
Hyderabad
March 26 2011
Ramesh Loganathan
VP (Products) & Center head, progress software- Hyderabad
Familiar..?
In next 30 minutes..
Software consumption patterns are shifting. Enterprises are now
increasingly looking for solutions to their biz problems, And not
just technology to address their software needs.
The biz problems are also undergoing paradigm shifts with
problems spanning departments within and outside the
organizations.
The talk will deliberate on some of these challenges and
approaches possible to address them.
Enterprise scenarios today
Continuously anticipate problematic
events and re-prioritize to keep planes
in the air and passengers happy
Dynamically up-sell based on customer
activity, context and location
Investigate potentially fraudulent activity
while it’s happening and prevent it from
spreading
Business Strives for Operational Responsiveness…
4
© 2011 Progress Software Corporation. All rights reserved.
Constantly Increasing Pressures for
Responsiveness
Source:
mail
express
fax
e-mail
Document transfer
100 ms
20 min
Responsiveness
is the key to
surviving the
pace of
competition
30 sec
8 hr
10 sec
1 day
1 day
1 min
5
weeks
Trade settlement
2 hrs.
4 weeks
Build-to-order PC
1 day
days
© 2011 Progress Software Corporation. All rights reserved.
hours
Phone activation
Refresh data warehouse
0.5 hour
5 days
Call center inquiries
Supply chain updates
15 min
1 week
Airline operations
Track financial position
5 min
3 days
Typical
Business
SLAs
20 ms Algorithmic trading
minutes
seconds
At this speeds,
one cant operate looking at the rear-view
6
© 2011 Progress Software Corporation. All rights reserved.
Cannot afford not being prepared or quick
What is needed:
Visibility
Response
7
© 2011 Progress Software Corporation. All rights reserved.
Enterprises need to be Operationally
Responsiveness
Real-time
Business Visibility
Immediate Senseand-Respond
Continuously improve your
business’ Operational
Responsiveness
8
© 2011 Progress Software Corporation. All rights reserved.
Continuous
Business Process
Improvement
Challenge:
Can’t Rip/Replace Critical Business Applications
Business improvement in
mission-critical systems
9
© 2011 Progress Software Corporation. All rights reserved.
=
Changing the engines on
an airliner while in flight
Enterprises massively distributed today:
Example- The Transportation & Logistics Value Chain
Customer
Event & Information Network
Document
Mgt
Contract
Services
Customer
Service
Carrier
Determination
Warehouse
Mgt
Crew Mgt
Claims
Reconciliation
Settlement
Planned
Tenders
HRMS
MRO
Invoicing
Engines
Project
Mgt
Asset
Mgt
Domestic
International
Warehousing &
Distribution
Trade Services
Goods
Mgt
Carrier
Optimization
Collections
Billing
Routing
Sales &
Outbound
Processing
10
Planning &
Dispatching
© 2011 Progress Software Corporation. All rights reserved.
Intermodal
Services
Processes & Integration everywhere
Existing
Process
Shadow
Process
Improve
Model
Typical
BPM
Order Entered
Monitor
Automate
Credit Checked
Order
Approved
Order
Denied
Improve
Model
Shadow
Process
Non-intrusive monitoring of existing processes
Does not require re-automation of process
11
© 2011 Progress Software Corporation. All rights reserved.
Monitor
Need to Continuously track & optimize
Automate
Exception
Management
Workstep
Warehouse
status
SAP
SAP shipping
Oracle
Siebel
Product catalog
Logistics
ERP
CRM
12
© 2011 Progress Software Corporation. All rights reserved.
Event driven enterprise solutions
Examples:
Fraud detection
Cross-promotion
13
© 2011 Progress Software Corporation. All rights reserved.
Aggravated by the cloud
Customer
Claims
Reconciliation
Invoicing
Engines
Settlement
Business processes that span people, systems and
departments
Document
Mgt
Contract
Services
Customer
Service
Carrier
Determination
Planned
Tenders
HRMS
MRO
Warehouse
Mgt
Crew Mgt
Project
Mgt
Asset
Mgt
Domestic
International
Warehousing &
Distribution
Trade Services
Goods
Mgt
Carrier
Optimization
Collections
Billing
Routing
Sales &
Outbound
Processing
14
www
Intermodal
Services
Planning &
Dispatching
© 2011 Progress Software Corporation. All rights reserved.
Business Process
The SOA enabled cloud- services everywhere!
User
s
acce
ss
on
www
UI services
app
BAM
Event EngineUI services
2
events
app
1
…
enterprise
3
5
UI services intranet
app
UI services
app
hosted 4
virtualization
platform
ww
!w
5
Amazon
EC2
UI services
app
SaaS
www SaaS
virtualization
UI services
app
15
PaaS
5
Serious challenge testing in this environment…
© 2011 Progress Software Corporation. All rights reserved.
cloud
5
Google App engine
Web based
Admin
s3
S3
5
What does this mean for
Testing & Quality Assurance?
Must be very reliable.. Out of the door
Else, with poor reliability can never ensure Operational Responsiveness
Not this kind of reliability though…
17
© 2011 Progress Software Corporation. All rights reserved.
Customer centric testing

 Test, Keeping customer more in focus
 Testing biz solutions as opposed to technology
New challenges to the software quality assurance process.
Software QA organizations must be much more aware of these usecases and not just the
functionality defined in the functional specifications or the technology standards.

Devise approaches that bring customer environments inhouse
into the automated testing suites & processes.

18
Must stress and regress functionality. in more complex endues scenarios.
© 2011 Progress Software Corporation. All rights reserved.
Beyond solution stacks.. Distributed solutions’
testing
Challenges:
 Multiple layers &
distributed
 Data Driven Testing (No
GUI)
 Difficulty in isolating bugs
 Lack of effective reporting
and debugging capabilities
 Integration &
interoperability
 Involvement of 3rd party
services
 Different authorization /
authentication approach
 Performance testing
problems
19
© 2011 Progress Software Corporation. All rights reserved.
Stress the new features in an integrated enterprise
•Software Systems have to be very robust
•Reliable and work as designed
•Under stress and varied use conditions
20
© 2011 Progress Software Corporation. All rights reserved.
Testing in & for the cloud
 Testing a solution in the
context of a cloud
• Integration to apps in the
cloud
 Testing solutions running in the
cloud
 Acceptance testing of solutions
procured OFF the cloud
(SaaS)
 Testing solutions in the context
of massive integration
• Boundary conditions become
extreme
21
© 2011 Progress Software Corporation. All rights reserved.
Release cycles now more frequent
Testing for rapid releases (Web2.0 & SaaS style)

Continuous integration is a trend that is rapidly being adopted in testing
•

Leveraging virtualised test environments
•

•
The developer who checked in the offending code is probably still nearby and can quickly fix or
roll back the change.
Go Agile!
•
22
Performs the build before the check-in is finalised, allowing the check-in to be aborted if it
would cause a break, or if it fails the tests.
And given historical code coverage data from test runs, the tool can identify which one of the
several thousand test cases needs to be run when a new build comes out - significantly
reducing the build validation time.
Failed builds and tests are found Immediately
•

As soon as code is checked in, a build workflow kicks in that compiles the code - deploys it on
to a virtualised test environment, triggers a set of unit and functional tests on the test
environment, and reports on the results.
VSTS takes the build workflow one step further, even before checkins
•

Include build automation, auto-deployment of the build into a production-like environment, and
ensuring a self-test mechanism such that at the very least, a minimal set of tests are run.
With Agile getting more mainstream, what are the QA changes needed in integrating into Agile
methodologies. In particular, with scrum, how would QA function? If QA is part of a scrum
team, how will integration QA work
© 2011 Progress Software Corporation. All rights reserved.
On-demand (virtualized) test infrastructure
 Have access to lot of customer scenarios- real or
assumed
 Easy setup of environment
• Accelerate set-up/tear down and restoration of complex
virtual environments to a clean state, improving machine
utilization
 Developers can access
• Eliminate no repro bugs by allowing developers to recreate
complex environments easily
 Better automation of customer environment testing
• Improve quality by automating virtual machine provisioning,
building deployment, and building verification testing in an
integrated manner (details later)
23
© 2011 Progress Software Corporation. All rights reserved.
Can we be pro-active?
We can do better than this..
 Top-down, dev driven
 Avert bugs, rather than testfind-fix
 From definition & design
thru implementation
 Interesting research work in
ensuring Dev Tools help
24
© 2011 Progress Software Corporation. All rights reserved.
About Progress Software
 A publicly traded (PRGS) $500M enterprise software company
with a solid track record of growth with more than 25 years of
profitability
 More than 140,000 customers and 2,500 partners in more than
175 countries
 More than $5 billion of Progress technology, partner applications
and services are sold each year to thousands of companies
 Invented both the Enterprise Service Bus and commercial
Complex Event Processing
25
© 2011 Progress Software Corporation. All rights reserved.
Progress Responsive Process Management Suite
Financial Services
Accelerators
Real-time
Market
Surveillance
Communications
Accelerators
Revenue
Assurance
Enterprise Integration
26
Travel & Logistics
Accelerators
© 2011 Progress Software Corporation. All rights reserved.
Smart
Airlines
Data Services
Why Progress?
Progress Delivers Value for the Banking Industry
27
Enable
Business
Strategy
Trusted
Partner
Industry
Expertise
Lowest Cost
of Ownership
© 2011 Progress Software Corporation. All rights reserved.
Driving Your Business with Responsive Process
Management (RPM)
28
© 2011 Progress Software Corporation. All rights reserved.
Progress Success in Banking
29
© 2011 Progress Software Corporation. All rights reserved.
Progress Internal use only
Operational Responsiveness
2 5
8
11
1
3
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
4
Monitor and share continuous
real time information to the
appropriate service
providers.
7
5
6
6
8
10
12
13
Enable invoicing
engines to
Customer Request for Outbound Service (via phone, email, EDI, fax)
Appointment for Pickup – Service Provider schedules pickup
simultaneously manage
Routing Assignment Scheduling (Equipment, crew, intermodal options, delivery windows…)
tariffs, claims, discounts,
Intermodal Notification (Anticipate inbound schedule crew, equipment,… )
and equalization.
Outbound Origination (Shipments in transit)
Location Updates with current location several times en route
Alert Intermodal Carrier - Delayed Inbound
Outbound Delivery to Intermodal Service- Reschedule Equipment and crews
Intermodal Outbound – Shipment in Transit
Location Updates with current location several times en route
Late Arrival- Shipment arrives late at customer.
Drop Off. Proof of Delivery (POD) received.
Reconciliation. Customer reports damaged goods and SLA violation.
Continuous Process Improvement
– automate, adapt and create new
business processes
31
9
© 2011 Progress Software Corporation. All rights reserved.
??







32
For products automation is easy (as it is a necessity to reduce repetitive work). But
how would we incentivize automation for services- especially turnkey projects (that
may or may not have maintenance phase following dev)
In multi project/SI environments, what has your experience been building
QA/Automation frameworks that could be used across projects?
How do you factor in frequent handle UI changes when automating tests
Challenges in testing multi-channel UI (web/mobile/et al)
Do you think it will be practical to integrate testing & code-coverage on a nightly basis
and help accelerate fixing the bugs (by identifying regressive checkins, that caused
test failures)?
Cloud challenges? What shifts in QA thinking/test approaches would we need to test in
the cloud? If there are multiple solutions in the cloud, how would integration testing
work? Your experiences. (all)
80s manual. 90s rich UI. 2000 web. 2010s- what?
© 2011 Progress Software Corporation. All rights reserved.
The Transportation & Logistics Value Chain
Customer
Event & Information Network
Document
Mgt
Contract
Services
Customer
Service
Carrier
Determination
Warehouse
Mgt
Crew Mgt
Claims
Reconciliation
Settlement
Planned
Tenders
HRMS
MRO
Invoicing
Engines
Project
Mgt
Asset
Mgt
Domestic
International
Warehousing &
Distribution
Trade Services
Goods
Mgt
Carrier
Optimization
Collections
Billing
Routing
Sales &
Outbound
Processing
33
Intermodal
Services
Planning &
Dispatching
© 2011 Progress Software Corporation. All rights reserved.
Real Time
Business
Visibility
Solution Stacks to be tested
 Solutions often present as a stack or suite in a
customer environments.
 The possible number and complexity of usecases in
these combined environments are much higher
 The testing complexity thus significantly amplified.
34
© 2011 Progress Software Corporation. All rights reserved.