Transcript Visual Studio Testing Tools

Testing Tools using
Visual Studio
Randy Pagels
Sr. Developer Technology Specialist
Microsoft Corporation
Plan
REQUIREMENTS
Monitor + Learn
BACKLOG
Development
Collaboration
Develop + Test
Production
Release
Agenda
•
•
•
•
•
•
•
Web Performance Testing
Load Testing
Unit Testing
Manual Testing
Exploratory Testing
Coded UI Testing
Lab Management
Test Manager
Manual Testing Tools
•
•
•
•
•
•
•
•
Test Plan Management
Test Case Management
Shared Steps Management
Exploratory Testing
Test Configuration Management
Test Fast Forwarding
Test Data Collection
Test Lab Management
Visual Studio
Automated Testing Tools
•
•
•
•
•
•
•
Coded UI Tests
Web Performance Tests
Load Tests
Generic Tests
Ordered Tests
Developer Unit Tests
Database Unit Tests
New Test Runner
Unit Testing with Code Coverage
Exploratory Testing
• Exploratory testing is the
testing of an application
without a set of tests defined in
advance. During an exploratory
test session, you are not
restricted to a script or a set of
predetermined steps. Some
improvements have been made
to the exploratory testing in
Microsoft Test Manager.
Coded UI Testing
• Coded UI tests provide a way to
create fully automated tests to
validate the functionality and
behavior of your application’s user
interface. You can create coded UI
tests directly from existing action
recordings. Action recordings
contain the steps taken during
manual testing of an application.
Web Performance Testing
• Any new Web performance and
load testing efforts you create in
Visual Studio are now created in a
Web performance and load test
project type instead of a test
project. A Web performance test
consists of a series of HTTP
requests. Web performance tests
work at the protocol layer by issuing
HTTP requests.
Load Testing
• Load tests consist of a series of Web
performance tests or unit tests
which operate under multiple
simulated users over a period of
time. Load tests can also include
automated coded UI tests. Coded
UI tests should be included only
under specific circumstances. All the
scenarios that use coded UI tests in
load tests involve using the coded
UI tests as performance tests.
 View the performance
data from Application
Insights
 Application counters are
correlated with the user
load
 Understand what issues
may be causing any
performance problems
 Easily go to Application
Insights if you need to do
a more detailed analysis
Load Test Manager
Demo
Testing Tools using
Visual Studio







REST APIs for tags
Query on Tag
Tags in Visual Studio
Tag Permissions
Exclude non-working days
Cumulative Flow Start Dates
Pinning of Work Item Charts
 Export your test plan to HTML
 Choose the level of detail you want
 Create sets of test data
 Reference by various test cases
 Easily bind to automated tests
Permissions Reference
Set alerts, get
notified when
changes occur
Lab Management
• Testing a complex multi-tiered
application and creating different
configurations in a user-flow can
be challenging. Lab
Management provides teams a
powerful and flexible
development and test lab
environment to enable scalable
build-deploy-test workflow and
continuous integration through
environment templates.
Testing Architecture
Team Foundation Server
Test Controller
Team Build
System Center Virtual Machine
Manager (SCVMM)
VM Template Library
VM Template 1
Test Agent
VM Template 2
Test Agent
SCVMM Environment
VM Host
Web Server
VM
Database Server
VM
VMMAgent
Test Agent
Test Agent
Standard Environment
Web Server
Test Agent
Database Server
Test Agent
Build-Deploy-Test
(1) Get Source Code
(2) Compile projects
Team Build
Team Foundation Server
(8) Publish results to
Team Foundation Server
(3) Copy build to running
environment
SCVMM Environment
Test Controller
(7) Send test
results
(6) Execute
automated tests
VM Host
Web Server
VM
Database Server
VM
VMMAgent
Test Agent
Test Agent
(4) Run deployment scripts for
each machine
(5) Create environment snapshot
Related Content
http://msdn.microsoft.com/en-us/library/tfs/bb385901%28v=vs.110%29
http://msdn.microsoft.com/en-us/library/tfs/dd293547%28v=vs.110%29
http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/09/javascript-unit-tests-on-teamfoundation-service-with-chutzpah.aspx
http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/31/writing-a-visual-studio-2012-unittest-adapter.aspx
http://msdn.microsoft.com/en-us/library/tfs/ms182539%28v=vs.110%29.aspx
http://blogs.msdn.com/b/visualstudioalm/archive/2012/06/04/getting-started-with-loadtesting-in-visual-studio-2012.aspx
Visit Team System Café Today!
The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics!
http://www.teamsystemcafe.net
Resources
What's New for Application Lifecycle Management in Visual Studio 2012
http://bit.ly/baSMz5
What's new for Microsoft Test Manager 2012
http://bit.ly/wN2JrH
Quick Start Guide for Manual Testing using Microsoft Test Manager 2012
http://bit.ly/d4l9qN
Test Scribe for Visual Studio 2012
http://bit.ly/Nim0gH
What is new in Coded UI Tests 2012
http://bit.ly/zWIbVf
Platforms for Coded UI Tests and Action Recordings
http://bit.ly/b5m32u