Exporting Fiddler2 sessions to Visual Studio Web Tests

While finishing the revisited and new “Web Performance Testing with Microsoft Visual Studio 2013” training, I found a very interesting topic to cover, idea of my colleague Carl Bricknell, that is to migrate Fiddler2 sessions to Visual Studio generating new Web Tests.

As you know Visual Studio 2013 Ultimate and Visual Studio 2015 Enterprise have included the templates for Load and Performance Tests.
It’s as easy as go into VS and create a new “Web Performance and Load Test project”.

Usually, once the project is done, we have to record our session with the Web Test Recorder as follows:

And right after our session, we will be able to edit the recorded test steps on the WebTest view. This will allow us to create our validation rules that would be used to let the test pass or fail; also create, modify and delete web requests, their headers, parameters (dynamic and statics) and, the most fancy feature, to add data parameters in order to replay the tests several times with different data straight from an Excel Sheet, CSV file or SQL Database.

Many testers and developers use Fiddler2 in a daily basis, and this is because is one of the most powerful web traffic capture tools.

Fiddler2 includes the ability to capture web traffic (including AJAX requests) for later playback with the Visual Studio Web Performance Test feature. It can also be used to help debug your Web performance tests. Comparing your Fiddler2 recording and your Web performance test recording can help identify key missing headers that your Web performance test may not record, amongst other things.

We can summarize as:

Fiddler is at HTTP debugging proxy server application that captures HTTP and HTTPS traffic and logs it for the user to review.

Fiddler can also be used to modify HTTP traffic for troubleshooting purposes.

In order to export Fiddler2 recording sessions to Visual Studio Web Test Project we need to follow the next steps:

  1. Create a Visual Studio empty Web Test Project
  2. Record your session using Fiddler2
  3. Export the Fiddler 2 session to the Visual Studio Web Test Project

The exporting is very straight forward:

  1. Go to File à Export Sessions à All sessions

  1. Select Visual Studio Web Test as Export Format

  1. Select all the plugins installed by default:

  1. Find the generated web test in your hard drive and attach it to your Visual Studio Web Test Project:

Done!

From here, everything that happens is result of your creativity, it’s ready for testing!

  • Happy testing! –

Eduardo Ortega Bermejo

Advertisements
Posted in P&L Tests, Testing, Visual Studio | 1 Comment

FREE Upgrade to Visual Studio Enterprise with MSDN!

There is no better time to get ready for the release of Visual Studio 2015. The new Visual Studio is coming in May 2015 and the prices have been reduced dramatically!
When you upgrade from Visual Studio Professional or Visual Studio Test Professional to Visual Studio Premium, the price is cut to 50%! And also get a free upgrade to Visual Studio Enterprise with MSDN automatically when Visual Studio 2015 gets released.

The offer is only valid for 2 months, expiring on June 30th so hurry up.
But there is much more. Visual Studio 2015 license system has changed. These are the versions that we will have now:

  • Visual Studio Community

    • Integrated Development Environment for building Web, Windows Desktop and cross-platform iOS, Android, and Windows apps
    • Ecosystem with thousands of extensions to choose form the Visual Studio
    • Free for open source projects, academic research, training, education and small professional teams
  • Visual Studio Professional with MSDN

    • Professional developer tool for building any application type
    • Powerful features to improve your team’s productivity such as CodeLens
    • Improve team collaboration with Agile project planning tools, Team Rooms, charts and more
    • MSDN subscription benefits including access to core software for dev/test, Team Foundation Server, Visual Studio Online Basic, $50/month in Azure credits, training and support.
  • Visual Studio Test Professional with MSDN
  • Visual Studio Enterprise with MSDN

    • End-to-end solution for your development teams, including the most feature-rich Visual Studio IDE for working on any type of project
    • Build quality applications at scale with advanced features such as Load Testing, automated and manual testing and new IntelliTest capabilities
    • Manage complexity and resolve issues quickly with features such as Code Map and IntelliTrace
    • Enhanced MSDN subscription benefits including comprehensive access to software for dev/test, Team Foundation Server, Visual Studio Online Advanced, $150/month in Azure credits, training and support

Customer price has changed as well:

If you have You will get New customer price
Visual Studio Community Visual Studio Community 2015 Free
Visual Studio Professional with MSDN Visual Studio Professional 2015
Your Visual Studio Professional with MSDN
subscription will continue without change
$1,199
Visual Studio Premium with MSDN Visual Studio Enterprise 2015
Your subscription will be upgraded to
Visual Studio Enterprise with MSDN
$5,999

 

Here you can find a comparison between the different versions of Visual Studio, including the Visual Studio Test Professional (that is the most relevant product for many of us).]

References:

Posted in ALM, Visual Studio | Leave a comment

Supported configurations and platforms for VS Coded UI Tests

Coded UI automated tests! Sounds good, uh? Well, yes, it’s very exciting to see how a machine is simulating that is playing with your app while input some predefine values in your textboxes and performing some actions. Said that, it’s good to know where you can create and apply these Coded UI Tests.

First, supported Operating Systems:

  • Windows 7
  • Windows Server 2008 RD
  • Windows 8

Supported Architectures:

  • .NET 2.0, 3.0, 3.5, 4 and 4.5

Second, Platform Support:

  • Windows Phone Apps: Supported
  • Windows Store Apps: Fully supported including HTML5 in IE9 and IE10
  • Internet Explorer 8 and 9.
  • Internet Explorer 10 and 11: is only supported on the desktop, not Modern UI
  • Windows Forms and WPF: Fully supported
  • Internet Explorer 6 and 7: Not supported
  • Chrome: Recording of action steps is not supported. Coded UI Test can be played back on Chrome and Firefox.
  • Opera: Not supported.
  • Safari: Not supported
  • Silverlight Not supported
  • Flash/Java: Not supported
  • Windows Win32 and MFC: Partially supported
  • SharePoint: Fully supported
  • Office Client Applications: Not supported
  • Dynamics CRM web client: Fully supported
  • Dynamics AX 2012: Action recording and playback are partially supported
  • SAP: Not supported
  • Citrix/Terminal Services: Partially supported
  • PowerBuilder: Partially supported

Of course, when the talk about ASP.NET, HTML5 pages, these are included in the fully supported list of apps.

If you want to know how to Create, Edit and Maintain a Coded UI Test, check this out: https://msdn.microsoft.com/en-us/vstudio/ff977233

Happy support!

Eduardo Ortega​

Posted in Coded UI, Testing, Visual Studio | Leave a comment

How to update to TFS 2013.4

​Step 1: Download the Visual Studio Team Foundation Server 2013 Update 4 from your MSDN subscription or Microsoft downloads

Step 2: Start the installer:

<Image not available>

Step 3: Let the installation be. It will copy the needed components for the update

<Image not available>

Step 4: Follow the Team Foundation Server Upgrade starting with clicking “Next”
<Image not available>

Step 5: Before doing any upgrade (as happens for example in the TFS2010 to TFS2013 migration), you should do a DataBase backup of the main databases. So click where you read “Click here to launch the Database Backup Tool”.
<Image not available>

Step 6: Once finished. Go back to the previous screen and check “By checking this box, I confirm that I have a current backup”.

Step 7: Provide the settings for the application Tier. This means, which system account you want to use for the Application Tier services. By default it will use the Network Service and NTLM authentication.

<Image not available>

Step 8: Here is your moment to set up the Reporting Services. Even if you don’t have reporting services set up previously, you can do it now. If they are already in place just populate properly the fields. Example below:
<Image not available>

In the next step, the database will show up automatically in the databases list. Just make sure you Test the connection to it.

Step 9: Proceed on the same way with the Analysis Services. In case the Analysis Services is stopped, make sure it’s running.

Step 10: Report Reader Account. In this step we should provide a user account as System or Network Services accounts cannot be used here.
<Image not available>

So that’s it! We have skipped the SharePoint configuration as for this instance we don’t have such services set up. Just go to review and click on Configure.

<Image not available>

<Image not available>

Now you are ready to enjoy the new features on TFS 2013 Update 4. I recommend you to see what’s new on TFS2013.4.

But just a sneak peak, check the new access levels from the configuration console in the Team Web Access:

<Image not available>

Happy upgrade!

Eduardo Ortega

Posted in TFS | Leave a comment

Team Foundation Server 2013 Access Levels

*Info updated here: https://www.visualstudio.com/en-us/products/visual-studio-online-pricing-vs.aspx

The amazing world of licenses…when to use them, how to use them, how many computers, how many users, how many services available, on premises or online… These are few of the many questions that I receive every time a Dev or Test teams need to increase its number or its disciplines.

Let’s explain first how it works for those users that work with Team Foundation Server 2013 (the On-Premises server).

TFS 2013.3 Access Levels

First, a user, whatever kind of user is, needs to access to TFS2013 Update 3, so we need to specify which features need to get accessible. For that we have 3 levels (more info here):

  • Limited (Stakeholder access level)

    • View My Work Items
  • Standard (Basic access level)

    • View My Work Items
    • Standard Features
    • Agile Boards
    • Backlog and sprint planning tools
    • Chart Viewing
  • Full (Advance access level)

    • View My Work Items
    • Standard Features
    • Agile boards
    • Backlog and sprint planning tools
    • Request and Manage Feedback
    • Test case management (including running tests)
    • Team rooms
    • Agile Portfolio Management
    • Chart Viewing
    • Chart Authoring

Now that you know more about the licensing, let’s differentiate the licensing on TFS2013.3 from TFS2013.4 and Visual Studio Online.

In TFS2013.3 the access levels were Limited, Standard and Full.

In TFS2013.4 the access levels are Stakeholder, Basic and Advance.

In Visual Studio Online the levels are Stakeholder, Basic, Professional, Advance and MSDN Subscribers.

TFS2013.4 Access Levels

Let’s see now how the licensing changed from TFS2013.3 to TFS2013.4:

Access level

License required

Basic

TFS client-access license (CAL) or Visual Studio Professional with MSDN subscription

Advanced

One of these MSDN subscriptions: Visual Studio Ultimate with MSDN, Visual Studio Premium with MSDN, MSDN Platforms, or Visual Studio Test Professional with MSDN.

Stakeholder

No license required. Assign Stakeholder access to customers or stakeholders that you want to collaborate with but who aren’t on your team.

It means that the Stakeholder level (previously called Limited), will allow you to create Workitems (such as Bugs, Test Cases, Requirements, etc) but now, on the Update 4 for TFS2013, we have some extra features:

Stakeholder access level:

  • View and edit all work items (not only yours)
  • Standard features
  • Agile boards
  • Basic backlog and sprint planning tools
  • Agile Portfolio Management

If you go for the Basic access level (you would require a CAL or a license of VS Professional), you will get the next features access:

Basic access level (all stakeholder’s plus…):

  • Chart viewing
  • Build
  • Code
  • Administer account
  • Advanced home page
  • Advance backlog and sprint planning tools

Advanced access level (all basic’s plus…)

  • Chart Authoring
  • Request and manage feedback
  • Test case management
  • Team rooms
  • Advanced portfolio management

Visual Studio Online Access Levels

And last but not least VSO. If you don’t want to host the TFS server on your premises or just you want to avoid all the set-up of servers, SQL Server Databases, etc. Maybe the best option is to subscribe to an on demand service called Visual Studio Online (previously called Team Foundation Service). This service allows you to get licenses on demand and monthly, so you will save a considerable amount of money. Right now you can’t have divided your infrastructure half on premises, half on the cloud, so that means that your online users will work on team projects hosted on the cloud.

VSO features are slightly reduced in comparison to TFS (like reporting or SharePoint integration) but most of the features are available!

Let’s go through the features accessible through the different access levels

Stakeholder access level (free):

  • Work item tracking, queries, tagging
  • Alerts
  • Agile planning boards and backlogs
  • View Iteration and capacity planning
  • Portfolio management boards and backlogs
  • View query based charts 
  • Provide feedback
  • Track test progress and charts

Basic access level (5 free and $20/month new ones). All stakeholder access plus:

  • Team chat
  • Git repositories and TFVC
  • Work with Xcode, Eclipse, IntelliJ and others
  • Code Reviews
  • Enterprise Scale
  • Full Build and Deployment features
  • Web-based test execution. Test runner
  • Administer accounts, users, teams and projects structure

Professional access level (includes stakeholder and basic access levels). $45 per user per month.

  • Includes Visual Studio Professional

Advanced access level (includes stakeholder and basic access levels). $60 per user per month.

  • Request and manage feedback
  • Test planning: create test plans
  • Test authoring
  • Test suite management
  • Test tracking

As you can see it’s slightly different the On-Premise Server than the On-Line Services but in practice, this would be transparent for your developers, testers or team leads.

For more information follow the links below.

Happy licensing!

Eduardo Ortega

Resources:

VSO Matrix: http://www.visualstudio.com/pricing/visual-studio-online-feature-matrix-vs

Visual Studio Versions: http://www.visualstudio.com/products/visual-studio-with-msdn-overview-vs

Work as a stakeholder: http://www.visualstudio.com/get-started/work-as-a-stakeholder-vs

Visual Studio Online Pricing: http://www.visualstudio.com/pricing/visual-studio-online-pricing-vs

Pay for users accessing your account: http://www.visualstudio.com/get-started/get-more-user-licenses-vs

Visual Studio Online Basic: http://www.visualstudio.com/products/visual-studio-online-Basic-vs

Posted in ALM, TFS, Visual Studio, VSO | Leave a comment

Mobile testing with Xamarin Test Cloud

One of every two companies nowadays ask for a mobile application to integrate in their ecosystem of services and products. Most of the times is just for increasing the marketing or presence on the media, or to offer a better customer experience, or just to help their own employees to be more mobile. Whatever it is, one thing is clear, Mobile Apps are here to stay.

Microsoft Visual Studio offers its own Mobile Testing Platform, using frameworks such as Coded UI, MS Unit Test and few more included with the Visual Studio Suite. But most of the mobile test targets are Windows Phone apps. What about Android and iOS?

Xamarin is a multiplatform framework that allows you to write Mobile Apps for iOS, Android and Windows Phone using C# and Visual Studio or Xamarin Studio.

Recently they started offering a testing service called Xamarin Test Cloud. I’m not going to enter on licensing matters but in what you can do with it.

Xamarin Test Cloud automatically test your app on 1,000 devices in the cloud. Write your own tests, or have our engineers create and maintain a test suite for you.

Automated UI tests can be written using one of two frameworks:

  • Xamarin.UITest – This is a framework that allows test to be written in C# using NUnit testing library. This is mainly for developers that write their own automated tests. Xamarin.UITest is available as a NuGet package and relies on NUnit.
  • Calabash: This is a framework that allows you to write test in Ruby using Cucumber. This gives you an indication that this will be driven by Behaviour Driven Development.

With Xamarin.UITest, an interface shell called REPL is exposed to explore the views on a screen and automate interactions with the application. The best thing of this framework is it worksin any mobile app regardless of the platform it’s written in.

Each test is a method that follows the Arrange-Act-Assert pattern, as the one used in CodedUI with Visual Studio.

 

The process will follow the next steps:

  1. Automate your app using one of the testing frameworks
  2. Upload the test suite and run it on hundreds of real devices in the cloud
  3. Receive a detailed report with the results, screenshots and performance metrics.

In terms of the capabilities of the Frameworks, here some details:

  • Interaction:

    • Most of the gestures are allowed on the testing: tap, double-tap.
    • Build your own gestures.
    • Query UI elements and use CSS selectors to query these elements in hybrid apps.
  • Device features:

    • Change GPS location, press physical buttons, activate camera and rotate the device.
    • Simulate 2G, 3G, 4G networks.
  • Tools:

    • Write test in C# or Ruby with Cucumber.
    • Use Xamarin Studio and Visual Studio for C# tests.
    • Integrate with standard NUnit test runners
  • Analyse app performance

    • Screenshots and video playback for every step of every test.
    • Receive p.erformance data and compare reports against previous runs to find regressions.
  • Test continuously:

    • Collect test results in your CI system to include UI failures in your nightly reports
    • Integrates with TFS, Jenkins, TeamCity and post-build commands CI systems.

I didn’t have the luck to start playing around with it yet as it requires a license that I’m trying to get, so once is with me I will give you more details about how to perform and will do a comparison between Xamarin Test Cloud, SeeTest and Perfecto Mobile.

If you want to know more about how to write test with C# and Xamarin or Ruby, follow the links on the resources, there is a whole page plenty of guides, samples and API references here.

Happy testing!

Eduardo Ortega

Resources:

Xamarin Test Cloud: http://xamarin.com/test-cloud

Introduction to Xamarin Test Cloud: http://developer.xamarin.com/guides/testcloud/introduction-to-test-cloud/

Submitting Test to Xamarin Test Cloud: http://developer.xamarin.com/guides/testcloud/submitting/

Automate Xamarin.Forms testing with Xamarin.UITest and Test Cloud: http://developer.xamarin.com/guides/cross-platform/xamarin-forms/uitest-and-test-cloud/

[Video]Using C# and UITest to Create your first mobile test: http://blog.xamarin.com/test-cloud-video-series-using-c-and-uitest-to-create-your-first-mobile-test/

[Video]Uploading Test Scripts and View Mobile Test Results: http://blog.xamarin.com/xamarin-test-cloud-video-series-uploading-test-scripts-and-viewing-mobile-test-results/

[Video]A Quick Overview of Xamarin Test Cloud: http://blog.xamarin.com/video-a-quick-overview-of-xamarin-test-cloud/

Posted in Xamarin | Leave a comment

How to uninstall IE11 form your computer

Looks funny but people can think that having IE11 will be fully backwards compatible and even have tons of new features. Well, the thing is that for some specific scenarios IE11 is not supporting some plugins, activeX or old scripts and we have to revert it back to IE10 in order to do our work properly.

One example was explain to me from my colleague Abid; he told me in some scenarios the Microsoft CodeUI Testing tools​ don’t work properly with IE11, and this is an impediment for our teams.

Here is the solution to fix the problem:

1. On your Windows 7 computer, go to Control Panel –> Uninstall a program

2. On the top-left corner of your screen you will see View installed updates

3. On the list of installed updates you will be able to find Internet Explorer 11.

4. Right click on Internet Explorer 11 and uninstall it.

5. Restart your computer and voila!

If you want to make sure IE11 is not installed further with your Windows Updates, open the Windows Updates tool and on the optional updates you will find IE11, just hide it from there.

Cheers!

Ed/​

Posted in Internet Explorer | Leave a comment