December 8, 2015 Experitest

5 Mobile Testing Takeaways from the World Quality (QA) Report

mobile enterprise apps one size fits all


Dana Natan


Head of Marketing


The World Quality Report for 2015-2016, presented by Capgemini, HP, and Sogeti chronicles the state of quality assurance for 1,560 executives across 32 countries, giving us a picture of the trends happening in QA, and for us, a glimpse of what we can expect in mobile testing.


Here are our five takeaways:


1. Customer Experience is Top Priority.


“Digital Transformation puts customer value and end-user experience at the heart of digital initiatives. Get it wrong and the company’s reputation will suffer. . . Thus, the ranking of protecting the corporate image as the top QA and Testing strategic priority is wholly understandable.”

mobile application qa best practices

More than ever the IT strategy of a company directly impacts the bottom line. For mobile, it is the bottom line. Your mobile application holds the fate of the reputation of your name. If it isn’t working, people will not only abandon your app, they will abandon your entire brand. Mobile application testing is as important to your marketing strategy as your ad buy. A defective mobile application can be as devastating to your products appeal as a defect in the product itself.


This thanksgiving holiday shopping season saw 26% of all online sales conducted on a mobile device. Where physical shops like Macy’s and Walmart saw a drop in Black Friday sales of over 30%, Amazon, the online retailer saw a rise of over 115%! People are interacting with a business over its mobile app more than any other channel. This makes your mobile application quality assurance strategy critically important.




Enjoy a FREE one month trial of SeeTest Automation along with a live demonstration on developing test automation scripts!
Check it out at Automation Made Simple!
QA Makes it Work!



2. Test Automation is Still a Fantastic Opportunity


45% of all test cases are automated. For the last year, there was an alarming 9% rise in mobile QA testing budgets. That means people are still performing manual testing for their apps. While a business can secure some cutting edge manual testing tools for free, like Experitest’s SeeTest Manual, mobile test automation tools are a must at a time when test coverage is expanding exponentially.


The average mobile application has to be tested on 4 different operating systems, and several versions of each. It also must work on 20,000 different types of mobile devices, and 400 local phone networks all with varied levels of latency and throughput. This implies a test coverage of over 50 million ways a user can use your mobile application.


The demand for best mobile test automation tools becomes greater once you realize that you have LESS time to cover this expanding test area. The right tools for mobile test automation become a matter of survival. Just see the article on Test Automation ROI.


mobile test automation solutions

Mobile test automation benefits you in the following ways:


    • You can test in parallel execution, or test on multiple devices at once.


    • Using a test recorder, you don’t have to code. The right test automation tools will allow you to call a reflection of the mobile screen to your desktop, and perform the set of actions you wish to test by using a keyboard and mouse. The recorder will document the actions and create the scripts itself.


    • The right mobile testing tool will also be able to convert those test scripts into any ALM environment you need. Experitest’s SeeTestAutomation can convert your mobile testing scripts into UFT/QTP, WebDriver (Selenium), Junit, Microsoft Visual Studio, Python, etc.


    • You have full integration with the cloud so you can run a test on massive amounts of devices in parallel execution, speeding up your mobile quality assurance testing significantly.


    • Full integration with Continuous Integration platforms like JIRA, Jenkins, and QC so you can expand to test automation for DevOps and automate most of the DevOps process. Almost a third of those interviewed in the World Quality Report complained about too much delay between development phases. Using test automation solutions that include DevOps is a priority.


SeeTestAutomation, and SeeTestCloud are test automation tools for mobile apps that meet all of these requirements, letting you migrate into automated testing with the greatest of ease.


mobile app test automation tools

3. Technology is Still Ahead of Business


Despite all of the talk about the DevOps revolution, it has still not become mainstream. The best companies are in the early stages of transforming their IT ops to a mobile first attitude. By and large, the bulk of the industry has not fully implemented DevOps, nor has it invested in the required resources to do so.


This presents great opportunities for most businesses. If we know that over a quarter of companies don’t test at all, and 39% of apps are tested manually, then by simply implementing test automation for your mobile applications, you will reach higher mobile quality than over 2/3rds of your competitors.


mobile QA testing tools

Until every company is internally structured for a mobile first, digital first strategy, those businesses that act now will enjoy a competitive advantage over those that don’t.


4. Agile and DevOps Adoption Raises the Need for Mobile Testing


While DevOps is still in its initial phases, businesses are waking up to the fact that the old model of releasing software at specific times is being replaced with continuously improving applications that constantly have to keep up with new innovations appearing on any of the platforms these applications run on (like mobile operating systems, mobile devices, network connection speeds, etc.).


According to the report, the top three challenges large enterprises face are:


    1. Identifying the right areas on which mobile testing should focus.


    1. Lack of appropriate test environment and data.


    1. Lack of professional test expertise in agile teams.


Mobility as a whole is still less than a decade old. Experience still has a low ceiling.


Still, there are tactics an emerging DevOps team can employ to move up the learning curve faster. It all boils down to one strategy:


Comprehensive Testing.


test automation devops

The first challenge, identifying the right areas on which mobile testing should focus, results in too narrow an approach to testing. A mobile testing team can successfully test every function of their mobile application to perfection, only to see it abandoned by the public due to problems it didn’t test for.


A common challenge is when your mobile testing lab uses state of the art technology to connect the mobile application to the application server, and every function is performed at a connection speed far greater than what 99% of your users will have access to. With the ideal environment simulated in the lab, the application is far more likely to pass all the tests. The mobile application is released, only to perform too slowly for the user’s standards. A page that functions perfectly may take 1 second to appear in the lab, but 10 seconds for a user on your app while riding an elevator. If the function performs too slowly, your user will think the app is broken and delete it.


Network Virtualization takes functional testing to the next level. It will simulate real world conditions for any network on earth so you can test the functions of your mobile application under the same set of real-world circumstances your users will face.


The best network virtualization tool, Experitest’s SeeTest Network Virtualization, takes it one step further. It will drill down to a user’s position to re-create a dynamic personal environment. You can test for the user changing positions as he rides through a tunnel, or enters and exits an elevator.


Even when a team performs adequate functional and performance mobile application testing, there is no guarantee that the same number of people will be using the application at all times. Concurrent usage is a big challenge for mobile testers as large masses of people can call the application server all at once. There are more smartphones in the world than desktops. Heck, there are more smartphones on earth than toothbrushes! Traffic is now an issue for the most ubiquitous communications device ever made. A normal traffic load can be using your app at any given moment, but for some reason, they all decide to use the same function at the same time. This creates load issues that both functional and performance testing don’t cover. A top of the line load testing tool, like SeeTest Load will re-create conditions for your mobile application to perform under the challenge of masses of concurrent users accessing your mobile application, or all of them accessing the same function at once.


From the report: The key challenges for QA and Testing in DevOps are: how to achieve meaningful testing in ever-shorter time frames; how to achieve maximum automation of testing; and how to transform from testing and validation before … to more predictive forms of testing and real-time quality monitoring.


mobile test automation benefits

The move to DevOps and Agile revolves around one primary objective: shorter time to market for your mobile application without sacrificing test coverage in the process.


This significantly reduces the role of manual testing. To accomplish this you must have mobile test automation tools. There is also another tool that will ramp up your DevOps strategy: The cloud.


Cloud testing is the final piece of the puzzle. It takes test automation and parallel execution to the next level. You can set up a mobile device lab in your company, and hook up 50, 100, 300 devices to test all at once. Each device can have a popular combination of mobile device type, operating system, version, and local network to enable you to cover a massive area of test coverage in just one test execution.


The solution is to set up one mobile device lab, and connect it to any mobile tester using SeeTestCloud. Now any mobile tester in any office can remotely “call” any device, or series of devices to test the mobile application on them all at once. The cloud technology connects the devices to any mobile tester in the company. Once their computer is connected to the device, a reflection of the device screen will appear on his computer. Using the keyboard and mouse, or a pre-recorded automated test script, the mobile tester can execute the tests from any place.


This is parallel execution and mobile test automation in its finest form. Testers from different offices can be assigned different devices at different hours. The QA manager can organize a 24 hour non-stop mobile testing process. At the other end of the mobile device lab, all testers can use both functional testing, Network Virtualization Testing, and Load Testing tools to conduct a comprehensive testing plan on a huge amount of devices.


Connecting all of this to a Continuous Integration (CI) Platform like Jenkins, JIRA, or QC optimizes the entire DevOps process: You can release new versions of your mobile application faster while maintaining a massive test coverage in both functional and performance mobile testing.


quality assurance for mobile applications

5. Flexibility is Constant


Mobile was adapted by the world faster than any technology ever developed. It was 30 years from the time electricity was publically available to the time 10% of the population was using it. It took 64 years before the telephone was used by 40% of the population. Smartphones accomplished this feat in less than a decade.


How fast will the internet of things penetrate the world? What about wearables? What about applications that track sensors and hardware implanted into your body, or the body of any living creature?


Smartphones, IoT, Big Data are all new technologies penetrating the world at a rate we have never seen before. Not only must mobile applications be released and re-released in a constant cycle of new versions, the organizations inside businesses themselves must be in a state of constant change to enable itself to keep up with everything.


This demands that mobile testing tools constantly reinvent themselves to keep up with new technologies, and new ways that companies will re-invent themselves to leverage those technologies to provide the very best experience to their users and customers.


A mobile testing tool must quickly adapt itself to test for applications running on smartwatches. It must move fast to test new features that the latest versions of Android and iOS come out with each year. It must enable apps reading data from a pacemaker inside someone’s heart with the greatest accuracy. It must be ready to expand its testing capabilities to include wearables, self-driving cars, and other new technologies we haven’t heard of that will become commonplace by the end of this decade.


SeeTestAutomation has rapidly enhanced its capabilities to test for wearables, fitness bands, new functionality on the latest devices, and mobile applications receiving and transmitting data from the array of sensors which make up the internet of things, enabling mobile testers to quickly test for any innovation they wish to incorporate into their mobile application.


Get Updates on Software Quality Assurance at
our Experitest  LinkedIn  Page

lang: en_US



, , , , , , , , , , , , ,