Tag: app testing

Mobile App Testing: The Basics Part 3 (Mobile App Testing Tools)

Younes

Mobile App Testing Tools

We previously discussed the nature of mobile app testing, common problems in the testing process, and testing strategies. Now, we’ll take a look at mobile app testing tools that can streamline the testing process. And since one of the best strategies you can use over time is to “automate whenever it is possible”, it is important that you don’t miss in automation tool selection.

 

Here we list five mobile app testing tools you can consider before you dive into testing your apps. Note that the basis for the inclusion of a tool in the list is the recommendations from other sources and that we don’t favor one over the other. And though not extensive, we hope that this list will be helpful for you.

 

Appium (Open Source, Cross-Platform)

Appium is a test automation framework that works for native, web-based, and hybrid apps. It also drives cross-platform apps through the WebDriver protocol. This means that you can create test cases with the use any WebDriver-compatible development languages and tools. Appium’s philosophy centers on the idea that app testing automation frameworks should let app testers use their preferred tools, test frameworks, and test practices.

 

BitBar Testdroid (Cloud-based)

This testing tool is available in either public or private cloud. It is a “mobile device farm” with an inventory of thousands of real mobile devices (Android and iOS) for manual and automated mobile app testing. These devices are accessible round the clock through the monitoring of distributed teams. That, and other services like quick delivery of test data, logs, screenshots, and videos are some of the reasons why this is the testing tool of choice of many payment providers.

 

TestFairy (Beta Testing Platform)

Testfairy removes one major problem with crowd testing – the guessing on what really went wrong. Testfairy’s solution is to provide a video of the exact test aside from the logs and crash reports. It also works on any development platform, whether native, web-based or hybrid. Another selling point is its compatibility with bug trackers like Bugzilla and Jira.

 

SIGOS (Cloud-based)

This is Keynote’s mobile testing solution. SIGOS boasts of the combination of powerful mobile app test automation features and total control on manual device tests. Testers can run exploratory tests from anywhere through the DeviceAnywhere cloud service. You can even test on newly-released devices using real mobile carrier and Wi-Fi networks.

 

Ranorex

Finally, Ranorex Studio offers to test for desktop, web, and mobile apps. It is a service marketed to both beginners and experts alike. At the forefront are easy to use automation tools that support many third party tools and frameworks. Features that stand out are the GUI object recognition, easy step by step setup and recording of daily tests, reusable code modules, and early bug detection.

Mobile App Testing Basics

Mobile App Testing: The Basics Part 1

Younes

What is mobile app testing and why is it necessary?

Mobile app testing is a process that involves the evaluation of a mobile app’s usability, functionality, and consistency. There are different types of these tests that work for different mobile platforms, operating systems (and their different versions), devices (types and sizes), and networks (types and operators).

The results of these tests help mobile app developers quantify the app’s performance level. It also ensures that the app’s quality. A simple, overlooked mistake can cause not only monetary loss but also damage to a brand’s image.

 

Types of Mobile App Testing

 

Functional Testing

This is the test for the app’s functionality. The test mainly centers on the app’s UI and screen flow.

 

Usability Testing

This test aims to assess the user-friendliness and UI effectiveness. Usability Testing ensures the uniformity of user experience in all devices

 

Laboratory Testing

Usually, only network carriers perform this type of mobile app testing. The test’s main goal is to evaluate the app’s online functionality.

 

Performance Testing

This tests the situational performance of an app from both the side of the app’s server and the side of the client. The possible scenarios for testing include heavy server traffic, low device battery, low device memory, etc. The app’s behavior during these scenarios determines its performance level.

 

Load Testing

This test is related to performance but focusses on one issue: the app’s load time. If an app server can’t handle heavy traffic, the load time may slow down or the app can crash.

 

Memory Leakage Testing

Memory leakage happens when an app fails to “return” the memory it temporarily obtained from the mobile device. This can cause the slowdown of not only of the app but also of the system. If the app opens constantly or runs continuously, even the smallest memory leak can cause the app to crash.

A bug is more often than not the cause of memory leaks. That’s why it is important to test for these leaks while still in the development phase of the app.

 

Interrupt Testing

This is a test to determine if an app can handle common interruptions while it is running. These interruptions may include common device functions like voice calls, messaging, notifications, etc. There are also interruptions that can cause the app or even the device to terminate like battery removal, data transfer interruptions, system warnings, etc. Upon reopening, the app should be able to resume to the last state it was in before the interruption occurred.

 

Installation Testing

The app is installed and then uninstalled on different devices in order to ensure that the installation process goes without a hitch. This test also includes the process of updating the app.

 

Security Testing

Any data and network security vulnerabilities surface during this test. The app needs to pass the industry set security and user privacy standards.

 

Outdated Software Testing

This test aims to check if an app works on previous versions of the mobile operating system it is developed for.

 

How are these tests conducted?

You can conduct a mobile app test manually or with the use of automation tools. With manual testing, the tester acts as an end-user. The app is installed on different devices and the tester will conduct any desired tests in real time. But soon enough, device fragmentation becomes a problem. It’s impossible and impractical to test on all myriad of devices carrying different versions of different mobile operating systems. To make things easier, you can use emulators or simulators (we’ll discuss in the next posts).

But there are times where automated testing is more practical. Scenarios where automation is advisable includes:

  • Routine test cases. These are cases you often perform and has predictable results.
  • Test cases that are too tedious for manual testing.
  • The app is consistently growing
  • Outdated Software tests and other OS compatibility test cases

On the next post, we’ll be discussing common problems in mobile app testing and mobile app testing strategies.