Performance & Stress Testing: For Delivering Responsive Future-Proof Systems

PerformanceTesting

At Oniyosys, we get involved in performance testing right from the pre-deployment stage itself. This helps in early resolution of issues. In the event that systems are already live.

What is Performance Testing?

Performance Testing is the general name for tests that check how the system behaves and performs. Performance testing examines responsiveness, stability, scalability, reliability, speed and resource usage of your software and infrastructure. Different types of performance tests provide you with different data, as we will further detail.

Before Performance Testing, it’s important to determine your system’s business goals so you can tell if your system behaves satisfactorily or not according to your customers’ needs.

After running performance tests, you can analyze different KPIs, such as the number of virtual users, hits per second, errors per second, response time, latency and bytes per second (throughput), as well as the correlations between them. Through the reports, you can identify bottlenecks, bugs and errors, and decide what needs to be done.

When should you use Performance Testing?

When you want to check your website performance and app performance, as well as servers, databases, networks, etc. If you work with the waterfall methodology, then at least each time you release a version. If you’re shifting left and going agile, you should test continuously.

What is Stress Testing?

Stress Testing is testing that checks the upper limits of your system by testing it under extreme loads. The testing examines how the system behaves under intense loads, and how it recovers when going back to normal usage, i.e are the KPIs like throughput and response time the same as before? In addition to load testing KPIs, stress testing also examines memory leaks, slowness, security issues and data corruption.

Stress Testing can be conducted through load testing tools, by defining a test case with a very high number of concurrent virtual users. If your stress test includes a sudden ramp-up in the number of virtual users, it is called a Spike Test. If you stress test for a long period of time to check the system’s sustainability over time with a slow ramp-up, it’s called a Soak Test.

When Should You Use Stress Testing?

Website stress tests and app stress tests are important before major events, like Black Friday, ticket selling for a popular concert with high demand or the elections. But we recommend you stress test every once in a while so you know your system’s endurance capabilities. This ensures you’re always prepared for unexpected traffic spikes, and gives you more time and resources to fix your bottlenecks.

This is an example of what a Spike Test would look like on JMeter. This test analyzes adding 7,000 users at once and then adding 500 users every 30 seconds until reaching 10,000 users. After reaching 10,000 threads all of them will continue running and hitting the server together for 5 minutes.

We offer the following performance tests:

Load Test – where we test applications at the optimal level of its specifications.

Stress Test – here we test the system or application at extreme operating conditions by stressing it out by removing the resources that support it & see how it works.

Ageing Test – this test gauges how an application performs after extended usage over a long period of time.

Throttle Test – here the application is testing across different bandwidths and within specifications like CPU usage, memory, web traffic, web processes etc.

At Oniyosys, our performance testing team will help with suggestions on how to improve the existing applications and help in identifying the segments of software that need fine-tuning and fixing under both normal and extraordinary conditions.

Automation Testing : The Best Alternative Of Manual Testing

03

Website test automation requires you to use software and tools, which is an ideal alternative to time consuming manual testing. In order to successfully plan and execute test automation, you need to have an effective framework, tested methodology, and suitable tools to reduce time and boost the quality of testing. Oniyosys has the expertise to create software test automation process for applications across a number of domains. Our proficiency in developing test automation scripts for customized website allows us to manage product complexities.

The automation software can also enter test data into the System Under Test ,  compare  expected and actual  results and generate detailed test reports. Successive development cycles will require execution of same test suite repeatedly. Using a test automation tool it’s possible to record this test suite  and re-play it  as required.Once the  test suite is automated,  no human intervention is required .This improved ROI of Test Automation. Goal of Automation is to reduce number of test cases to be run manually and not eliminate manual testing all together.

Why Automation Testing?

Manual Testing of all work flows, all fields , all negative scenarios is time and cost consuming

  • It is difficult to test for multi lingual sites manually
  • Automation does not require Human intervention. You can run automated test unattended (overnight)
  • Automation increases  speed of test execution
  • Automation helps increase  Test Coverage
  • Manual Testing can become boring and hence error prone.

Which Test Cases to Automate?

Test cases to be automated can be selected using the following criterion to increase the automation ROI

  • High Risk – Business Critical test cases
  • Test cases that are executed repeatedly
  • Test Cases that are very tedious or difficult to perform manually
  • Test Cases which are time consuming

The following category of test cases are not suitable for automation:

  • Test Cases that are newly designed and not executed manually  atleast once
  • Test Cases for which the requirements are changing frequently
  • Test cases which are executed on ad-hoc basis.

Simple Steps to follow in Automation Testing:

There are lots of helpful tools to write automation scripts, before using those tools it’s better to identify the process which can be used to automate the testing.

  • Identify areas within software to automate
  • Choose the appropriate tool for test automation
  • Write test scripts
  • Develop test suits
  • Execute test scripts
  • Build result reports
  • Find possible bugs or performance issue

For the products that are change-resistant and economical, Oniyosys is adept in building functional test automation cycle and effective regression testing capabilities pre- and post-deployment and it suits all budgets and technical needs. Explore our Lucrative Test Automation Benefits for Maximum Level of Accuracy, Fast Turn Around Period & Money Saving, Team Skill Improvement, Interactive Approach and Advanced Test Automation Tools Usage.

Regression Testing – A crucial step for the success of application development and upgrades

2
Oniyosys

Oniyosys conducts regression testing, where previously run tests are re-conducted to avoid the emergence of old/new software bugs or regressions that typically come back when major code or program modifications/maintenance are done.

Let’s talk about our Regression Testing for better understanding :

When any modification or changes are done to the application or even when any small change is done to the code then it can bring unexpected issues. Along with the new changes, it becomes very important to test whether the existing functionality is intact or not. This can be achieved by doing the regression testing.

Types of Regression testing techniques:

We have four types of regression testing techniques. They are as follows:

1) Corrective Regression Testing: Corrective regression testing can be used when there is no change in the specifications and test cases can be reused.

2) Progressive Regression Testing: Progressive regression testing is used when the modifications are done in the specifications and new test cases are designed.

3) Retest-All Strategy: The retest-all strategy is very tedious and time-consuming because here we reuse all test which results in the execution of unnecessary test cases. When any small modification or change is done to the application then this strategy is not useful.

4) Selective Strategy: In selective strategy, we use a subset of the existing test cases to cut down the retesting effort and cost. If any changes are done to the program entities, e.g. functions, variables etc., then a test unit must be rerun. Here the difficult part is to find out the dependencies between a test case and the program entities it covers.

When to use it:

Regression testing is used when:

  • Any new feature is added
  • Any enhancement is done
  • Any bug is fixed
  • Any performance related issue is fixed

Advantages of Regression testing:

  • It helps us to make sure that any changes like bug fixes or any enhancements to the module or application have not impacted the existing tested code.
  • It ensures that the bugs found earlier are NOT repeatable.
  • Regression testing can be done by using the automation tools
  • It helps in improving the quality of the product.

Regression Testing Techniques

Software maintenance is an activity which includes enhancements, error corrections, optimization and deletion of existing features. These modifications may cause the system to work incorrectly. Therefore, Regression Testing becomes necessary. Regression Testing can be carried out using following techniques:

Retest All

This is one of the methods for regression testing in which all the tests in the existing test bucket or suite should be re-executed. This is very expensive as it requires huge time and resources.

Regression Test Selection

Instead of re-executing the entire test suite, it is better to select part of test suite to be run.

Test cases selected can be categorized as 1) Reusable Test Cases 2) Obsolete Test Cases.

Reusable Test cases can be used in succeeding regression cycles.

Obsolete Test Cases can’t be used in succeeding cycles.

Prioritization of Test Cases

Prioritize the test cases depending on business impact, critical & frequently used functionalities. Selection of test cases based on priority will greatly reduce the regression test suite.

If your software undergoes frequent changes, regression testing costs will escalate. In such cases, Manual execution of test cases increases test execution time as well as costs. Automation of regression test cases is the smart choice in such cases.  The extent of automation depends on the number of test cases that remain re-usable for successive regression cycles.

Regression Testing Tools

Following are most important tools used for both functional and regression testing:

Selenium: This is an open source tool used for automating web applications. Selenium can be used for browser-based regression testing.

Quick Test Professional (QTP): HP Quick Test Professional is automated software designed to automate functional and regression test cases. It uses VBScript language for automation. It is a Data-driven, Keyword based tool.

Rational Functional Tester (RFT): IBM’s rational functional tester is a java tool used to automate the test cases of software applications. This is primarily used for automating regression test cases and it also integrates with Rational Test Manager.

Oniyosys run regression tests using a suitable combination of automated and manual testing. They are conducted not only during the operational software development stage but also before the release stage into a live environment. Regression testing helps detect major variances that could have serious implications on the revenue, schedule, and company reputation. This type of testing is crucial to the success of application development and upgrades.