Smart Cloud Bench

Smart CloudBench is a configurable, extensible and portable system for the automated performance benchmarking of cloud infrastructure that uses representative applications from a suite of benchmark applications. It also enables the comparison and ranking of different cloud service offerings based on user requirements in terms of infrastructure specifications, application performance, costs, security, geographic location, compliance, regulatory requirements and other requisite criteria. The key steps involved in running Smart CloudBench are:

Select Test Mode

Smart Cloud Bench currently supports three test modes. In this step select the test mode you want to run the tests in:

  • On-demand Mode
  • Reserved Mode
  • Mixed Mode

Configure System Under Test

System Under Test is the virtual cloud server that you want to benchmark. Depending upon the test mode, you can either select the cloud server from the Server Catalog or manually enter the server details.

Configure Test Agent

Test Agent refers to the server taht is used to carry out the benchmark tests against the System under test. Depending upon the test mode, you can either select the cloud server from the Server Catalog or manually enter the server details.

Configure Test Setup

Review the test results and rank them based on your preferences for the measured metric such as average response time, maximum response time, interaction success rate.

Review Test Plan and Launch

Define the different scenarios you want to test against the selected benchmark on the selected cloud servers. You can specify a number of different scenarios including:

  • A scenario where users of an online retail store randomly browse through pages on the target site
  • A scenario where users are adding products to the shopping carts
  • A scenario where users are simulated making a purchase

Visualize Test Results

Review the test results for tests executed on a single server or a group of servers and analyse the application performance and the corresponding resource consumption..

Compare Cloud Providers

Compare the performance test results for the different cloud instances and providers. The test results can be compared based on price, performance or both.