Features

Browser Matrix

With our Browser Matrix image you can quickly see the status for your latest test build for the various browsers/platforms.

You can simply add markdown code or HTML code to your project website to show the status of your most recent test build.

Builds

In order to show a browser matrix image, you need to make sure that you're running your tests in a group, called a build.

For example: you have a project that has a bunch of tests. After every commit you want to make sure the tests still pass.

The tests you want to run are groupped in a build.

To make sure your tests are grouped in the same build, use Selenium's Desired Capabilities.
Simple pass "build" : "build-1XXX" in your Desired Capabilities:

DesiredCapabilities caps = new DesiredCapabilities();
caps.setCapability("platform", "WIN7");
caps.setCapability("browserName", "Chrome");
caps.setCapability("build", "build-1XXX"); // for example

In our member area you will then see a new build, build-1XXX, which will contain all the tests that ran with the same build identifier.

Marking tests passed/failed

To mark tests as passed or failed, your test runner should be configured to send the success state of each test to TestingBot via the TestingBot API.

The browser matrix image will then show the success state for every browser/platform in your build.

Browser Matrix

Below is an example of how the browser matrix image looks like, and information on how to embed this image on your website.

TestingBot Build Matrix
Markdown:
[![TestingBot Test Status](https://testingbot.com/buildmatrix/YOUR_TESTINGBOT_KEY?auth={authentication})](https://testingbot.com/builds/YOUR_TESTINGBOT_KEY?auth={authentication})
HTML:
<a href="https://testingbot.com/builds/YOUR_TESTINGBOT_KEY?auth={authentication}">
  <img src="https://testingbot.com/buildmatrix/YOUR_TESTINGBOT_KEY?auth={authentication}" alt="TestingBot Build Matrix"/>
</a>

Private Accounts

To display the matrix image, or link to builds, you need to generate an authentication token.
To generate the authentication token, you must concatenate your TestingBot key, TestingBot secret
and optionally an identifier. Finally, take the MD5 hash of the concatenated string:

Digest::MD5.hexdigest("#{client_key}:#{client_secret}")
MessageDigest m=MessageDigest.getInstance("MD5");
String s = "TESTINGBOT_KEY:TESTINGBOT_SECRET";
m.update(s.getBytes(),0,s.length());
System.out.println("MD5: "+new BigInteger(1,m.digest()).toString(16));
echo md5("TESTINGBOT_KEY:TESTINGBOT_SECRET");
import hashlib
print(hashlib.md5("TESTINGBOT_KEY:TESTINGBOT_SECRET".encode('utf-8')).hexdigest())
var crypto = require('crypto');
crypto.createHash('md5').update("TESTINGBOT_KEY:TESTINGBOT_SECRET").digest("hex");

Open Source Accounts

Open Source accounts automatically have their tests and builds set to public. This means no authentication (auth parameter) is required to display matrix images or link to tests/builds.

More

  • If you like to show browser matrix images of multiple projects, please consider creating a new user account per project.
  • We're also providing status badges, displaying if your build passed/failed.