#monkop

The alpha version will run your test on one real iOS device, capture test video, CPU, vMem and threads. You can now try this version for free on www.monkop.com or using your own account at console.monkop.com

Monkop iOS Beta release will include multi-device test runs, more performance metrics and a larger device farm.

Setting up Monkop for Jenkins

1.- Create a new freestyle job: 

2.- Create a command line build step.

Linux: “Execute shell” 

Windows: “Execute Windows batch command” 

setting the following commands inside:  

Windows: curl -sL monkop.com/cli | python - -k %monkopapikey% -a “path_to_build.apk” Linux/Mac OS X: curl -sL monkop.com/cli | python - -k $monkopapikey -a “path_to_build.apk”

3.-  Consider setting monkopapikey as an environment variable using EnvInject Plugin and injecting the variable as a password in your job:

Note: Environment variables can be accessed using the syntax $monkopapikey (Linux/Mac OS X) or %monkopapikey%  (Windows).

Prerequisites

Monkop CLI uses Python + CURL to use Monkop’s API in order to run tests, show results and also update build status (if needed). So the prerequisites are:

CURL: If you don’t have it, please install curl where Jenkins will run your build process.

Enable the use of the API getting your APIKey on your Monkop account under the ‘Add-ons’ option https://console.monkop.com/addOns.xhtml

Python 2.7 installed (installed by default on Mac OS X and most Linux distros) https://www.python.org/download/releases/2.7/

Adding Monkop tests to your Jenkins pipeline will let your team automatically get key information on each build regarding how your app behaves on real devices while evaluating mobile-side performance. Check out Monkop CLI for help with creating different tests or running automation scripts.

Overview

This document explains how to understand Monkop report after each execution (test-ride). This is how it looks like:

The report is a web page, so it can be accessible from any browser. It contains a left navigation panel and dashboard overview.

Navigation Panel: The left menu contains all sections and highlighted warnings and cautions. This panel enables users to navigate across:

-       Dashboard: Contains market stats and selected devices

-       Executions: The most important section, containing each device information like OS version, screen and hardware details, and also execution-related information such as: videos, screenshots, installation process, timing measures, resources and logs.

-       Information: General information about the application under test, such as: version, compatibility, permissions requested, activities and included libraries.

-       Correctness, Performance, Resource usage, security and power sections: each section containing analyzed behavior over all devices. Yellow / red indicators are values out of Monkop’s default thresholds, which are based on Google best practices and important market researches.

-       Errors: Contains crashes reports, and logs when app is not responding (ANR).

This section contains a market chart, execution details, device selection segment (by screen density) and test-run information.

The following chart shows the latest Android market stats based on data collected by Google.

Executions

This is the most important section, since it has each device-specific execution. It shows executions that user has manually selected, or those one that Monkop has automatically selected for him

Clicking on any device, users will find device specific information about execution:

Below this information users will find all details about device performance, videos, screenshots and logs.

Keep updated to learn about how to understand Monkop’s indicators. That yellow/red bubbles you find on each execution.