Copyright © 2011 Open Geospatial Consortium
21
5.2.1.3 Test configuration and scheduling
Once Drivers have been developed, Japex is ready to run some tests on these drivers. A test campaign is described through XML configuration files. The common way to use
Japex, and run a campaign, is to provide 2 files:
A “driver group” file, gathering the list of drivers “driver name” to run and the parameters to give to these drivers and some “global” japex parameters like
“unity” for measurements,…
A “test suite” file, grouping “test case” items grouping a list of parameters defining a test case. These parameters depend of the nature of the test. For our
compression test, they are mostly input files As the number of XML files used to describe a campaign can change due to the
possibility of using Xinclude, it’s important to understand that an individual test is characterized by:
The selection of a driver, with parameters let’s say EXI with schema knowledge and post-compression with an interest on “cpu” consumption when compressing
The selection of a test case, in our case, an input file for instance a notam When defining a driver group, with a test suite containing multiple test cases, you will
have a run corresponding for each test case by each driver. That is the main reason to define one file for drivers you will run them every time, and multiple files for test
suites.
5.2.1.4 Report generation
Japex generates reports in both HTML and XML. HTML pages include pictures of histograms in our case, but other graphs are possible. When a campaign uses multiples
drivers on multiples files, you get several graphs, including:
One for each test case or input file showing the compared performance of each driver on histogram bar by driver
One global representing the average performance of each driver for all the files, ranging for 3 different means calculation Arithmetic, Geometric and Harmonic
Result data are also shown in table, grouped by driver, one line for each test case or input file in our situation.
For graphs compaction for instance, the first “driver” sets the reference 100 and other are expressed related to the performance of the first one.
Copyright © 2011 Open Geospatial Consortium
22 XML output is easy to post process if you plan to generate your own graphs excel,….
5.2.1.5 W3C EXI test bed
Kategori