I. Overview
Conformance testing is a key enabler of the adoption of any standard. Standards that enjoy high adoption rates are those that make it as easy as possible for implementers to successfully implement those standards. Therefore, the development of an ETS and the provision of training on the use of the ETS are necessary for the continued adoption of the GIMI standard.
II. Executive summary
This report describes a training course on use of an Executable Test Suite (ETS) for the GEOINT Imagery Media for Intelligence, Surveillance, and Reconnaissance (GIMI). Developed as part of the Testbed-21 initiative, the training course is presented as a series of presentation slides and accompanying training materials.
GIMI is a family of standards that integrate advanced media standards such as the ISO Base Media File Format (ISOBMFF) and the High Efficiency Image File Format (HEIF). GIMI has been designed to support still images, motion imagery, tiled imagery, audio, security marking, timing information, and content identification (id) information.
To facilitate the development of applications that can produce GIMI-conformant files, the Testbed-21 initiative included a task to implement an ETS for GIMI. Along with the ETS, the Testbed was tasked with developing and delivering training on the use of the ETS.
This report presents the training course, which is available as a Markdown file that can be converted to slides using Marp.
III. Keywords
The following are keywords to be used by search engines and document catalogues.
gimi, testbed, training, team engine
IV. Submitting Organizations
The following organizations submitted this Document to the Open Geospatial Consortium (OGC):
- Pixalytics
- Heazel Technologies
- Geomatys
V. Contributors
All questions regarding this document should be directed to the editor or the contributors:
| Name | Organization | Role |
|---|---|---|
| Samantha Lavender | Pixalytics | Editor |
| Charles Heazel | Heazel Technologies | Contributor |
| Martin Desruisseaux | Geomatys | Contributor |
| Gobe Hobona | OGC | Contributor |
VI. Future Outlook
The training presented in this report is focused on the ETS for version 1.0.0 of GIMI. There are associated specifications that are emerging around GIMI, for example NGA’s Imagery Domain Ontology and OGC’s GeoHEIF, that will likely require conformance testing tools of their own. Therefore, executable test suites for those associated specifications will also require training courses to help with their adoption.
There is also an growing trend on use of Artificial Intelligence (AI) to create interactive and adaptive training courses. This could be an avenue for a future testbed to explore, for example, how a training course on a specific ETS could adapt to the user’s situation with the help of AI.
VII. Value Proposition
The training course will lead to:
quicker understanding of how to use the ETS
fewer mistakes in interpreting test results
faster deployment of the ETS through greater profeciency
1. Introduction
Conformance testing is a critical enabler for the adoption of technical standards, as high adoption depends on making implementation as straightforward as possible for developers. To support adoption of the GEOINT Imagery Media for Intelligence, Surveillance, and Reconnaissance (GIMI) standard, the Testbed-21 initiative developed an Executable Test Suite (ETS) along with dedicated training on its use. GIMI integrates advanced media standards such as ISO Base Media File Format and High Efficiency Image File Format to support still and motion imagery, tiled imagery, audio, security markings, timing information, and content identification.
The training course, delivered through presentation slides and supporting materials, is designed to help implementers correctly apply the ETS when producing GIMI-conformant files. The training described focuses on the ETS for GIMI version 1.0.0 and aims to accelerate understanding, reduce errors in interpreting test results, and enable faster and more effective deployment of the ETS.
2. Topics
Figure 1 is a cover slide that introduces those involved in developing the training material.
Figure 1 — Slide 1
Figure 2 introduces the concept of conformance, and the relevance of an Abstract Test Suite (ATS) and Executable Test Suite (ETS) to conformance testing. There are several additional concepts underneath those aforementioned. Therefore, the trainees are referred to relevant resources such as The ModSpec Model: A Standard for Designing and Writing Modular Standards (ModSpec).
Figure 2 — Slide 2
Figure 3 introduces the GIMI standard and the base standards that GIMI extends, namely ISOBMFF and HEIF. The slide also explains the ownership of GIMI, that is the role of the GEOINT Media Standards Board (GMSB).
Figure 3 — Slide 3
Figure 4 explains the structure of the GIMI format, introducing the concept of boxes — which is inherited from ISOBMFF.
Figure 4 — Slide 4
Figure 5 introduces the NGA’s Imagery Domain Ontology (IDO). As the IDO is still in development, the introduction is intentionally meant to be brief.
Figure 5 — Slide 5
Figure 6 offers an outline of the architecture of the ETS.
Figure 6 — Slide 6
Figure 7 offers an outline of the approach adopted in conformance testing through the ETS.
Figure 7 — Slide 7
Figure 8 offers an outline of TEAM Engine, the test harness of the OGC. The GIMI ETS is implemented as a plug-in for TEAM Engine.
Figure 8 — Slide 8
Figure 9 offers an outline of the GIMI Abstract Test Suite (ATS).
Figure 9 — Slide 9
Figure 10 offers an outline of the tests executed by the ETS.
Figure 10 — Slide 10
Figure 11 explains the role of Apache SIS in facilitating the ingestion of GIMI files into the ETS.
Figure 11 — Slide 11
Figure 12 explains how to run the ETS through the Graphical User Interface (GUI) provided by TEAM Engine. Note that TEAM Engine is configured with the ETS, with the ETS appearing as module.
Figure 12 — Slide 12
Figure 13 presents an example output for a GIMI file that has passed the mandatory tests.
Figure 13 — Slide 13
Figure 14 presents an example output for a file that has failed the mandatory tests.
Figure 14 — Slide 14
Figure 15 presents the steps for invoking the ETS through the Command Line Interface (CLI).
Figure 15 — Slide 15
Figure 16 presents a sample configuration file, which is used to integrate the ETS into TEAM Engine.
Figure 16 — Slide 16
Figure 17 presents a sample configuration file for setting the inputs to an ETS.
Figure 17 — Slide 17
Figure 18 presents an example XML-encoded report of a test run. Note that whereas the GUI presents an HTML rendered report, the CLI presents the report as an XML-encoded file.
Figure 18 — Slide 18
Figure 19 presents a set of commands for building the Maven project of the ETS, and then running a docker container that includes the docker image created by the Maven project.
Figure 19 — Slide 19
Figure 20 introduces the use of the Java library of the ETS through an IDE.
Figure 20 — Slide 20
Figure 21 explains how to interpret the test results.
Figure 21 — Slide 21
Figure 22 provides some further explanation of how to interpret the test results.
Figure 22 — Slide 22
Figure 23 is an invitation for questions from the trainees.
Figure 23 — Slide 23
3. Outlook
Looking ahead, additional specifications related to GIMI, such as NGA’s Imagery Domain Ontology and OGC’s GeoHEIF, are expected to require their own conformance testing tools and associated training. Therefore, it will be necessary to extend the GIMI ETS in such a way that it can leverage those additional conformance testing tools when they become available. Emerging approaches, including the use of artificial intelligence to deliver adaptive and interactive training, represent a potential future direction to further improve usability and adoption of executable test suites for geospatial and imagery standards.
4. Security, Privacy and Ethical Considerations
No security, privacy nor ethical concerns were identified in the development of the Training course.
Bibliography
[1] Joan Masó Pau, Núria Julià Selvas, Rob Smith, Open Geospatial Consortium: OGC 24-040r1, OGC Testbed 20: GIMI Lessons Learned and Best Practices Report. Open Geospatial Consortium (2025). http://www.opengis.net/doc/PER/t20-D013.
[2] NGA: GEOINT Imagery Media for Intelligence, Surveillance, and Reconnaissance (GIMI) Volume 1, Version 1.0.0 (2024).
Annex A
(normative)
Abbreviations/Acronyms
ATS
Abstract Test Suite
ETS
Executable Test Suite
GIMI
GEOINT Imagery Media for Intelligence, Surveillance, and Reconnaissance
Annex B
(informative)
Technical Detail
B.1. Sample Configuration file
This section presents a sample configuration file, typically named config.xml.
Listing B.1
<?xml version="1.0" encoding="UTF-8"?>
<config>
<scripts>
<organization>
<name>OGC</name>
<standard>
<name>GIMI</name>
<version>
<name>1.0</name>
<suite>
<namespace-uri>http://www.opengis.net/cite/gimi-1</namespace-uri>
<prefix>tns</prefix>
<local-name>ets-gimi-1-0.2-SNAPSHOT</local-name>
<title>ets-gimi-1 Conformance Test Suite</title>
<description>Tests for compliance to the GIMI Standard.</description>
<BasicConformanceClasses>
<conformanceClass>Core</conformanceClass>
</BasicConformanceClasses>
</suite>
<revision>
<name>0.2-SNAPSHOT</name>
<status>Final</status>
<sources>
<source>gimi-1/1.0/ctl</source>
</sources>
<webdir>gimi-1/1.0/site</webdir>
</revision>
</version>
</standard>
</organization>
</scripts>
</config>
B.2. Sample Input Properties file
This section presents a sample input properties file, typically named test-run-props.xml.
Listing B.2
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE properties SYSTEM "http://java.sun.com/dtd/properties.dtd">
<properties version="1.0">
<comment>Sample test run arguments</comment>
<entry key="iut">file:///path/sample-image.heif</entry>
</properties>