About the contributor


PDF Association

More contributions
PDF Association forms PDF/E Competence Center to support engineering and 3D applications

PDF/E Competence Center promote awareness of the ISO standard for engineering supporting the secure creation, exchange and use of engineering documents.

Document Expectations Through the Ages

Reproduction of a bison of the cave of Altamira Throughout Time… Humans have put their thoughts to media with the idea of capturing these in time – that is, creating documents – for many millennia. Needless to say, readers’ expectations have changed …

PDF Day Australia – Agenda

This educational event is designed to help CIOs, document management experts and electronic content policy-makers come to grips with ISO-standardized PDF technology. With special focus on archiving and accessibility, PDF Day Australia is a unique oppor …

Save the Date – PDF Days Europe 2017, May 15-16

The successful PDF Days Europe will be held in Berlin again. Across two days, you’ll be able to choose from German- and English- language presentations, user reports and workshops in order to assemble your own personal package of PDF knowledge.

Making “information management” real

ECM needs a common portable container to move information management to the next level.

Isartor Test Suite

The Isartor test suite is named after the location of the first meeting of the Technical Working Group, a medieval gate towards the river Isar in the center of Munich/Germany. This test suite comprises a set of files which can be used to check the conformance of software regarding the PDF/A-1 standard. More precisely, the Isartor test suite can be used to “validate the validators”: It deliberately violates the requirements of PDF/A-1 in a systematic way in order to check whether PDF/A-1 validation software actually finds the violations.

Basic Principles

The Isartor test suite has been constructed according to the following basic principles:

  • Atomic: A test file attempts to examine a particular aspect of the standard. Wherever possible test files avoid to touch more than one aspect of the standard.
  • Complete: The Isartor test suite provides full coverage of all requirements in the PDF/A-1 standard.
  • Self-documenting: The test files contain intrinsic information about the expected result of performing the test.
  • Traceable: Each test is based on a specific clause in PDF/A-1 which can easily be identified.
  • Reproducible: All test files (with only a few exceptions) have been created programmatically with a documented change history. This creation process support reproducibility.

Through a rigid quality assurance and testing process a lot of effort has been spent to make sure that all test files adhere to these basic principles.

What the Test Suite checks

The Isartor test suite for PDF/A-1b deliberately violates each requirement of the PDF/A-1b standard in order to check whether validation software detects all possible kinds of violation of the standard requirements, and whether it provides appropriate explanation for rejected nonconforming documents.

A PDF/A validator which completely passes the Isartor test suite is known to implement all required checks.

For the sake of simplicity, only a single aspect of the standard is violated at a time. However, in a few cases this is not possible because of interdependencies among multiple aspects of the standard.

The test requirements (assertions) are the inverse of requirements in the standard. For example, PDF/A-1 mandates that fonts be embedded, so the test suite contains several documents where the fonts are deliberately not embedded. PDF/A validators must report this standard violation in order to pass the test.

Who created the Test Suite?

The Isartor test suite is a project of the PDF/A Competence Center, and was developed by its Technical Working Group (TWG). Members of the TWG are volunteers from member companies of the PDF Association. All companies who send TWG delegates are software vendors. Individual TWG members are experts in the field of PDF and/or standardization. Most members are involved in the design, development, and testing of software for creating, processing, or validating PDF/A documents. Several TWG members are also members of TC 171 SC2 WG 5, the ISO committee which defined the PDF/A family of standards.

Design and structure of the Isartor test suite have been devised by the TWG. Test files have been created by a core group after thoroughly discussing the respective criteria in the standard. All test files have been formally reviewed by at least two other members of the TWG.


Isartor test suite files have been contributed by the following founding members of the PDF/A Competence Center:
PDF Tools AG
PDFlib GmbH
callas software GmbH

Extensive reviews of the test suite have been performed by the above companies plus the following:
intarsys consulting GmbH
SEAL Systems AG

Download the Isartor Test Suite Information

Tags: Isartor, conformance, test suite, validate
Categories: PDF/A