TestReport

TestReport["file"]

runs tests from a file, returning an analysis of the completed test run.

TestReport[{test1,test2,…}]

gives a report of the results of the tests testi.

TestReport[{report1,report2,…}]

gives a unified report by merging all test reports reporti.

Details and Options

Examples

open allclose all

Basic Examples  (2)

Run a list of VerificationTest:

Run tests from a notebook:

Extract information on tests that failed and present in a TabView:

Merge the existing TestReportObject with a new one:

Scope  (1)

Basic Uses  (1)

Run a list of tests:

Properties of the TestReportObject:

Association of individual test results:

Compare the expected and actual outputs of tests where those differed:

Expected and actual messages where a message failure occurred:

Options  (6)

MemoryConstraint  (2)

Apply memory constraint to all given VerificationTest:

The individual options for the VerificationTest override the option set at the TestReport level:

SameTest  (2)

Apply SameTest to all given VerificationTest:

The individual options for the VerificationTest override the option set at the TestReport level:

TimeConstraint  (2)

Apply time constraint to all given VerificationTest:

The individual options for the VerificationTest override the option set at the TestReport level:

Applications  (1)

Run a list of VerificationTest and test files at the same time:

Use TestReport again to merge an existing TestReportObject into a new one:

When merging multiple TestReportObject instances using TestReport, duplicated tests will be automatically deleted from the report:

You can now use GroupBy to group together tests that have been run in the same file:

Possible Issues  (1)

TestReport is automatically deleting duplicated tests:

Wolfram Research (2014), TestReport, Wolfram Language function, https://reference.wolfram.com/language/ref/TestReport.html (updated 2019).

Text

Wolfram Research (2014), TestReport, Wolfram Language function, https://reference.wolfram.com/language/ref/TestReport.html (updated 2019).

CMS

Wolfram Language. 2014. "TestReport." Wolfram Language & System Documentation Center. Wolfram Research. Last Modified 2019. https://reference.wolfram.com/language/ref/TestReport.html.

APA

Wolfram Language. (2014). TestReport. Wolfram Language & System Documentation Center. Retrieved from https://reference.wolfram.com/language/ref/TestReport.html

BibTeX

@misc{reference.wolfram_2022_testreport, author="Wolfram Research", title="{TestReport}", year="2019", howpublished="\url{https://reference.wolfram.com/language/ref/TestReport.html}", note=[Accessed: 10-June-2023 ]}

BibLaTeX

@online{reference.wolfram_2022_testreport, organization={Wolfram Research}, title={TestReport}, year={2019}, url={https://reference.wolfram.com/language/ref/TestReport.html}, note=[Accessed: 10-June-2023 ]}