Artima SuiteRunner is a free testing toolkit for Java, released under the Open Software License. You can use this tool with JUnit to run existing JUnit TestSuites, or stand-alone, to create unit and conformance tests for Java APIs.

To download a ZIP file containing source, binaries, and examples for Artima SuiteRunner, please click on the following link:

• Download Artima SuiteRunner 1.0beta7

Contents of the Distribution ZIP File:

• account.srj - Recipe file for the example
• accountjunit.srj - Recipe file for the JUnit example (Added in 1.0beta4)
• accountscript.srj - Recipe file for script-driven example (Added in 1.0beta6)
• example - Directory of Java source and class files for the example
• generatedscript.txt - Generated cript for script-driven example (Added in 1.0beta6)
• javadoc - Directory containing Javadoc documentation for the API
• README.txt - The obligatory README file
• righttriangle.srj - Recipe file for the Settings example (Added in 1.0beta7)
• script.txt - Hand-written script for script-driven example (Added in 1.0beta6)
• suiterunner-[release].jar - Artima SuiteRunner executable JAR file
• suiterunner-[release]-src.zip - ZIP file of Artima SuiteRunner source code
• wrongtriangle.srj - Recipe file for the Settings example (Added in 1.0beta7)
• xmlreporter.srj - Recipe file for the XMLReporter example (Added in 1.0beta5)

Installation

To install Artima SuiteRunner, unzip the distribution ZIP file.

Running the Example

To run the example, type the following command in the directory in which you unzipped the distribution ZIP file:

java -jar suiterunner-[release].jar account.srj

Artima SuiteRunner requires Java 1.2 or later.

For more information about the example, please see Getting Started With Artima SuiteRunner.

To learn how to use Artima SuiteRunner to run your existing JUnit test suites, please see Running JUnit Tests with Artima SuiteRunner.

Getting Help

If you have questions, comments, criticisms, or suggestions about Artima SuiteRunner, please post to the SuiteRunner Forum.

You may also wish to read the Artima SuiteRunner Tutorial, an article that shows you how to build conformance and unit tests with Artima SuiteRunner.

Change Log

1.0beta7 - Released June 16, 2004

In the 1.0beta7 release, class Report has been made Serializable, tests can now be configured via settings provide in the recipe, on the command line, or via the Edit Recipe dialog. Two methods have been added to the public interface of Suite, setUpSuite and tearDownSuite. setUpSuite is called before execute, and tearDownSuite after. Any settings are passed as key value pairs in a Map in the context parameter of setUpSuite. In addition

1. Added com.artima.examples.settings.ex1.PythagoreanSuite to the examples directory.
2. Added righttriangle.srj and wrontriangle.srj to the suiterunner-[release] directory.
3. Fixed the bug that was causing testSucceeded to be called after testFailed was called.
4. Changed Thread getThread() in class Report to String getThreadName(). This breaking change was done to enable Report to be made Serializable.
5. Class Report now implements Serializable.
6. Added setUpSuite and tearDownSuite to the public interface of class Suite.
7. Invoke setUpSuite prior to execute, and tearDownSuite after execute, both from the Runner and in Suite's implementation of executeSubSuites.
8. Added a Settings tab to the Edit Recipe dialog, that allows the user to manage the recipe's settings via the GUI.
9. Allow settings to be specified as properties in the recipe file, or on the command line via -D<key>=<value> arguments.
10. Pass any settings to the initial Suites listed in the recipe via the Map passed to setUpSuite.

1.0beta6 - Released March 10, 2003

The 1.0beta6 release adds a new script-driven example, adds JavaDoc API documentation for the examples, and modifies and clarifies the contract for Suite's implementation of executeTestMethods:

1. Added com.artima.examples.scriptdriven.ex1.ScriptDrivenAccountSuite to the examples directory.
2. Added com.artima.examples.scriptdriven.ex1.ScriptGenerator to the examples directory.
3. Added JavaDoc API documentation for all the examples in the example/javadoc directory.
4. Make sure tearDownFixture executes if setUpFixture returns normally, even if the test method completes abruptly with an exception.
5. Abort execution of all remaining test methods if either setUpFixture or tearDownFixture completes abruptly with an exception, but still attempt executing any sub-Suites.
6. Clarified the contract of executeTestMethods, so it mentions it invokes setUpFixture and tearDownFixture, and explains its behavior when either of these throws an exception.

1.0beta5 - Released February 23, 2003

The 1.0beta5 release adds a new XMLReporter example and fixes one bug in 1.0beta4:

1. Added a com.artima.examples.reporter.xml.ex1.XMLReporter to the examples directory.
2. Fixed a bug that was causing two instances of Custom reporters to be created instead of one.

1.0beta4 - Released February 16, 2003

This release changes two method names in the public API, fixes a few minor bugs, and makes a few cosmetic enhancements over 1.0beta3:

1. In org.suiterunner.Suite, method setupFixture is now setUpFixture.
2. In org.suiterunner.Suite, method cleanupFixture is now tearDownFixture.
3. In 1.0beta3, the open/save recipe file chooser was actually the same object as the edit runpath's JAR/directory chooser, and they interfered with each other a bit. Now use individual objects for each.
4. Changed the file filter text in the file choosers to something more reasonable: "Recipe Files (*.srj)" and "JAR Files (*.jar)".
5. This time, remembered to update the version number in the about box. In 1.0beta3 it still said 1.0beta2. It now says 1.0beta4.

1.0beta3 - Released February 12, 2003

The 1.0beta3 release fixes three bugs in 1.0beta2:

1. OK button of Suite Selector dialog is now enabled when appropriate.
2. The extraneous InterruptedException on startup on Mac OS X Java 1.3 no longed causes a stack trace to show up on the standard output.
3. When running without a GUI, an event handler thread is no longer fired off, which was preventing the app from exiting on completion of the test. The app now exits immediately when a test run without the GUI completes.

1.0beta2 - Released January 24, 2003

The 1.0beta2 release is the inital public release of Artima SuiteRunner.