Can you recommend a flexible Win32 application for designing test plans?

November 15, 2004 3:10 PM

Can you recommend a flexible Win32 application for designing test plans?

I'm the testmonkey for a Windows-based software company, and I'm looking for an application that allows me to design and execute test plans. Desired features:

• A Win32 application; Web-based solutions require too much overhead and are generally clumsy. If I were in the market for something Web-based, I'd probably write my own.
• Open Source is preferable, though I could probably get a budget if the argument were convincing enough. Professional grade UI regardless.
• Ideally, plans are broken down into a hierarchical tree structure, wherein you define n number of test sections, test cases, etc. This tree can be expanded and collapsed depending on the level of detail required.
• Individual test plans are stored as discrete files rather than a central database/server.
• Test case verification via PASS/FAIL, preferably with color coding.
• Test plan reporting, preferably with editable templates.
• Miscellaneous Non-Vital: Import/Export with Microsoft Excel or Microsoft Word, time tracking per task, test regression/revision history, etc.

Any help in this pursuit is greatly appreciated. The aforementioned Excel and Word are woefully inept at these sorts of tasks.

posted by Danelope to computers & internet (3 comments total)

What kind of applications are you testing? Or more specifically, what language are they written in? The only programs i've used are the XUnit type applications. NUnit For c# and .NET applications, JUnit for java programs. the XUnit type programs seem to meet most of your requirements: win32 application, open source, heirarchical tree, discrete files, pass/fail with color coding, (maybe test plan reporting, i don't know), (not sure about exporting).

I haven't used the C++ version (CPPUnit), so i can't really comment on it.

You can also find more tools here.
posted by escher at 4:22 PM on November 15, 2004

The applications themselves are built in C# .NET, Visual Basic, and Flash. That said, the software I'm looking for should actually be platform- and language-agnostic, as I only need to build textual (as opposed to functional/scripted/automated) test plans. The hierarchy should roughly fit into PROJECT > FEATURE > OBJECT > TESTS AGAINST THIS OBJECT.

(I apologize if I've not used the proper terminology. I'm a Web Designer/Developer by trade, and this is the first full-fledged software testing position I've had.)
posted by Danelope at 5:32 PM on November 15, 2004

For reference, I've managed to locate TestLog, which meets nearly all of the above criteria and is generally a nice program. Caveats:

1. It stores all data in a structure dictated by (filesystem) directories and files. Data for individual test cases are in XML format.

2. No direct import/export functionality with MS Office file formats, though it can import from and export to .CSV files, which Excel groks.

3. Registration is $99 per seat, with bulk discounts available.

4. Supports a hierarchy for PROJECT > TEST SUITE > TEST CASES, which is less detailed than initially desired but can work with some adjustment to my documentation method.

5. The reporting functionality is nice, but the interface leaves something to be desired. Once you create reports, they are static, with no means to update them with the latest data, and no means to edit their display parameters. (For example, if you want to omit a field from the test list, you have to create a new report rather than editing an existing one.)

On the other hand:

1. The application is fast, well-designed, and offers an array of features useful to even moderately experienced testers.

2. You can duplicate projects, test suites, or test cases at will, to maintain a revision history (particularly useful if you deal with a lot of regression testing.)

3. The test case display can be customized via editable CSS files, which is an unexpected treat.

I have 90 days left to evaluate the application in full but, thus far, it seems quite promising.
posted by Danelope at 9:59 AM on November 16, 2004