06/11/11 12:57:35
(Updated for V1.1.1)
This is the test plan for JavaHelp V1.1.1. It is a comprehensive document to insure the quality of the bundles that are released on java.sun.com as well as the Solaris packages that are distributed for the Solaris installation CD. As such it includes additional test requirement for java.sun.com JavaHelp web pages.
Bundles and Solaris packages are initially tested after a release engineer has successfully completed a build. They are not forwarded to java.sun.com or to the java consolidation until all the tests have been successfully completed. Once available on java.sun.com or in the Solaris Operating System the packages are retested.
JavaHelp V1.1.1 was provided in beta form and has been released on the web since September 2000. At the time of it's web release there were no P1 or P2 bugs filed against JavaHelp. There is currently one P2 bug filed against V1.1.1.
The main bundles to test are the "fool-proof" bundles."Fool-prof" bundles have a JRE included. The "small" bundles will be tested only by content and by short tests on a few platforms since a "fool-proof" bundle is based on the small bundle. The Solaris packages will be tested as a main bundle
Each bundle or package will have at least one of the following tests executed.
Test | Description |
---|---|
Documentation Review | Full review of the product Documentation |
TCK Test | JavaHelp Technical Compatibility Kit for JavaHelp 1.0 Specification |
Contents Verification | Verification of a bundles/packages contents |
Installation Verification | Verification package installs correctly |
Full Functionality | A complete test of functionality of JavaHelp via the demos |
Short Functionality | A shorten version of the Full Functionality tests |
Web Pages | A comprehensive test of the Web pages |
The tests executed on a given package are described in Testing Configurations.
The release of JavaHelp V1.1.1 comes in 4 different packages, as indicated below:
Name | Platform | Approx Size | JRE included |
---|---|---|---|
javahelp1_1_1-solsparc-rt.bin | Solaris/SPARC | 23,356,630 | 1.2.2 |
javahelp1_1_1-win-rt.exe | win32 | 17,056,357 | 1.2 |
javahelp1_1_1-unix-no_rt.bin | Unix platform | 8,291,388 | None |
javahelp1_1_1-win-no_rt.exe | win32 | 8,672,334 | None |
The JavaHelp V1.1.1 Solaris install packages comes in 4 different packages, as indicated below. The packages are designed to be installed against the Java1.2 and Java2 Solaris packages.
Name | Description | Size |
---|---|---|
SUNWjhrt | JavaHelp runtime | 407,552 |
SUNWjhdev | JavaHelp developer tools | 391,680 |
SUNWjhdoc | JavaHelp documentation | 2,944,512 |
SUNWjhdem | JavaHelp demos | 5,427,712 |
Testing Configurations: Priorities
OS | Install Bundle | TYPE |
---|---|---|
N/A |
javahelp1_1_1-win-no_rt.exe
javahelp1_1_1-unix-no_rt.bin |
Documentation Review
TCK Test |
Win95 | javahelp1_1_1-win-rt.exe | Full Functionality |
Solaris 2.7 | javahelp1_1_1-solsparc-rt.bin | Full Functionality |
NT4.0 | javahelp1_1_1-win-rt.exe | Full Functionality |
Win98 | javahelp1_1_1-win-rt.exe | Full Functionality |
Solaris 2.8 | Solaris install packages |
Contents Verification
Installation Verification Full Functionality |
Solaris 2.9 | Solaris install packages |
Contents Verification
Installation Verification Full Functionality |
Any Solaris 2 | javahelp1_1_1-unix-no_rt.bin |
Contents Verification
Installation Verification |
Any Win32 | javahelp1_1_1-win-no_rt.exe |
Contents Verification
Installation Verification |
Any win32 | javahelp1_1_1-win-rt.exe |
Contents Verification
Installation Verification |
Any Solaris |
javahelp1_1_1-solsparc-rt.bin |
Contents Verification
Installation Verification |
N/A | N/A | Web Pages |
Proof read manuals for technical accuracy. All examples and procedures will be tested.
Execute the JavaHelp TCK tests against a given installation.
Verify that doc/welcome/content.html and doc/welcome/CONTENS.html matches what is in the release.
Including installation instructions, product documents, and Release Notes.
(Review documentation from a user's perspective)
<installdir>/jre/bin/java -fullversion
java full version "JDK-1.2-V"
<installdir>/jre/bin/java -fullversion
java full version "JDK-1.2-V"
Do this in one win32 and one Solaris machine.
java -fullversion
java full version "JDK-1.2-V" [or 1.1.8]
Do a content difference between the small and the full releases. Changes should be limited to:
Do this in on Solaris 8 update 5 and Solaris 9.
java -fullversion
java full version "JDK-1.2.2-W"
Verify proper installation against:
These tests are a complete test of the functionality of JavaHelp. They rely heavily on the JavaHelp demos as the testing mechanism.
These tests are an abbreviated test of the functionality of JavaHelp. They rely heavily on the JavaHelp demos as the testing mechanism. Short Functionality tests are executed as a sanity check that the installation proceeded correctly. They test only a minimal amount of the functionality. In all cases the Full Functionality test has already been executed on the platform and it is only necessary to retest with the short test.
This tests that the main information available to the users in the release is available. It also tests that the basic JavaHelp machinery is OK.
This tests that different ways of locating and accessing at HelpSet information are working. Most of these tests could be done using the "Merge" application, but this application came quite late, so we are sticking to this mechanism.
The welcome documentation lists a number of other helpsets that can be tried, some of them are given as JAR files, some of them as directories. Each entry should be tested. Here is the list:
welcome.hs | doc\welcome |
HolidayHistory.hs | demos\hsjar\holidays.jar |
HolidayHistory.hs | demos\hs\holidays |
IdeHelp.hs | demo\hsjar\idehelp.jar |
api.hs | demos\hsjar\apidoc.jar;demos\lib\classviewer.jar |
HolidayHistory.hs | demos\lib\jhsearch.jar |
Go to File|Open Page and look at some .html page.
This tests the extension mechanism for navigators. It also tests that the users can navigate through the API documentation.
This tests Context-Sensitive Help, Embedded Help, multiple independent Help viewers.
This tests Merging HelpSets. Also it provides an interface to locating HelpSets and the such.
This tests components within HTML content.
This tests building a Full Text Search.
"../../javahelp/bin/jhindexer -verbose -db JavaHelpIndex2 .".
"../../javahelp/bin/jhsearch JavaHelpIndex2"
This tests that the users can rebuild the IdeDemo example.
Product Marketing owns this
http://java.sun.com/products/javahelp/ -
http://webwork/products/javahelp/ -
Product Marketing owns this. I don't remember where the "in-progress" pages live. These are the installed pages:
http://developer.java.sun.com/
http://developer.java.sun.com/developer/earlyAccess/javahelp/index.html
Things to check
1. Install Bundles come with Swing1.1beta. Using a different Swing requires intervention.
2. Any Solaris will do. The contents is also tested implicitly with every full test.