testng-plugin

Plugin Information

Plugin ID testng-plugin
Latest Release 0.32-h-1
Latest Release Date Sep 4, 2012
Plugin Central Plugin Central 3.2
Sources Github
Support Eclipse Hudson Forum
Issue Tracking Eclipse Bugzilla
Hudson Core (latest) 3.3.3

This plugin allows you publish TestNG results.

TestNG result xml file contains more information than the junit report xml file . This plugin exposes those extra information in graph and table reports.

This plugin makes it possible to import TestNG XML reports from each build into Hudson.

The data is parsed using the output generated using org.testng.reporters.XMLReporter. The results are displayed with a trend graph and all details about which tests that failed are also presented.

Features : The page layouts are intentionally designed to look very similar to Hudson's junit plugin.

  • In the project/build page you can see a summary of passed/fail tests as well as passed/fail configuration methods. It also enlists the failed test cases with a direct link to view the test failure.
  • In the Class result summary page test methods are separated from configuration methods
  • In the Package result summary you can see the order which test methods were ran during the regression run.
  • Different graphs will show you the pass/failed trend of job's previous results.
  • Able to hide/expand tables that display package and class results

Usage :

  1. Job Configuation : You need to specify an ant compatible search path where testng plugin will look for testng resutl xml files. If your result xml files are not located under job/workspace and you need to specify a relative path , make sure that the below checkbox is selected.

Release  0.7 (October 25, 2010)

  • Fixed: Plugin fails to find testng-results.xml file when project is configured to checkout sources from SVN SCM.

Release  0.5 (September 24, 2010)

  • Fixed: parser test cases were failing with IOException
  • Fixed: Updated colors for Trend Graph to match JUnit graph and bar colors
  • Fixed: Better display of content on the test method result page
  • Fixed: Open/Close js behavior on Package results page
  • Fixed: Removed a lot of dead code and unnecessary files
  • Fixed: Trend Graph is shown for Projects and not for Builds
  • Changed: TestNG Results link at Project page doesn't take you to latest build results anymore
  • New: Trend graph has tooltips and links to different builds

Release  0.4 (August 17, 2010)

  • New: Initial release

Release  0.1 (August 12, 2010)

  • First Revision

Labels:

plugin-report plugin-report Delete
tier3-hudson-plugin tier3-hudson-plugin Delete
Enter labels to add to this page:
Wait Image 
Looking for a label? Just start typing.
  1. Oct 27, 2010

    Peter Schuetze says:

    The current version available is 0.7. Can I find the release notes for that vers...

    The current version available is 0.7. Can I find the release notes for that version somewhere?
    I am using version 0.5 and since I have no test environment available so far, I need to have an indication whether I take the risk of updating the plugin or not.

    BTW, I finally found the readme in the source code. Which looks pretty good. How about just copying the content of the file on this page. It would be great.

  2. Nov 11, 2010

    Mark Mills says:

    I tried out the 0.7 version, and the plugin doesn't appear to display properly t...

    I tried out the 0.7 version, and the plugin doesn't appear to display properly to me. There is merely a check box for "TestNG Results" under the project configuration. I don't see the additional fields specified in the hudson.plugins.testng.Publisher/config.jelly file (and documented in the wiki page above). Perhaps the plugin is not built correctly?

    Thanks,

    Mark

    1. Jan 03, 2011

      Farshid Ghods says:

      Mark, are you still facing the issue after upgrading to version 0.8 ?

      Mark,

      are you still facing the issue after upgrading to version 0.8 ?

  3. Nov 12, 2010

    Johann Werner says:

    I tried to use 0.7 but it seems to have some problems I couldn't resolve. The la...

    I tried to use 0.7 but it seems to have some problems I couldn't resolve. The latest test result and a graph are shown but class/package test results are missing. Clicking on the 'TestNG Results' link returns a 404 response because no testngresults directory has been created by the plugin.

    I have an ant task that runs my tests:

    <testng outputdir="Test/Reports" reporter="org.testng.reporters.XMLReporter" classpathref="test.classpath">
    <xmlfileset dir="Test" includes="testng.xml"/>
    </testng>

    which are written to the project directory into Test/Reports. For the Hudson job I configured testng-plugin to publish TestNG results and set the report pattern to 'Test/Reports/**/*.xml'. On the console output there is only a line stating that the xml file was parsed. In the system log I see a bunch of warnings:

    Nov 12 11:03:43 v-100003-svr01 com.hudson[78]: 12.11.2010 11:03:43 hudson.plugins.testng.parser.ResultPullParserHelper parseToTagIfFound
    Nov 12 11:03:43 v-100003-svr01 com.hudson[78]: WARNUNG: next() threw exception : already reached end of XML input (position: END_DOCUMENT seen ...</testsuite>\n... @10:1)
    Nov 12 11:03:43 v-100003-svr01 com.hudson[78]: 12.11.2010 11:03:43 hudson.plugins.testng.parser.ResultPullParserHelper parseToTagIfFound
    Nov 12 11:03:43 v-100003-svr01 com.hudson[78]: WARNUNG: next() threw exception : already reached end of XML input (position: END_DOCUMENT seen ...</testsuite>\n... @11:1)
    Nov 12 11:03:43 v-100003-svr01 com.hudson[78]: 12.11.2010 11:03:43 hudson.plugins.testng.parser.ResultPullParserHelper parseToTagIfFound
    Nov 12 11:03:43 v-100003-svr01 com.hudson[78]: WARNUNG: next() threw exception : already reached end of XML input (position: END_DOCUMENT seen ...</testsuite>\n... @20:1)
    Nov 12 11:03:43 v-100003-svr01 com.hudson[78]: 12.11.2010 11:03:43 hudson.plugins.testng.parser.ResultPullParserHelper parseToTagIfFound
    [...]

    Is that a known bug or what could be the cause?

    1. Jan 03, 2011

      Farshid Ghods says:

      that means the testng.xml file does not have a </testsuite> xml node. my a...

      that means the testng.xml file does not have a </testsuite> xml node. my assumption was that any testng.xml file will have a testsuite . I could be wrong . I will check with testng specs later.

      can you share couple of those files here ?

      1. Jan 07, 2011

        Johann Werner says:

        With version 0.8 I had no more of those errors. But what is still a problem: •...

        With version 0.8 I had no more of those errors.

        But what is still a problem:

        • Looking at a job the link from the side menu, the central "TestNG Result" link and the trend links are correctly pointing at http://<server-address>/hudson/job/<jobname>/[<build>/]testngreports
        Now when I click on the "TestNG Result" link I get to a page where all links lack the "/hudson" part so all are resulting in a 404-error.

        • I have a test class that contains 5 methods. 4 of them are annotated with @Test(groups = { "group1" }) and one with @Test(groups = { "group2" }). Both groups are executed by TestNG and looking at the report files results for all 5 methods are written out correctly.
        On the package result page of the testng-plugin the class is listed twice under the topic "All Classes" with the correct duration and total method number for each. But the column "(diff)" after "Total" shows a "--3" for group2 which seems wrong as for that group nothing changed. The testng-plugin seems to mix both groups up. Also if I click on the class link I get the same page with the 4 methods of group1 no matter which of both links I choose though it should show either the methods of group1 or group2.

        1. Feb 07, 2011

          Farshid Ghods says:

          Hi Johann, I tested the code mostly with test suites which don't have associate...

          Hi Johann,

          I tested the code mostly with test suites which don't have associated groups. Is it possible that you share the testng-result.xml here?

          -Farshid

  4. Nov 23, 2010

    Scott Severtson says:

    Plugin version 0.7 has a minor bug: The javascript method to show/hide results t...

    Plugin version 0.7 has a minor bug: The javascript method to show/hide results tables is defined with inconsistent case. Some define/use "showOrHideTable", some "showorHideTable". This may be resolved by editing the .jelly template files to use consistent case.

    1. Jan 03, 2011

      Farshid Ghods says:

      Hi Scott, are you still facing the issue after upgrading to 0.8 ?

      Hi Scott,

      are you still facing the issue after upgrading to 0.8 ?

  5. Nov 23, 2010

    Scott Severtson says:

    Also, version 0.7 appears to be missing an icon: Requests to /build/plugin/testn...

    Also, version 0.7 appears to be missing an icon: Requests to /build/plugin/testng-plugin/icons/report.png results in a 404. To resolve, we placed an icon in Hudson's plugins directory, under plugins/testng-plugin/icons/report.png. We used Hudson's built-in clipboard icon, found in the Hudson install directory, under images/48x48/clipboard.gif, which we converted to a .png and renamed.

    1. Jan 03, 2011

      Farshid Ghods says:

      sorry for the very late response. I just checked in the missing icon. I tried t...

      sorry for the very late response. I just checked in the missing icon.

      I tried to release the newer version but still dont know how to release the plugin from github. working on it now :)

      1. Feb 07, 2011

        Farshid Ghods says:

        Scott, I just released the testng 0.9 update which has the missing icon but hud...

        Scott,

        I just released the testng 0.9 update which has the missing icon but hudson update center is not displaying the update.

        http://maven.hudson-labs.org:8081/content/repositories/releases//org/jvnet/hudson/plugins/testng-plugin/0.9/