TestSmith generates four different report types

HTML Reports
Text Reports
Timing Data Logs
Command Line Error Log




Html Reports (*.tsrep files)  ^

The main TestSmith playback report. This html-formatted report is displayed in the TestSmith Report Window during playback. It is updated as the playback progresses.
Seven levels of logging are provided, each one independent of the others. See Standard Logging Options.
Reports contain 5 colums of information, as follows:
  • A timestamp of the format YYYY:MM::DD::HH::MM::SS.msecs; by default local time is used. This can be set to GMT if required.
  • The ordinal number of the command.
  • The script line number where the command begins.
  • The type of message (FLG, WRN, INF, REM or DSC) or the command result (OK, OK! ERR)
  • Message description, including detailed flag, warning and error information.
Example .tsrep file:

ie-test_0: TestSmith Report

TimeStamp (Local) Cmd Line   Detail...
2003:03:02:13:32:13.88514FLGFuzzy match on Frame Window [title=Microsoft%--Internet%--Explorer, class=IEFrame]
2003:03:02:13:32:13.95524OK!wndInit completed successfully
2003:03:02:13:32:13.95528INFwaiting to reinitialize Html Document in 2000 milliseconds
2003:03:02:13:32:17.37028OK htmlNavigate completed successfully
2003:03:02:13:32:17.410311WRNHtmlDocument not found at position 15; using closest HtmlDocument at position 16.
2003:03:02:13:32:17.445311OK!htmlClick completed successfully
2003:03:02:13:32:17.480416INFwaiting to retry htmlText in 2000 milliseconds
2003:03:02:13:32:19.583416FLG<INPUT> element found at new index 153
2003:03:02:13:32:19.583416OK!htmlText completed successfully
...
2003:03:02:13:32:36.077   Playback Completed

Flags: 7
Warnings:0
Errors:1
Error Code:1
Elapsed Time: 22.983 seconds


Text Reports (*.tslog files)  ^

Plain text (tslog) reports are identical in content to the *.tsrep report, with the following formatting differences:
  • Each field in a tslog report is contained in square brackets [ ].
  • Leading zeros are used for the command number and line number fields
    so the columns line up.
  • The OK! result is displayed as either
    OKf (Flag was raised) or OKw (Warning was issued).
If the 'Plain Text Logs only' check box is selected in the Play Options dialog box then it is the plain text log that is displayed in the TestSmith Report Window.

Example lines from a .tslog file (wrapped): 


ie-test_0


C:\QualityForge\TestSmith\Reports\ie-test_0.tslog


[2003:03:02:13:32:13.885] [001] [0004] [FLG]


    [Fuzzy match on Frame Window [title=...]]


[2003:03:02:13:32:13.955] [001] [0004] [OKf]


    [wndInit completed successfully]


[2003:03:02:13:32:13.955] [002] [0008] [INF]


    [waiting to reinitialize Html Document in 2000 milliseconds]


[2003:03:02:13:32:17.370] [002] [0008] [OK ]


    [htmlNavigate completed successfully]


[2003:03:02:13:32:17.410] [003] [0011] [WRN]


    [HtmlDocument not found at position 15; using ...]


[2003:03:02:13:32:17.445] [003] [0011] [OKw]


    [htmlClick completed successfully]


[2003:03:02:13:32:17.480] [004] [0016] [INF]


    [waiting to retry htmlText in 2000 milliseconds]


[2003:03:02:13:32:19.583] [004] [0016] [FLG]


    [<INPUT> element found at new index 153]


[2003:03:02:13:32:19.583] [004] [0016] [OKf]


    [htmlText completed successfully]


...


[2003:03:02:13:32:36.077] [---] [----] [---]


    [Playback Completed]





Flags        = 7


Warnings     = 0


Errors       = 1


Error Code   = 1


Elapsed Time = 22.983 seconds

Timing Data Logs (*_time.csv files)  ^

The final run time for each execution of a script is saved to a Timing Data Log - a .CSV file).
.CSV files can be viewed in a spreadsheet application. Graphs and charts can be created as desired from the data in these files.
A timing data line contains 5 fields; the format of a timing data line is:

ScriptName_Run Number,Start Timestamp,Run Time (milliseconds),
Number Of Errors,Exit/Error Code

Example Log Output when running the script default.smith 3 times in parallel (no errors):


default_0,2003:02:14:19:25:26,2133,0,0


default_1,2003:02:14:19:25:27,2193,0,0


default_2,2003:02:14:19:25:27,2354,0,0

Command Line Error Log (cmd_error.log)  ^

Command Line/Batch Mode errors are logged to cmd_error.log in the TestSmith /Reports directory. The format of a command line error is:

[Timestamp] [message]

Example lines (wrapped):


[2003:02:02:14:14:36.613]


    [Invalid file(s): C:\MyScripts\notexist.smith]


[2003:02:02:14:15:17.061]


    [No scripts specified for batch mode]