Professional > Table scripting > Statistical tests > Setting the significance levels
 
Setting the significance levels
By default, the column proportions, column mean, net difference test, and paired preference tests are run at the 5% significance level. However, you can optionally run a test at another significance level, such as the 10% or 1% significance level.
You can also run the test at two significance levels on the same table. In the resulting table, the IDs of columns that are significant at the higher level appear in upper case, and those that are significant at the lower level appear in lower case.
You select this option using the SigLevel statistics property. For example:
TableDoc.Tables.MyTable.Statistics[0].Properties["SigLevel"] = 1
The Statistics and Statistic objects implement the mrScriptBasic dynamic property expansion feature. This means that an alternative way of writing this would be:
TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevel = 1
See Dynamic property expansion.
To run the test at two significance levels, use the SigLevelLow statistics property to display the lower significance level. For example:
TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevel = 1
TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevelLow = 5
In the resulting table, the IDs of columns that are significant at the higher level appear in upper case, and those that are significant at the lower level appear in lower case.
Note If you are using two levels of significance, ensure that the value of the SigLevelLow property is greater than that of the SigLevel property, as it represents a higher probability that the results are due to chance, and therefore a lower level of significance.
To run the test at two significance levels, use the SigLevelLow statistics property to display the lower significance level. For example:
TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevel = 1
TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevelLow = 5
In the resulting table, the IDs of columns that are significant at the higher level appear in upper case, and those that are significant at the lower level appear in lower case.
Note If you are using two levels of significance, ensure that the value of the SigLevelLow property is greater than that of the SigLevel property, as it represents a higher probability that the results are due to chance, and therefore a lower level of significance.
See also
Column means test
Paired preference test
Diagnostics information
Overlapping data
Hierarchical data
Minimum base and small base values in statistical tests
Statistical tests compared to IBM SPSS Statistics
Statistical tests compared to Quantum and Quanvert
Statistical tests