Setting the significance levels

By default, the column proportions, column mean, net difference test, and paired preference tests are run at the 5% significance level. However, you can optionally run a test at another significance level, such as the 10% or 1% significance level.

You can also run the test at two significance levels on the same table. In the resulting table, the IDs of columns that are significant at the higher level appear in upper case, and those that are significant at the lower level appear in lower case.

You select this option using the SigLevel statistics property. For example:

TableDoc.Tables.MyTable.Statistics[0].Properties["SigLevel"] = 1

The Statistics and Statistic objects implement the mrScriptBasic dynamic property expansion feature. This means that an alternative way of writing this would be:

TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevel = 1

To run the test at two significance levels, use the SigLevelLow statistics property to display the lower significance level. For example:

TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevel = 1

TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevelLow = 5

TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevelLow = 5

In the resulting table, the IDs of columns that are significant at the higher level appear in upper case, and those that are significant at the lower level appear in lower case.

If you are using two levels of significance, ensure that the value of the SigLevelLow property is greater than that of the SigLevel property, as it represents a higher probability that the results are due to chance, and therefore a lower level of significance.

To run the test at two significance levels, use the SigLevelLow statistics property to display the lower significance level. For example:

TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevel = 1

TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevelLow = 5

TableDoc.Tables.MyTable.Statistics.ColumnProportions.SigLevelLow = 5

In the resulting table, the IDs of columns that are significant at the higher level appear in upper case, and those that are significant at the lower level appear in lower case.

If you are using two levels of significance, ensure that the value of the SigLevelLow property is greater than that of the SigLevel property, as it represents a higher probability that the results are due to chance, and therefore a lower level of significance.

See also