Significance Testing

Published Dec 08, 2021

Share this

Toluna Start offers an easy-to-use web-based data visualization and analytics platform that provides access to real-time reporting to analyze results, as data populates in real-time.

One example of a popular analysis technique made easy is the ability to use Significance Testing.

Researchers leverage Significance Testing as a method to express the reliability of survey results. Phrases such as “significantly different,” “margin of error,” and “confidence levels” are often used to help describe and make comparisons when analyzing data. With Toluna Start, the process of applying Significance Testing is simplified, making it easy and quick for all to use.

Significance Testing in Toluna Start

As a pre-requisite, users will need to create either a Category, grouping their Subpopulations, or apply a Crosstab with the audience segments they would like to test for significant differences

From the Analyze dropdown menu users should select Significance Testing

Once selected, a pop-up window of customizable settings will appear.

Here, users can set their test’s Confidence Level (Toluna recommends 95%), Base Size minimum for their test, and choose whether or not they would like their test to Calculate and mark below the minimum, or not.

When finished, click Save.

Next, users should open the question where they would like to apply Significance Testing, click the Statistics icon, and enable by checking the box, and clicking Save.

Once complete, statistically significant differences will appear in the data tables and charts.


Interested in more question types?

Let our team of experts help you add advanced question types to your surveys. Don’t have time to become a survey pro? Enlist our team of experts.

Share this
This site is registered on as a development site. Switch to a production site key to remove this banner.