Qualtrics - Data and Analysis
Modified on: Fri, May 19 2023 9:16 AMGetting Started
- After logging in to Qualtrics, use the three-line icon in the upper left-hand corner to click on 'Projects'.
- Find the survey you are interested in.
- Select the survey you just activated by clicking on its title.
- Click on 'Data and Analysis' towards the top.
Using the 'Data and Analysis' tab, users can filter, classify, merge, clean, and statistically analyze their response data. This can be done using four different sections: data, text iQ, crosstabs, and weighting.
Data Section
Most filtering, classifying, merging, importing, and data cleaning activities take place under the Data section.
- Click on 'Data' under 'Data and Analysis'.
- Users can click on the 'Export and Import' dropdown menu to import responses; to do so click 'Import Data' from the drop-down menu and import a CSV or TSV file. Here users can also manage downloads by clicking on 'Manage Downloads'. Users can export data by clicking on 'Export Data,' selecting the appropriate file format, and clicking 'Download'. From here users can also automate imports and exports.
- Users can edit individual responses by clicking on the field you'd like to change. For multiple-choice questions, a dropdown menu to select from will appear. For text options, you will be able to make modifications directly. This option may be helpful in cases where foul language is used by respondents, and so on.
- Users can review results by looking at 'Recorded Responses' which are complete and 'Responses in Progress' which are incomplete.
- Using the 'Tools' dropdown menu, users can change column layouts.
- Users can also click on the dropdown arrow underneath the actions column for each item to delete responses, view responses, retake responses or export the response as a PDF.
- To sort, hide, and move columns, simply click on the header for each column and select the appropriate choice.
Text iQ
Text iQ allows you to tag text entry responses with topics for analysis.
- If you've never used the Text iQ tool, you will have to update your dataset with Text iQ data. A window will appear titled 'Update Data Set?' Simply select 'update'.
- Users can add topics by clicking on the '+' next to a response and inputting a tag name. When ready, users can select 'Apply Changes'.
- A window will appear titled 'Changes are being applied'. Wait for changes to be completed and click close when ready.
- To make any future edits for specific responses, select the pencil next to the response. Here you can change the tag from those already used or add an entirely new tag.
- In the search box, you can search for tags used. This may be helpful to identify certain responses after tags have already been placed.
- Users can also import topics or tags by clicking on 'import topics'. You can upload a file or look through Qualtrics 'starter packs' database.
Crosstabs
Crosstabs perform multivariate analysis while calculating p-value, Chi-Square, and T-Test stats. Cross tabs are typically used with multiple choice and matrix table questions, but you can also add embedded data to your crosstabs.
- On the side will be a 'variable list' that contains your survey questions, embedded data, survey metadata, and Text analysis results.
- Choose a variable or variables from the variable list and drag it to the 'columns' area to create columns or banners. Usually these are demographic or 'Input' variables like age, income, or gender.
- Choose a variable or variables from the variable list and drag it into the 'rows' area to create rows or stubs. These are ratings or 'output' variables like satisfaction.
- In the 'cells'area, you can choose types of information you want to show up in the table that will be generated.
- On the right-hand side, a table that shows results from the currently selected row variable will appear.
- Users can change variable settings by hovering over the variable to expose the setting icon. Click on the setting icon to bucket the variable into groups, enter recode values, hide values, and so on.
- Significance is determined by adjusting the 'Confidence Level'. Click the button in the upper-right to change the threshold in which differences are considered statistically significant.
- When desired, users can export a table, their current crosstab with stubs, and all crosstabs with all stubs by clicking on the export tab at the top and clicking 'export' to confirm.
- To create an entirely new crosstab, select 'New Crosstab'. You can even do so by creating a copy of your current crosstab.
- By clicking on the settings icon, users can manage analysis settings and import their latest data.
Weighting
Surveys sample larger populations. The Weighting section lets you adjust your sample to account for underrepresented populations.
- If you've never used the weighting section, you'll want to create a new scheme, by clicking on 'Create new scheme'.
- You can then select which weighting method you want to use raked weighting, cell based weighting, or static weighting. Raked Weighting mean you are calculating two (or more) variables independently and displaying them side-by-side. Cell based weighting is non-overlapping. Static weighting is also non-overlapping, but it is distinguished by your ability to specify the weights, or multiplier, that will be applied to each response group.
- Once you have selected a type of weighting, you can enter variables and your target distribution by clicking 'add a variable'.
- When ready, click 'save weights'.