8 Qualtrics Hacks That’ll Make Your Life Easier – Number 6 Will Make Your Day

Advanced question options icon

Researchers live for collecting data. Here at Wharton we use Qualtrics regularly, and our postgraduates are always doing something more complicated than a conjoint analysis or Likert scale. These are some of our favorite Qualtrics hacks that multiply your ability to get a great data set.

The examples below are generalized from real work done by the Research and Analytics team. Please contact us if you need help implementing these methods in Qualtrics. research-programming@wharton.upenn.edu

1. Displaying Text With Embedded Variables

With some simple additions to a survey you can set variables and display different text based on conditions. This can expand different survey conditions quickly and easily.

  1. Go to your survey’s “Survey Flow” page.
  2. Add a “Set Embedded Data” block.
  3. Add an “annual_salary” data variable.
  4. Add a “Randomizer” block below the embedded data block.
    1. Add 3 embedded data blocks under the Randomizer
    2. In each set annual_salary to a different valueA Qualtrics Ranomizer block with three embedded variable blocks below. Each sets annual_salary to a different value.
    3. Set the Randomizer block to randomly present “1” of the elements and check the “evenly” box. More info on evenly presenting.
  5. In the following block add a Text question with the following content.

    You are an executive in the Marketing department of ABC Corp. Your annual salary is ${e://Field/annual_salary}.

  6. You can run the survey multiple times to see the different conditions and corresponding block in the Randomizer.

Further info: Piped Text.

Example survey: Try it here.

2. Branch Group Operations *New*

Presenting a single random condition with variables and different blocks was complicated until Qualtrics recently added the Group block as an option. Now we can get a random condition and do multiple actions within it easily.

  1. Add two new blocks and name them Executive Block and Employee Block.
  2. Add a text description question in the Employee block that says “After your yearly review, you have gotten a raise.”
  3. Add a text description question in the Executive block that says “After your yearly review, you have been promoted.”
    Executive and employee survey blocks with descriptive text.
  4. To the initial embedded data block add the variables “job” and “department”.
  5. In “Survey Flow” in the “Randomizer” section click “Add New Element Here” and select “Group”.
  6. Do this twice more for 3 group elements in the Randomizer.
  7. Drag each salary setting setting block into one of these groups.
  8. In each group add a Block element and choose employee or executive.Adding a survey flow block under the randomizer group.
  9. In each of the groups’ embedded variable blocks set the department and job. Ex. job=graphic designer, department=Marketing.
    Shows each group block of the Randomizer populated with variables and either executive or employee blocks.
  10. Modify the Question after the Randomizer to display the new information.Shows question text with piped variables for each job, department, and annual_salary.
  11. Run the survey and see the different conditions and corresponding block in the Randomizer.

Further info: Grouping Elements.

Example survey: Try it here.

3. Populate Embedded Variables from Survey Links

Recently we had a research project with many different subject groups. We had to track employees and managers, as well as the department in which they worked. Rather than create separate surveys, we utilized the survey link to transfer information about our pool. By sending different links to each employee/department combination we can direct the information a little more closely.

  1. In “Survey Flow” add embedded variables for “employee_status” and “department.” Move this to be first element in the survey flow.
    Shows Qualtrics survey flow with the "Set Embedded Data" element. There are two variables: employee_status and department.
  2. In our example we can add the following to our anonymous survey link “?employee_status=employee&department=sales”. When someone arrives from that link, the values after the equals sign will be stored in that variable.URL bar that reads: https://wharton.qualtrics.com/jfe/form/my_survey_link?employee_status=employee&department=sales
  3. We can then use these values in the survey by adding piped text to our question.Shows Qualtrics question text editor with example text being entered.Shows Piped Text menu. Highlighted is "Embedded Data Field" and under that "department."
  4. When a user takes the survey this question will display their status as an employee or employer and what department they work for.A survey being taken displays the text: "You are an employee in the sales department. Is that correct?"

Further info: Passing Information Through Query Strings.

Example Survey: Try it here.

4. Use Numbers to Select From a Fixed List

We do not always want the participants to see those values in the URL primarily because they can be changed easily. If instead we wanted to just use a simple code number we could. Then with simple JavaScript we can “lookup” the text value from a set. Even without the URL piece, we can generate a random number and give someone text from a quick JavaScript snippet.

  1. Add two more embedded variables “es” and “de” to the initial survey flow element.
  2. Set the values to randomly assign an integer* value.
    1. Choose “Set a Value”
    2. Then “Insert Piped Text”
    3. Then “Random Number”
    4. Integer. Min = 1, Max = 2 for “es”.
    5. Integer. Min = 1, Max = 5 for “de”.Entering a value for random number with piped text.d e text field showing "${rand://int/1:5}"
    6. This method will only work with positive integers and zero, but I prefer to leave zero as the unknown condition and not set it explicitly.
  3. Setting these variables must happen at least one page before they are used. The consent page, since it is at the beginning and seen by all, is a good place to add some simple JavaScript for setting values.
  4. Select the Advanced Question Options (Gear icon) in the consent block.
    Advanced question options icon
  5. Select Add JavaScript.
  6. Add the sample code from here: Sample JavaScript Index LookupsJavaScript entry dialogue showing text pasted from the example link.
  7. Save and test the survey.

For further info see: Add JavaScript.

Example survey: Try it here.

5. Export Flow History

Many surveys contain some branching logic. The simplest example is to place people into a control group or test group. But as your logical branching becomes more complex, it can be hard to track how each participant saw the survey. Enter Flow Ids.

  1. Go to the “Survey Flow” editor.
  2. In the top right corner, check the “Show Flow IDs” box.
  3. Each block in the survey will now show a flow identifier. Ex FL_4Survey flow editor with "Show Flow IDs" checked.
  4. In order to see the order in which a user took the survey you will need to do an additional step before exporting results.
  5. In the “Data & Analysis” tab, click “Export & Import” and then “Export Data”.
  6. In the “Download Data Table” window click “More Options”.Download Data Table window with the More Options button focussed.
  7. Check the box for “Export viewing order data for randomized surveys”.The Export viewing order data for randomized surveys option is checked.

More information: How do I see which randomized block a participant saw?

6. Integrating Web Service Data Into Qualtrics Survey Loop and Merge

If you have access to a web based data service, you can incorporate it into a survey using a few techniques. Check out our guide to learn Loop and Merge, API calls and some Excel trickery to make any data size workable. Included are more informational links and example code.

7. Hidden Fields and Default Values for Linking Back to Source Material

Another method for tracking which data set a user saw would be to actually enter a tracking code into the answer for a question. This value could be something like an identifier for a book review, a tweet id, an ISBN number or other unique code that allows the researcher to match repeated generic questions back to the material viewed. We like to combine a hidden field and default value answer to do this.

  1. In survey flow add an embedded data block and variable called “isbn”.
  2. After the consent block create a new block with Three questions. One descriptive text. One matrix table with two example statements. And lastly one essay answer question with the question text “ISBN number.”A survey showing a three question block. The first is a description of a book, the send is matrix statements about the book, and the third is an ISBN number essay question.
  3. In the ISBN question click the “Advanced Question Options” gear icon.
  4. Click “Add Default Choices”.
    Add default choice option is highlighted.
  5. Through the dropdown menu choose Embedded Data and “isbn”.
    Piped Text dropdown showing isbn highlighted.
  6. In our example we made a trivial way to generate “isbn” with random numbers and Randomizer conditions.
    A randomizer element with two embedded data options to set random isbn number.
  7. View the survey a few times to see how the essay question gets answered by default and with different values. Try it here visible.
    Participants view of the survey with ISBN question showing.
  8. Now, in the question text for the ISBN Number edit the text and switch to HTML view.
  9. Add the following code below the text. *The QID number will depend on your survey. 
    <style>.QID3 { display: none; }</style>
  10. Now when viewing the survey the answers will be recorded but not visible to the participant. Try it here hidden.

8. Embedding YouTube Links or Other Videos

The Research Programming team has done several projects involving video in Qualtrics. We are capable of helping you to embed everything from a single YouTube intro video to randomly serving videos from a library of thousands. We have custom JavaScript modules ready for addition to your survey, but they are a bit more complicated than your normal survey. We are happy to guide you through the process.

 

Conclusion

Wharton Computing is ready to help you with these Qualtrics hacks. Please email us, we would love to help you get the most out of your research.