Custom Questions Guide

Note to administrators: if you also have access as an instructor, make sure you are logged in to the correct version of your Watermark account. Refer to the top right corner of your screen and toggle between Instructor and Administrator access accordingly.

The process for adding custom questions is almost identical for administrators and instructors; the only difference being the scope of access to courses.

Note: School-level administrators determine if a project allows for custom questions.

School-level and department-level administrators may add customized questions to course evaluations for any or all courses within their department or program using the following steps, further detailed below.

Check Access
Preview survey for main questionnaire
Add Custom Survey Questions
Attach Custom Questions to Survey

To skip to a video tutorial, click here.

Access to custom question module

Users will be notified via email when their window to add custom questions is open. To check your current status of access, start on the Watermark Dashboard page (after logging in with NetID and password).
View status of access within Custom Questions widget box on the left. If the window is open, the widget will say "Open for Questions" beside the current open project.

Screenshot of Watermark Custom Question widget with arrow pointing to project name

To start the process, click on the linked project name within the Custom Question widget (see arrow above).

Preview Survey

Click 'View Main Survey for this Project' to see what questions are already in place.

Screenshot of Watermark with button View Main Survey for this Project highlighted

The Custom Question function is managed separately by each user, and does not support collaboration among administrators in the same department or program.

To avoid a duplication of efforts, be sure to communicate a plan for adding custom questions to all administrators and/or instructors in your department or program.

To preview a particular course’s evaluation, including any custom questions that have been added (by you or other users), visit the Manage Courses section and select 'Preview' for a specific course.

Add custom questions survey

To build your own survey, start by clicking 'Create New Survey.'

Screenshot of Watermark with button Create New Survey highlighted

Add a title and optional description (this will just be visible to you), then click 'Save.'
The Question Management box will appear below. Use the 'Add a Question' dropdown menu to choose from
- Create New: author your own question
- From Item Bank: choose from our bank of pre-written questions
- The LO Item Bank Question type connects to another Watermark tool that is not supported by Duke’s process. Please disregard this option.
  
  Image
If creating a new question, you may choose from the following:
- Single selection: Student will pick one of multiple options (best for yes/no or scale questions)
- Multiple selection: Student can check all that apply
- Matrix question: Common response scale with multiple items evaluated on the scale
- Numeric selection question: Allows you to set up a numeric rage from which students can select a number
- Write-In: For written responses or comments
- Label: Can include any text you would like to display on the form to organize, provide instructions, or add a thank you note to the survey
  
  Image

After selecting a question type, click 'Continue'
Select 'Save and Add' in the top right corner to save individual questions
Select 'Done' in the top right corner of your survey when it's completed and ready to attach to courses.

Attach custom questions to the evaluation project for your course(s)

From the Home page, go back into the Custom Question widget with your project name, then select 'Add Custom Question Survey.'

Screenshot of Watermark with button Add Custom Question Survey highlighted

Click the check mark on the far right of your screen for the survey you wish to add, then click 'Select courses.'

Screenshot of Watermark Add Custom Question Survey screen with the Select checkbox highlighted

Here, depending on your permissions, you will see two tabs:
- Select from Hierarchy Levels: this allows you to apply a survey to all courses within your program or department level (Only levels that you have access to will be clickable)
  
  Image
- Select Specific Courses: this will list all courses to which you have access as an administrator or instructor

When adding to specific courses, select 'Add courses'

Screenshot of Watermark Select Courses for Custom Question Survey screen with button Add Courses highlighted

After selecting your desired courses or level(s), click the button 'Add Selected Courses'

Schreenshot of Add Courses screen in Watermark with checkbox and button Add Selected Courses highlighted

To apply your questions, select 'Finish: Save Custom Question Survey'

NOTE TO ADMINISTRATORS: Crosslisted offerings are consolidated under the primary offering in this view, meaning that you will only see courses owned by your department.

After adding a custom question survey to your course(s), you can verify the survey is attached by revisiting the custom question widget from the home page. Here, you will see the title of your survey along with the number of courses to which it is attached. You may click on this number to view the list of individual courses that will receive your custom question survey.

Video Tutorial

This video walks through the process of adding custom questions at the departmental level.

Custom Question Bank

The following questions are available for the "Item Bank" question type when creating a custom question survey in Watermark.

Expand each topic below to view related questions.

Course Content

The course effectively accomplished the student learning objectives and overall goals.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
How well did you learn the material in this course?	Not at all, Somewhat, Moderately well, Well, Very well
How much did you learn from this course?	Nothing, A little, A moderate amount, A lot, A great deal
Course materials are organized effectively.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Exams cover important course materials and content.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
I find the course intellectually challenging and stimulating.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
My interest in the subject is increasing as a result of this course.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Reading assignments are of reasonable length and level.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Required texts help or supplement my understanding of the course subject.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course description accurately reflects the content of the course.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The pace at which course material is covered is:	Too fast, Slightly fast, About right, Slightly slow, Too slow
This course gave me confidence to do more advanced work in the subject.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
This course inspired me to consider a career in this field.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
This course was fun or enjoyable.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
What do you think you will remember from this class after you graduate from Duke?	Free response
What from this course do you imagine might be useful in your future career or life in general?	Free response
What made this class difficult?	Free response

Feedback on Instruction

The instructor communicates course ideas in an effective manner.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor encourages questions and discussion when appropriate.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor is available outside of class.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor responds to student questions and concerns about course content in a timely fashion.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor’s style of presentation holds my interest during class.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor treats students fairly and impartially.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor utilizes class time effectively.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor acknowledges and credits student contributions during class.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor is invested in my success in the course.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Course Policies

The course adhered to the policies (e.g., late assignments, due dates, excused absences) and practices laid out at the beginning of the term.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Grading criteria were explained clearly at the beginning of the course	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course had clearly defined student learning objectives and overall goals.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course had clear expectations for assignments and other work.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
What made the learning objectives unclear or how could the clarity of the overall course goals be improved?	Free response
What made the expectations unclear or how could the clarity of expectations be improved?	Free response

Teamwork & Collaboration

Teamwork/collaborative work contributed to my learning.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Feedback and assessments accurately reflected my contributions to the project.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course structure and assessments ensured that team members contributed approximately equally.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
I was able to honestly and accurately evaluate the contributions of team members.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Student Feedback

Graded assignments are returned to me in a timely fashion.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor offers appropriate feedback on student assignments, such as homework, essays, research reports, and other projects.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Feedback on course assessments helped me learn.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Exams/assignments were reasonable assessments of my knowledge of the course material.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The grading in this course was:	Much too hard, Hard, Fair, Easy, Too easy

Technology

Required technologies are functional and easy to use.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Technical issues/problems are resolved in a timely manner.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor demonstrates competency in using in-class technology.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor meaningfully incorporates technologies into their lectures.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Labs

Lab sessions contributed to mastery of course concepts.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Lab facilities, equipment, supplies, etc. were adequate.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The degree of lab difficulty was appropriate.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Overall, the labs were effective learning experiences.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The labs were clear and well organized.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Artistic Performance & Production

The instructor clearly articulated the standards of performance.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course (or section) presented skills in a helpful sequence.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course (or section) provided an appropriate balance between instruction and practice.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course (or section) was appropriate for the stated level of the class.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

TAs

TA’s ability to raise challenging questions was:	Very poor, Poor, Neither good nor poor, Good, Very good
TA’s ability to help clarify course material was:	Very poor, Poor, Neither good nor poor, Good, Very good
TA’s ability to encourage student participation effectively was:	Very poor, Poor, Neither good nor poor, Good, Very good
TA’s responsiveness to student questions, opinions, and criticisms was:	Very poor, Poor, Neither good nor poor, Good, Very good
TA’s feedback on assignments and examinations was helpful.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
TA created a welcoming and inclusive classroom environment.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Equity & Inclusion

The course (or section) developed my ability to interact with diverse groups of people.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
This class was open to a variety of different student experiences and perspectives.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Course content was inclusive of diverse perspectives.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Students were open to hearing diverse opinions.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor of this course showed respect for all students in the course.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor of this course encouraged me to respect points of view different from my own.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor was effective in handling multicultural issues and content.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
I became more aware of multiple perspectives on issues of diversity.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor was sensitive to multicultural issues in the classroom.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor promoted meaningful discussions of issues of diversity.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor valued the diversity of life experiences among students.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor saw cultural and personal differences as assets.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The course had a welcoming and inclusive classroom environment.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
How might the class climate be made more inclusive of diverse students?	Free response
How might the course content be more inclusive of diverse groups?	Free response
How might the course materials be more inclusive of diverse groups?	Free response
How might the teaching methods used be made more sensitive to diverse needs?	Free response
What made this class welcoming and inclusive or not welcoming and inclusive?	Free response

Remote/Hybrid Learning

Video quality of presentations is good.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Audio quality of presentations is good.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Technology used in the remote aspect of this course works effectively.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Online course materials are easy to use.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
I can readily find readings and other assignments.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Instructions to complete online learning activities are clear.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
The instructor facilitates a sufficient level of online interaction.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
I’m able to interact effectively with the instructor(s).	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
I’m able to interact effectively with fellow students.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
Online interactions with classmates contribute to my understanding of the course content.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree
There is a good balance of synchronous and asynchronous instruction in this course.	Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Open-Ended Items

In what ways could the course better support your learning.	Free response
Please identify what you consider to be the strengths of the course.	Free response
To what topics or concepts should more attention be given?	Free response
What in the class so far has helped your learning the most?	Free response
What in the class so far has hindered your learning?	Free response
Please list three things you wish you had learned (or learned about) in this course but didn’t and that might be included in the future.	Free response
How would you describe the learning environment of this class? In what ways did the professors and the structure of the course facilitate (or fail to facilitate) your learning? How might you suggest changes for future years (are there things you’d definitely keep/definitely change)?	Free response
How effective were the class lectures? What were the strengths, and what might you change?	Free response
How effective were the seminar meetings? What were the strengths, and what might you change?	Free response
How useful were the projects in relation to what we were learning in class? What were the strengths, and what might you change?	Free response
Would you like to provide any other comments about this course?	Free response

Updated October 2023