Permissions & Access

Instructors and administrators in participating course evaluation processes may add customized questions to the evaluation form for any or all courses within their purview of teaching or program oversight. Instructions for this process are available below in detail.

The process for adding custom questions is almost identical for administrators and instructors; the only difference being the scope of access to courses.

School-level administrators determine if the evaluation of their courses will allow for custom questions.

Note to administrators: If you also have access as an instructor, make sure you are logged in to the correct version of your Watermark account. Refer to the top right corner of your screen and toggle between Instructor and Administrator access accordingly.

Adding Custom Questions for Administrators & Instructors

Instructions for this process have been adapted from Watermark Support’s website

The process for adding custom questions to course evaluation forms is carried out through the Watermark system. The process can be broken out into two main steps: creating a new custom survey and attaching a survey to your course(s).

Creating New Custom Questions Surveys

From the homepage in Watermark, in the top banner dropdown button of Custom Questions > Custom Questions Surveys, click on the Create New Survey button. From here, you will land on a new page where you can add a title and description.

Image
Watermark screenshot: Create Survey

Once you’ve added a title and optional description, click Save, and there will be an option to edit survey details along with an option to add a Question. You can either create a new question(s) or choose to select question(s) from an item bank. Note: the LO item bank is not supported in Duke’s process.

Image
Watermark screenshot: Survey Details

If you choose to write your own question, you can do so by using existing question type(s).

Image
Watermark screenshot: Create New Question

Selecting Item Banks to add question(s) will bring you to a new screen. You can search by Item Banks (all selected by default), question types, or keywords from the search filter to narrow your question search. Click here to preview to the Item Bank of questions sorted by category.

Image
Watermark screenshot: Add from Item Banks

Click the check box by the question(s) you want to include on your custom survey, and click on Add Selected Questions located at the top right corner to add the selected questions.

Image
Watermark screenshot: Add from Item Banks
Adding Custom Questions Surveys to Projects

After a Custom Question Survey has been created, clicking on the Project Name (either from the Custom Question Widget on your homepage or Custom Question Projects page) will take you to an overview page of your custom questions and projects.

Image
Watermark screenshot: Survey added confirmation

Clicking on the Add Survey button, you will land on a new page where you can select your survey(s) and then click on Next to choose the destination(s).

Image
Watermark screenshot: Add Survey To Course Evaluation

From here, choose which courses will receive your selected custom question survey. Administrators will be able to select hierarchy levels and/or individual courses in their department or program. Instructors will be able to select from their individual courses. Additionally, you can also view the selections made on the right side panel.

Image
Watermark screenshot: Choose the Destinations

Once you click on Finish & Add, the survey and its destination(s) will be added to the project and will display for the current semester project under Custom Question Projects. From here, you can choose to add more surveys to the project.

Image
Watermark screenshot: Survey added confirmation

If you wish to either preview the selected survey, adjust destinations or remove the survey, click on the options menu (three dots icon) corresponding to your survey and choose the appropriate action.

Image
Watermark screenshot: Editing dropdown options

Note to administrators: Crosslisted offerings are consolidated under the primary offering in this view, meaning that you will only see courses owned by your department.

Custom Question Bank

The following questions are available for the "Item Bank" question type when creating a custom question survey in Watermark.

Expand each topic below to view related questions.

The course effectively accomplished the student learning objectives and overall goals.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

How well did you learn the material in this course?

Not at all, Somewhat, Moderately well, Well, Very well

How much did you learn from this course?

Nothing, A little, A moderate amount, A lot, A great deal

Course materials are organized effectively.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Exams cover important course materials and content.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

I find the course intellectually challenging and stimulating.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

My interest in the subject is increasing as a result of this course.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Reading assignments are of reasonable length and level.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Required texts help or supplement my understanding of the course subject.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course description accurately reflects the content of the course.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The pace at which course material is covered is:

Too fast, Slightly fast, About right, Slightly slow, Too slow

This course gave me confidence to do more advanced work in the subject.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

This course inspired me to consider a career in this field.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

This course was fun or enjoyable.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

What do you think you will remember from this class after you graduate from Duke?

Free response

What from this course do you imagine might be useful in your future career or life in general?

Free response

What made this class difficult?

Free response

The instructor communicates course ideas in an effective manner.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor encourages questions and discussion when appropriate.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor is available outside of class.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor responds to student questions and concerns about course content in a timely fashion.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor’s style of presentation holds my interest during class.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor treats students fairly and impartially.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor utilizes class time effectively.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor acknowledges and credits student contributions during class.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor is invested in my success in the course.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course adhered to the policies (e.g., late assignments, due dates, excused absences) and practices laid out at the beginning of the term.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Grading criteria were explained clearly at the beginning of the course

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course had clearly defined student learning objectives and overall goals.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course had clear expectations for assignments and other work.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

What made the learning objectives unclear or how could the clarity of the overall course goals be improved?

Free response

What made the expectations unclear or how could the clarity of expectations be improved?

Free response

Teamwork/collaborative work contributed to my learning.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Feedback and assessments accurately reflected my contributions to the project.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course structure and assessments ensured that team members contributed approximately equally.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

I was able to honestly and accurately evaluate the contributions of team members.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Graded assignments are returned to me in a timely fashion.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor offers appropriate feedback on student assignments, such as homework, essays, research reports, and other projects.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Feedback on course assessments helped me learn.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Exams/assignments were reasonable assessments of my knowledge of the course material.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The grading in this course was:

Much too hard, Hard, Fair, Easy, Too easy

Required technologies are functional and easy to use.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Technical issues/problems are resolved in a timely manner.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor demonstrates competency in using in-class technology.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor meaningfully incorporates technologies into their lectures.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Lab sessions contributed to mastery of course concepts.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Lab facilities, equipment, supplies, etc. were adequate.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The degree of lab difficulty was appropriate.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Overall, the labs were effective learning experiences.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The labs were clear and well organized.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor clearly articulated the standards of performance.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course (or section) presented skills in a helpful sequence.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course (or section) provided an appropriate balance between instruction and practice.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course (or section) was appropriate for the stated level of the class.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

TA’s ability to raise challenging questions was:

Very poor, Poor, Neither good nor poor, Good, Very good

TA’s ability to help clarify course material was:

Very poor, Poor, Neither good nor poor, Good, Very good

TA’s ability to encourage student participation effectively was:

Very poor, Poor, Neither good nor poor, Good, Very good

TA’s responsiveness to student questions, opinions, and criticisms was:

Very poor, Poor, Neither good nor poor, Good, Very good

TA’s feedback on assignments and examinations was helpful.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

TA created a welcoming and inclusive classroom environment.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course (or section) developed my ability to interact with diverse groups of people.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

This class was open to a variety of different student experiences and perspectives.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Course content was inclusive of diverse perspectives.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Students were open to hearing diverse opinions.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor of this course showed respect for all students in the course.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor of this course encouraged me to respect points of view different from my own.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor was effective in handling multicultural issues and content.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

I became more aware of multiple perspectives on issues of diversity.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor was sensitive to multicultural issues in the classroom.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor promoted meaningful discussions of issues of diversity.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor valued the diversity of life experiences among students.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor saw cultural and personal differences as assets.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The course had a welcoming and inclusive classroom environment.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

How might the class climate be made more inclusive of diverse students?

Free response

How might the course content be more inclusive of diverse groups?

Free response

How might the course materials be more inclusive of diverse groups?

Free response

How might the teaching methods used be made more sensitive to diverse needs?

Free response

What made this class welcoming and inclusive or not welcoming and inclusive?

Free response

Video quality of presentations is good.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Audio quality of presentations is good.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Technology used in the remote aspect of this course works effectively.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Online course materials are easy to use.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

I can readily find readings and other assignments.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Instructions to complete online learning activities are clear.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

The instructor facilitates a sufficient level of online interaction.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

I’m able to interact effectively with the instructor(s).

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

I’m able to interact effectively with fellow students.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

Online interactions with classmates contribute to my understanding of the course content.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

There is a good balance of synchronous and asynchronous instruction in this course.

Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly Agree

In what ways could the course better support your learning.

Free response

Please identify what you consider to be the strengths of the course.

Free response

To what topics or concepts should more attention be given?

Free response

What in the class so far has helped your learning the most?

Free response

What in the class so far has hindered your learning?

Free response

Please list three things you wish you had learned (or learned about) in this course but didn’t and that might be included in the future.

Free response

How would you describe the learning environment of this class? In what ways did the professors and the structure of the course facilitate (or fail to facilitate) your learning? How might you suggest changes for future years (are there things you’d definitely keep/definitely change)?

Free response

How effective were the class lectures? What were the strengths, and what might you change?

Free response

How effective were the seminar meetings? What were the strengths, and what might you change?

Free response

How useful were the projects in relation to what we were learning in class? What were the strengths, and what might you change?

Free response

Would you like to provide any other comments about this course?

Free response

Updated October 2024