Showing posts with label Assessment. Show all posts
Showing posts with label Assessment. Show all posts

Thursday

Rubric for online discussions

Example of a Rubric for online discussions; the assignment values 10 points

NOTE: If there is no participation for the first two weeks then will fail class

Criteria
/
Points

Demonstrates an excellent understanding of key concepts; presents proof of critical thinking, ability of application, and evaluation of the theory; has personal reflection and comments to other postings; contributes in a timely and relevant manner; exceeds minimum number of required postings; writes clearly and logically
8-10


Demonstrates an average understanding of most key concepts, rarely has proof of critical thinking and application of the theory to practice; mostly shows agreement with other postings; does not bring consistent personal performance; generally contributes in a timely and relevant manner; meets minimum number of postings; generally writes clearly and logically
5-7


Demonstrates limited understanding of key concepts; contributes in a sporadic manner; short and rushed postings; only agrees or disagrees, does not contribute with personal reflection and comments; does not show critical thinking, and has no proof of examples for application of theory to practice. Has only the number of minimum required postings.
2-4


Demonstrates weak or no understanding of key concepts; Rarely participates freely; mostly “just to do the job” postings; short and irrelevant remarks. There is no proof of understanding the application of theory to practice.
Less than 2

Rubric for article critique

Writing a very simple and easy to use Rubric for Article Critique

Criteria

Each of the below listed six criteria will be evaluated on a three-point Likert scale, see below the Note on how to consider the points resulted:

1= Poor
2= Good
3= Excellent


List of criteria for evaluation:

1. Pertinent presentation of article.

2. Presentation is grounded in the academic literature (use of extra reference).

3. Comprehensively addresses the topic, reflecting on the theory and results presented by authors.

4. Shows personal reflection on the theory presented in the article

4. Includes descriptions, details, and examples of alternative ideas; and reason behind them

5. Shows the application to real life setting; brings in new ideas for future research

6. Written well (scholar expressions, grammar, spelling, and punctuation), APA format.


Note:
20 points = 5 excellent
18 points = 4 excellent + 1 good
16 points = 3 excellent + 2 good
14 points = 2 excellent + 3 good
12 points = 1 excellent + 4 good
10 points = 5 good
failed if less than 4 good

How to build a rubric

DEVELOPING A RUBRIC

Questions to ask when developing a rubric:
1. What criteria must be present in student work to be able to qualify it as high quality?
2. How many levels of achievement should be present?
3. What is a clear description for each level of quality?
4. What are the consequences of performing at each level?
5. What grading scheme will be used in the rubric?
6. What aspects of the rubric are good and bad; and how to improve the rubric?
7. Is the product more important than the process; or are they valued as equal?



Different ways of starting:

- collect student work and try to score it using your existent rubric; pay attention to and details and questions might arise and use them to perfect your rubric
- collect student work and sort them in different groups based by quality, then describe the features of each sorted level. Write specific details for each performance level. Think about different grading levels when placing the student work into different groups, this will make a link between your rubric and grading.
- list all particular details of a performance that you are interested to know about. The most important dimensions of performance will form your rubric’s traits (thus analytical rubric will be developed)
- read what other experts know about the skills and the different levels of performance you want to consider. Search for other rubrics that describe the same skills or performance. Compare that with your rubric traits. Write a clear and neutral definition for each trait. Neutral definitions describe the trait and do not label good or poor performance.
- Find multiple examples for each of the different levels of your rubric
METARUBRIC


To evaluate your rubric you have to consider each of the following features of your rubric:

1. Content (coverage) – tells students what they need in order to succeed for the respective assignment. The rubric content should cover ALL that is essential and leave out details that will not be graded. Leave space to your students to present the content in different modalities if the modality of presentation does not have to follow a very specific pattern, otherwise everyone will try to fit a certain pattern that you cover in the rubric.
2. Clarity (detail) – a rubric must describe in enough detail the dimensions of performance that two raters understand the rubric in the same way and would evaluate the same way a certain performance/product. It is always good to have samples of student work for each level. Avoid just listing categories of evaluation without giving a definition of the category. Explain what each level means so that if two raters use your rubric to evaluate the same product/performance they should rate the same way.
3. Usability – a rubric must be practical, so that a scored/graded performance will be reflection of the rubric traits (so, that the student will not question “why?” the performance/product resulted in a certain score). The rubric needs to help students be successful, and understand what is necessary to correct if they do not do well.
4. Technical quality – your rubric must be fair to all students (language level used in the rubric, and ESL students). The rubric must have a good reliability - If two raters use the rubric to rate the same work they should assign pretty close scores; raters should be in agreement.



GRADING WITH RUBRICS

1. Rubrics are used in order to show students what are the criteria, expected standards that we use for grading and assessment.

2. Rubrics help also to inform students about different degrees (levels) of performance (e.g., poor, good, excellent); in consequence students will be able to self-evaluate themselves and prepare for the assessment.

3. Rubrics are models of standard for students. In developing a rubric students can be asked to participate set the criteria and describe different levels, then the teacher can use the suggestions gathered from students.

4. Rubrics are useful in the process of assessment when using different graders, or when it is needed a panel of assessors, in order to control for grader differences.


Use of rubrics in grading

- Decide ahead of time how many scale points will meet your needs for best performance
- Decide how many traits (specific dimensions) you want to measure, what are the important dimensions of the performance/product that the rubric will measure
- It is not advised to use strict percentages to convert scores from each particular assessment into letter grades; a better choice is to tell the students that all assignments will be scored on one or more traits and points will be cumulated (or if you count only the final performance then only the last performance in the semester should be transformed into letter grades).

o Example:
- on a rubric that uses scores on a scale 1-5, a “3” is described as average (B). However, when the obtained score is divided by the total possible score (3/5), the percentage obtained (60%), often would represent a failing score (F)

- Try to come up with a logic rule to convert scores/points to letter grade instead of using percentages.

Example1:
- taking into consideration obtained scores on a series of assignments;
- At least 40% scores of 5, and no more than 10% scores lower than 4 = A
- At least 10% scores of 5, and no more than 30% scores lower than 4 = B
- At least 20% scores higher than 4, and no more than 10% lower than 3 = C
- At least 10% scores higher than 4, and no more than 30% lower than 3 = D
- Anything lower than the above = F



Example 2:

- add all points from a series of assignments then use a logical formula to transform the total points into letter grades:
91-100 =A; 81-90 = B; 71-80 = C; 61-70= D; below 69 =F.

Rubrics

Rubrics are explicit grids, schemas, lists, to evaluate and clasify products of learning outcomes into different categories that vary across a given continuum.

Rubrics are very handy to use in measuring student learning given some specific learning outcomes.

There are different ways to build a rubric, often the building process takes some thought and time, but the rubric gives a clear picture to the student and instructor about the level of performance expected for a certain task.

The title above has a link or you can find the information below and in the other link on Rubrics.


Rubrics defined

Rubrics = criteria that cover the essence of a performance that is judged with them.

The use of rubrics help define the expected performance, standards of quality, levels of accomplishment, also they are helpful in diagnostic assessment and providing feedback to students.


Holistic vs. Analytical

Holistic rubric = gives a single score or rating for an entire product or performance based on overall impression of a student’s work.
The rater considers all quality judgment in a big component and overall judgment and comes up with one single score.

Example:

Excellent level:
- Student shows complete understanding of the tasks and concepts
- Clear identification of key concepts and important elements
- Excellent writing style
- Pertinent insight and demonstration of appropriate application of main ideas

Good level:
- understanding of most critical concepts
- shows identification of some key concepts but most of the parts are missing
- adequate writing style with minor errors, some limited clarity in expressions
- scarce demonstration of application of main ideas

Poor level:
- misunderstanding of majority of concepts or no understanding of concepts and processes
- irrelevant or illegible response that has no relation to the key concepts
- unsuccessful attempt to communicate
- lack of demonstration in application of main ideas


Holistic rubrics are suited for the following:
- judging simple products or performances
- getting a quick snapshot of overall quality or achievement; often used when a large number of students are graded
- judging the impact of a product or performance more than the specific detailed parts of the performance.

Disadvantages:
There is no detailed analysis of the strengths and weaknesses of the performance/product; so it is not useful as diagnostic or to give students detailed feedback on their performance and help them improve their performance.


Analytical rubric = divides a product into essential dimensions (traits) and each dimension is judged separately. A separate score is given for each dimension/trait considered important for the assessed performance.
Scoring of each trait can be done by using a Likert scale (e.g., 1 to 5 where 1 is poor quality, 3 is average, and 5 is excellent quality).


Example (Six-trait writing analytical rubric):

Each of the following traits is scored separately on a scale of 1 to 5:
Ideas: the main idea of the assignment, content ideas, main theme, details in the theme

Organization: the internal structure of the individual, the core and central meaning, logical and creative pattern of ideas

Voice: the feeling and beliefs of the individual come through the words

Words choice: rich, precise, scholar, and eloquent language that enlightens the reader

Sentence fluency: the rhythm and flow of the language, the words patterns, the way the writing plays to the ear

Conventions: the mechanical correctness of the work as an entire piece, along with grammar and usage of words (spelling, capitals, punctuation).


Analytical rubric are suited for the following:

- judging complex performances that involve multiple dimensions (skills that must be assessed). Each step in the rubric can be designed to measure one specific trait.
- Provide more specific information and feedback to students about their strengths and weaknesses.
- Can be used to target instruction to specific areas in need for improvement.
- Analytical rubrics help students come to a better understanding about the nature and quality of work they must perform.

Disadvantage:
- more time consuming to craft and use in grading
- lower inter-rater agreement because of the detailed and many traits
- less desirable in large scale assessment context when many students must be graded and when speed in grading is essential



General vs. Specific rubrics

General (generic) rubrics = can be used across similar performances (e.g., all Blackboard postings across a semester; all group interactions in the semester).

- you construct one rubric and use it for similar tasks
- sometimes the tasks are so similar that there is no reason to construct a detailed rubric for each
- when grading portfolios or any collection of different assignments that must be graded overall; where developing a rubric for each piece would be time consuming and not important
- help students understand the big picture and when students need to be able to apply what they learned in one task to the next task
- when the product is more important for assessment purposes than the process/steps of that performance
- when the students must come up with general ideas and when they must think in order to develop particularized performance
- when there are many different possibilities to solve a problem or there are many ways for a successful performance



Task-specific rubrics
= each rubric can be used only for a particular task/assignment (e.g., rubric for the Final exam,; rubric for a project proposal).

- it is easier and more consistent to get fast scoring. Easier to train the scorers
- if you want to know if students are able to perform specific methods and procedures

There are times when the best rubric is a combination of generic and task-specific rubric traits.
For example when you are interested if the students know how to develop specific parts/steps in a project proposal but in the same time you are interested in the overall quality of writing.


Number of score points for rubrics


- A good range to evaluate the performance
- Enough points to evaluate different levels of quality
- Does your rubric need to fit a particular standard? Use the same amount of points.
- Tracking changes over a longer period of time requires more points than limited/shorter time
- Have a good reason to pick odd or even number of points: odd number gives the tendency to gravitate to the mean to a more neutral assessment; but if your goal is to delimitate the average then odd number of points is the best choice.
- 1-5 point scale is similar to A-F grading, at times students confuse points with grades







Reference:

Arter, J. & McTighe, J. (2001). Scoring rubrics in the classroom. Thousand Oaks, CA: Corwin.

Brennan, R. L. (Ed.) (2006). Educational measurement (4th Ed.). NCME. Westport, CT: Praeger.

Earl, L. M. (2003). Assessment as learning. Thousand Oaks, CA: Corwin.

Huba, M. E. (2000). Learner-centered assessment on college campuses. Boston, MA: Allyn & Bacon.

Formative Assessment Techniques

Several short assessment techniques listed below can be very well used as formative assessment (that is, to only check how your students understand the topics you taught). However they can also be used as short measurements that will have some weight attached and be part of student grade in a specific course. Of course you would have to modify them a bit so you are able to collect and give grades. A good idea is to randomly give grades. For example ask the entire class to complete the short assignment and then randomly collect/ask some responses and grade them. This makes all students in the class to fully participate in the activity. One owrd of caution: Please let your students know by listing tyhis rule in the syllabus, and always be fair in grading and collecting the results of this short assessment (e.g., you can use random sections if you have a very large course; use lists of student name by letetr of last name). Might give you more work than a regular test day of all students in class, but the advantage is that you will have students involved in classroom work.

- Associational brainstorming – very good method to start a class or introduce a new topic/concept. Invite students to brainstorm everything it comes to mind related to the concept or word that represents a new topic. Encourage students to list Cognitive and Affective relations that come to their mind. Make sure you record all ideas – everything is good without any judgmental comment, let them do free association. Use a slide or overhead to collect all ideas. Then try to group the recorded ideas and ask students to come up with further groupings and reasons for the groups, and ask them to name the categories. Ask students to analyze the collected responses and identify themes, categories, connections, and patterns.

- Evocative visuals or textual passages – Good method to start the course, or a new topic. Start out with a picture, painting, or a video clip, or choose a powerful text passage, a chart, a graph that represents a content that you will teach. Ask the students to brainstorm their analysis of the presented. Ask questions to start the discussion: “What do you see?” “What is going on?” “What does it mean to you?” “What do you think it this?” “Why do you think I showed this to you?” “How do you think this relates to what you are studying in this class?” Use pairs or small groups (students seated in proximity) to let students share their representations then regroup as an class and ask them to comment. Several different ideas will arise. Provide support and challenge, model your way of thinking about the presented. Easily direct the flow of though toward the concept/topic you will teach next.

- Debates – good method to exemplify different ways of solving/ thinking about a problem, as well as to demonstrate higher order thinking and problem solving skills. The way students are seated divide the class in several areas (possibly as many ways of seeing a problem can be). Ask the large groups to think from the different perspectives and come up with arguments to defend that way of thinking. Give students 5 minutes to discuss in pairs or proximity seating small groups then call the class to regroup and ask the different parts to volunteer with examples of their way of thinking. If you use this to debate pro –con topic then is good at least to have a third group who must not take any side and come up with reasons why they would abstain to be for or against.

- Role-playing – very good method for History, Literature, or Biochemistry classes. Divide the class into as many sections as you need to have for role playing. Ask them to prepare their arguments or plan their behavior representing the role they play (different characters of a play, different groups in history, different enzymes that could react and form new ones). Give examples of content and then ask student to discuss shortly in pairs or small groups how would their role react. Then ask as an entire class to have representative descriptions from each section. Draw attention to consequences of possibly unplanned behavior descriptions and compare with the reality of the lecture you teach.

- Mini-Cases – can be used as a start up for a lecture or spread in between to spice up the tempo of the longer lectures and help students better understand by using a specific example. Students can be asked to pair up or form small groups turning around to colleagues seated in proximity. One group presents the case to the entire class then pairs/ small groups work for several minutes to find responses by directly applying the content to the case example.

- Think-pair-share – Ask a question to interrupt the lecture after approx 15-20 minutes, ask student to write down the response to the question, then turn to the next neighbor and discuss the responses. No more than 5 minutes (depends on the complexity of the question); then ask several pairs to share their responses and conclude with a correct response and move to the next topic in the lecture

- Minute paper – is a very powerful way to assess the degree students understand the topics and concepts they studied in the respective class period. Can be used 20 minutes in the lecture or at the end of the class. The task should not take more than 5 minutes maximum of class time. If it is used in the middle of the lecture then some questions might be: “Explain shortly the main concept discussed in this part of the lecture,” “Give an example of this concept or principle,” “How could this concept apply to…” a possible next topic in the same lecture, “How does this idea relate to your experience with…?” used at the end of the class period the One minute paper questions are: “1. What are the most important things you learned in today’s lecture? 2. What is the question on today’s topic that remains in your mind after this lecture?” Collect the responses – this is also a good way to take attendance if you request names (however names might affect honest statements of questions from students). The collected can form a basis for next class starting 5 minutes. Possibly you need to revise a concept, give some examples, or clarify some topics. Also you can use it as a basis to give good examples.

- Pause procedure – ask student in pair or group with 2-3 other students seated in proximity to compare notes or results from a short exercise in class. Allow 2-3 minutes and ask what questions if any arose from their review.

- Formative quizzes – quizzes that are not graded, can be used to evaluate how students understood a certain topic. Use similar questions as they will be on the exam. Use a power point slide or overheads to post the question. Responses can be shown by raising of hands. Clickers can be handy for this type of activity, unless you have a group larger than 150 where the time to get in the results from clickers takes longer than solving the problem (clickers for very large classes are not efficient).

NFL Game-- template

NFL game


Think about what you learned in this class and respond shortly to the questions below:
List what is the New concept you learned:

__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________



The concept you feel comfortable on teaching your Friend:

__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________



Which topic you need to do more Learning:


__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________



Developed by Dr. Zsuzsanna Szabo
---I developed this game in a summer course when my students were too focused on NFL. Just playing with words but my students said this is the best assessment so far to raise their awareness in preparation for a final exam. Can be used as a end of class/topic/semester tool as well
:-)

One word chapter -- template

One Word Chapter


After reading the assigned text, write below one word that captures the essence of what you’ve read and summarizes your response to it.


_________________________________
(One word summary)

Below explain shortly why you chose the word above and how it provides your summary of the reading:


__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________
__________________________________________________

Door pass -- template

DOOR PASS


Name_____________________________________


Write three facts or your reflection on facts you learned this class:

1.__________________________________________________________________


2.__________________________________________________________________


3.__________________________________________________________________


Do you have ONE question related to the content we learned this class period that you would like to ask your teacher?
Ask it:

______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

Assessment

When planning for Assessment the instructor needs to think if the assessment used in the course is a measure that brings evidence that responds to three fundamental questions:

· What will students know?

· What will students be able to do?

· What will students value?



These questions are correlated below with the three familiar “domains” of learning—

cognitive, affective and psychomotor-- developed through the work of Bloom (1956),

Krathwohl (1961), Doll (1996), Gagne (1985; 1992), Shulman (2002) and others.



What will students know?

These outcomes are all cognitive, and include content knowledge (e.g., the ability to recall

verbal information) and understanding. Factual knowledge that will be remembered, understood, and that the student will be able to apply and use in responding content related questions and use the factual information in problem solving.



What will students be able to do?

These outcomes can be both cognitive (problem-solving, analysis, evaluation, creative thinking, etc.) and psychomotor (physical). Although many physical skills develop exclusively in the realm of co-curricular activities (e.g., athletics and recreation), the psychomotor domain includes important academic outcomes in the performing arts (theater, dance, music), the fine arts (painting, drawing, sculpture), laboratory skills (dissection, etc.), fieldwork (natural sciences), construction of models in engineering, design and implementation of knowledge, speaking a foreign language, and certain computer skills.



What will students value?

These outcomes are affective, dealing with emotions, attitudes and values.

Experience with the highest order cognitive skills (reflecting on experiences; exercising critical judgment in real world situations with competing goals and incomplete information; designing something within multiple constraints--economic, usability, safety, etc.) reinforces the internalization of values in the affective realm.

Tuesday

Levels to collect learning outcomes

Learning outcomes assessment


1. Identification of student Learning Outcomes
2. Examination of opportunities to achieve learning outcomes in the program/course
3. Assessing student learning and development (gather student work exemplar)
4. Use Learning Outcomes Assessment to make changes in the course/program and close the assessment cycle by repeating the steps. (Attached is a template to complete for evaluating how Learning Outcomes function for course purposes; as well as a Program evaluation template).


LEVELS TO COLLECT LEARNING OUTCOMES ASSESSMENT

Level 1:
- Design and structure the program and course
- Write the program mission and matching learning outcomes
- Specify the courses in the program that map onto the learning outcomes
- Create syllabus for each course
- Create assessment for each course (quiz, homework, exams, rubrics to be used)
- Specify teaching strategies used in the course
- Decide on faculty peer review observations, and GIFT, and collect data
- Collect data and analyze graduation rates, and student exit survey data
- Analyze placement rates
- Analyze GPA
- Other



Level 2:
- Collect and analyze data concerning student perception of learning, IDEA, SGID
- Analyze summative survey of student perception of learning and achievement of learning outcomes set for the course



Level 3:
- Direct assessment of student work
- Assessment used in the course (exam, quiz, project, portfolio, homework, etc.)
- Formative and summative evidence of learning

Action verbs to LO

How to Write Student Learning Outcomes

Action Verb List – Suggested Verbs to Use in Each Level of Thinking Skills of Bloom taxonomy
Below are a collection terms (verbs) that can be used when creating student learning outcomes for a course or degree program.

Remember

Count
Define
Describe
Draw
Identify
Labels
List
Match
Name
Outline
Point
Quote
Read
Recall
Recite
Recognize
Record
Repeat
Reproduce
Select
State
Tell
Write


Understand

Associate
Clarify
Classify
Compare
Compute
Conclude
Convert
Defend
Determine
Discuss
Distinguish
Estimate
Exemplify
Explain
Extend
Extrapolate
Generalize
Give examples
Infer
Instantiate
Illustrate
Interpret
Order
Organize Paraphrase
Predict
Represent
Rewrite
Summarize
Translate

Apply

Add
Apply
Calculate
Carry out
Categorize Change
Classify
Complete
Combine
Compile Compute
Demonstrate
Divide
Examine
Execute
Explain
Graph
Group Implement
Integrate Interpolate
Manipulate
Modify
Operate
Prepare
Prove
Rearrange
Reconstruct
Relate
Reorganize Show
Solve
Subtract
Translate
Use



Analyze

Analyze
Arrange
Attribute
Breakdown
Combine
Compare
Contrast
Design
Detect
Develop
Deconstruct
Diagram
Differentiate
Discriminate
Distinguish
Focus
Find coherence
Illustrate
Infer
Integrate
Map
Organize
Outline
Prescribe
Propose
Point out
Relate
Select
Separate
Specify
Structure
Subdivide
Transform Utilize



Evaluate

Appraise
Assess
Check
Compare
Conclude
Contrast
Correct
Critique
Debate
Detect
Determine
Evaluate
Grade
Interpret
Judge
Justify
Measure
Monitor
Order
Rank
Rate
Revise
Rewrite
Score
Support
Test


Create

Compose
Construct
Create
Design
Derive
Develop
Devise
Discover
Generate
Expand
Explore
Hypothesize
Initiate
Innovate
Invent
Plan
Produce
Propose
Transform


• Adapted based on:
Anderson. L.W. (Ed.), Krathwohl, D. R. (Ed.), Airsian, P.W., Cruikshank, K.A., Mayer, R.E., Pintrich, P.R., Raths, T., & Wittrock, M.C. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s Taxonomy of Educational Objectives. Boston: Allyn & Bacon

Writing learning outcomes

Writing learning outcomes for course planning and syllabus preparation


A syllabus is a planning tool for course purposes.

It helps the instructor to organize the course, define goals and student learning outcomes, and plan the course assessment and the calendar.

The syllabus is also a guide for the students who take the respective course. It should communicate in a clear and detailed manner the course content, teaching approaches, requirements, and expectations in the course. Since the syllabus is a document that communicates with a larger audience (colleagues, administrators, accreditation agencies) it is also a reference guide.

In the process of planning the course and building the syllabus the instructor must decide which topics will be covered in the course, and for each what is the expected learning level that will be demonstrated by the students. Based on that decision the instructor will plan appropriate assessment measures. The purpose is to have a good balance of learning outcomes adequate to the importance of the different topics taught by the instructor. The instructor is the one who decides on which topic students should demonstrate a higher levels of thinking and the instructor would plan accordingly the appropriate assessment measure for the respective levels.

A very useful tool in planning for expected levels of teaching, learning, and assessment is the table of Bloom’s taxonomy. Bloom’s taxonomy gives a useful guide to map out the instructor’s plans for the course and provides an easy way to think about appropriate assessment tools. Bloom’s revised taxonomy defines learning as a two dimensional process: cognitive and knowledge based. This takes into account the learners’ thinking and knowledge based abilities.
Bloom classified the cognitive skills in six levels from lower (remembering, understanding, and lower level of applying) to higher levels of thinking (applying, analyzing, evaluating, and creating).

When planning activities and assessment for course purposes the first step the instructor would take is to map out each topic studied in the course at the desired level of thinking and knowledge. Then the next step the instructor would derive the learning outcomes and matching assessment type for each topic.

Look in the postings for more information on how to plan for assessment measures for a course taking in consideration Learning Outcomes. The material will take you step by step and guide you to develop Learning Outcomes using Bloom's taxonomy.

Objectives vs. Outcomes

Course objectives vs. student learning outcomes


Objectives

* Objectives represent valuable skills, tools, or content that enable a student to engage a particular subject.

* What are the goals and intentions of the faculty who teaches the course

* Objectives focus on content and skills important within the classroom or program: what the staff and faculty will do. Often termed the input in the course. Purpose and goals of the course.

* Objectives can often be numerous, specific, and detailed. Assessing and reporting on each objective for each student may be impossible.


Outcomes

* Student Learning Outcomes represent overarching products of the course. Measurable results of student learning.

* Outcomes express higher level thinking skills that integrate the content and activities and can be observed as a behavior, skill, or discrete useable knowledge upon completing the class. What exactly the assessment measures show that the student is able to do upon completing the course.

* An assessable outcome is an end product that can be displayed or observed and evaluated against criteria.

* The outcomes are clear and measurable criteria for guiding the teaching, learning, and assessment process in the course

Thinking about Learning outcomes

Questions to ask before starting writing learning outcomes:
- What will my students know?
- What will the students be able to do with their knowledge at the end of the course?
- What are the students beliefs, opinions, and attitudes
(measurable domains of learning on different domains: cognitive, behavioral, and values)

A well-designed course assessment will provide feedback on the important intended learning outcomes. The feedback students receive from assessments should deal directly with the learning to be acquired. Assessment results in feedback that learners can use not only to know how they are doing, but also to provide them with information in order to improve their performance.
Using learning outcomes will provide information on what students are expected to achieve at the end of the course, and after each class period. The intended outcomes of a course should be always be included in course syllabi at the beginning of the course.



Formulating effective statements of intended learning outcomes

Characteristics of effective learning outcomes statements:
- Are student-focused rather than professor –focused
- Focus on the learning resulting from the activity rather than on the activity itself
- Reflect the program, school, and institution mission
- Are in alignment at the course, program, department, school, and institutional levels
- Focus on important aspects of learning
- Focus on skills and abilities central to the discipline and based on professional standards of excellence
- Are general enough to capture important learning skills, but specific enough to be measurable
- Focus on aspects of learning that provide lifelong learning skills but that can be assessed in some form now


Several examples from different domains:

“Students will
- organize ideas in a way that increases the effectiveness of a message
- work effectively in problem-solving teams
- develop an erosion control policy based on plant, soil, water, and climate principles
- be able to communicate their message to others in written, verbal, and artistic medium
- reason using simplified economic models such as supply and demand, marginal analysis, benefit-cost analysis, and comparative advantage
- be able to design and conduct original and independent biological research
- as team members will reveal their commitment to the team through effective use of group problem-solving techniques

Note:
The learning outcomes should focus on the learning resulting from an activity not on the activity itself!
Learning outcomes should focus on important aspects of learning that are credible and valuable to the discipline and field.



Learning outcomes that promote lifelong learning:

1. complex thinking standards: students ability to use various reasoning strategies to deal with situations
2. information processing: information-gathering techniques, interpreting and analyzing, assessing the information, interpreting and synthesizing
3. effective communication with diverse audiences in a variety of ways for different purposes
4. collaboration and cooperation to complete an effective performance in group situations, using interpersonal skills
5. habits of mind: students’ ability to control their own thought process and behavior including self-regulation, critical thinking, and creative thinking



Learning outcomes in practice

1. Writing measurable objectives for learning outcomes: the planned goals of a course, materialized in knowledge, skills, and competencies that students are expected to exhibit upon successful completion of a course
2. Writing learning outcomes assessment measures in order to measure what is the level of knowledge, skills, and competencies the students master in the time of learning for the respective course (assignments, testing)
3. Documentation of learning outcomes results – a comparison of outcomes and objectives, that will be the base for further changes in the education process

Resources:
Huba, E. M., & Freed, J. E. (2000). Learner-Centered assessment on college campuses. Needham Heights, MA: Allyn & Bacon

Intro on Learning Outcomes

Learning Outcomes are measurable statements reflecting students' skills, competencies, and knowledge that any student will demonstrate upon successfully completing a course.
When writing learning Outcomes you must keep in mind the following important parts:

1. The student is the "Subject" of your statement (talk about the student, not about the content or what your students will learn if you use certain teaching methods).

2. The learning statement represents the content, skill, action that students demonstrate (The emphasis is on the student's skills not on the course content, or the teaching methods used by the instructor).

3. The statement should be measurable (that is, you should use action verbs that have a concrete measure).
Major questions as guideline to evaluate
student learning outcomes


1. Are the students meeting the course’s benchmarks or student learning outcomes?
a. Are the students learning outcomes written clear and measurable?
b. Does the course assess student learning adequately?
c. Is the assessment aligned with the course outcomes objectives?
d. What changes have been made in the course as a result of assessment?
e. Are the changes appropriate to reflect continuous improvement?

2. Does the course support student learning outcomes?
a. Is the course based on a solid core of knowledge at all levels of thinking (one taxonomy that could be used is Bloom’s taxonomy revised: Remembering, Understanding, Applying, Analysing, Evaluating and Creating) that supports the learning experience for students?
b. Is the course content based on rigor to immerse students in the discipline as applied to real life?
c. Does the course provide appropriate opportunity for students to apply their knowledge and skills? (projects, lab, field trip, internship, etc.).

3. Does the environment support student learning?
a. Is there enough institutional support for the learning environment?
b. Does the course provide adequate mentoring and advising for students?
c. Does the program set a standard of excellence, with clear outcome objectives?
d. Is there a description of evidence of learning outcomes and program improvement?

NFL --- template

NFL game

(very good to use when you have a summer course when the NFL games are at the same time, or if you want to use it as an "ice breaker" for a very hard topic)


Think about what you learned in this class and respond shortly to the questions below:

List what is the New concept you learned:




The concept you feel comfortable on teaching your Friend:





Which topic you need to do more Learning:




------------
Author of “NFL game”: Zsuzsanna Szabo, Ph.D.

One word chapter -- template

One Word Chapter


After reading the assigned text, write below one word that captures the essence of what you’ve read and summarizes your response to it.


_________________________________
(One word summary)

Below explain shortly why you chose the word above and how it provides your summary of the reading:

_________________________________
_________________________________
_________________________________
_________________________________
_________________________________

Door Pass -- template

DOOR PASS


Name_____________________________________


Write three facts or your reflection on facts you learned this class:

1.__________________________________________________________________


2.__________________________________________________________________


3.__________________________________________________________________


Do you have ONE question related to the content we learned this class period that you would like to ask your teacher?
Ask it:

______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

Minute Paper --- template

In concise, well-planned sentences, please answer the two questions below:


1. What are the two most meaningful things you have learned from the topic we learned in the class today?



2. What is that one question that remains in your mind and you would like to have more information on?

-------------

More teaching strategies to be found in:

Angelo, T. A., & Cross, K. P. (1993). Classroom assessment techniques: A handbook for college teachers. (2nd ed.). San Francisco: Jossey-Bass.