A printable PDF of this information can be found here. 

Annual Program Assessment Report

 

Academic Year Assessed: 2019-2020
College: CLS               
Department: History & Philosophy
Submitted by: History and Philosophy, DH and History Assessment Committee

 

Program(s) Assessed:   
Indicate all majors, minors, certificates and/or options that are included in this assessment:

Majors/Minors/Certificate

Options

Major, Minor

History-History/History-SETS/History-Teaching 

 

Annual Assessment Process (CHECK OFF LIST)

  1. Data are collected as defined by Assessment Plan
    YES                        
  2. Population or unbiased samples of collected assignments are scored by at least two faculty members using scoring rubrics to ensure inter-rater reliability.

                                YES. All papers reviewed separately by all three members of assessment committee.

  1. Areas where the acceptable performance threshold has not been met are
                        NA         
  2. Assessment scores were presented at a program/unit faculty meeting.
                        Presented at August 26 meeting with full department.

 

  1. The faculty reviewed the assessment results, and responded accordingly (Check all appropriate lines)

 

             Gather additional data to verify or refute the result. _____

             Identify potential curriculum changes to try to address the problem _____

             Change the acceptable performance threshold, reassess _____

             Choose a different assignment to assess the outcome _____

             Faculty may reconsider thresholds_____
             Evaluate the rubric to assure outcomes meet student skill level _____
             Use Bloom’s Taxonomy to consider stronger learning outcomes _____
             Choose a different assignment to assess the outcome_____
OTHER: Will address options at upcoming meeting.

  1. Does your report demonstrate changes made because of previous assessment results (closing the loop)?      YES

 

1. Assessment Plan, Schedule and Data Source.
a. Please provide a multi-year assessment schedule that will show when all program learning outcomes will be assessed, and by what criteria (data). (You may use the table provided, or you may delete and use a different format).

 

’11-12

12-13

13-14

14-15

15-16

16-17

17-18

18-19

19-20

History Major Los

 

1, 6

2, 3, 4, 5

1, 6

2, 3

1, 6

4, 5

2, 3

1, 2

History Minor Los

 

 

1, 2, 3

1

2

1

3

 

1

 

*Data sources: randomly selected essays from senior capstone courses (major) and randomly selected essays from 100-level courses essays (minor)

b. What are your threshold values for which you demonstrate student achievement? (Example provided in the table should be deleted before submission)

See below

2. What Was Done
a. Was the completed assessment consistent with the plan provided?
YES.
If no, please explain why the plan was altered.

b. Please provide a rubric that demonstrates how your data was evaluated.
See rubrics below for major LOs 1 and 2, and minor LO 1.

3. How Data Were Collected
a. How were data collected? (Please include method of collection and sample size).

We selected 10 of 10 submitted essays from capstone course from Fall 2019 and selected 10 (every 14th) papers from 100-level class with approximately 140 submissions in final paper assignment, also from Fall 2020. Given the nature in which the Spring 2020 semester concluded, we elected to not use papers from that semester in this year’s assessment.  

 

b. Explain the assessment process, and who participated in the analysis of the data.

The chair of history assessment committee contacted professors from the classes that were chosen to assist with assessment: 10 papers from the Capstone and 10 papers from the 100-level class. Two learning outcomes were assessed for the Capstone papers, one learning outcome was assessed in the papers from the 100-level class.

All three members of the assessment committee read all twenty papers and scored them individually according to the following four categories: excellent, good, acceptable, and unacceptable. The committee members then convened, and reported to one another the total number of papers they found to fall under each category, with the committee chair keeping score. Since there were 10 papers per class and 3 committee members reading them, there was a total of 30 scores per assessed learning outcome. In cases in which the quality of assessed learning outcomes was found to be “borderline” between two categories, the score was split (0.5 per category) between the two categories, which is why some scores end in .5. 

NOTE: Student names must not be included in data collection.  Totals of successful completions, manner of assessment (publications, thesis/dissertation, or qualifying exam) may be presented in table format if they apply to learning outcomes.

4. What Was Learned
Based on the analysis of the data, and compared to the threshold values provided, what was learned from the assessment?

a. Areas of strength

100% of student essays met the threshold (acceptable or above) on both objectives. We are meeting the goals established by the first assessment committee in 2010-11.

Minor:

Learning Outcome 1:  “Our graduates will be able to recognize that historical events are subject to multiple interpretations.”

 

                       Excellent                      10% (3 out of 30 scores)

                       Good                             23%  (7/30)        

                       Acceptable                 67%  (20/30)

                       Unacceptable            0%    (0/30)

            Total “Acceptable” and better:  100%. This result surpasses the goal of 75%.

 

Major:

Learning Outcome 1: “Our graduates will be able to present a clear thesis statement.”

 

                        Excellent                      0%  (0 out of 30 scores)

                        Good                             23%  (7/30)        

                        Acceptable                 52%  (15.5/30)

                        Unacceptable            12%   (3.5/30)

            Total “Acceptable” and better: 88%. This result surpasses the goal of 75%.

 

 

Learning Outcome 2: “Our graduates will be able to distinguish between primary and secondary sources”

 

                        Excellent: 13.3% (4 out of 30 scores)

                        Good: 20% (6/30)

                        Acceptable: 63.3% (19/30)

                        Unacceptable: 3.3% (1/30)

            Total “Acceptable” and better: 96.6%. This result surpasses the goal of 75%.

 

5. How We Responded

a. Describe how “What Was Learned” was communicated to the department, or program faculty. Was there a forum for faculty to provide feedback and recommendations?

The assessment committee presented its findings at a full meeting of the department on August 26, 2020. Faculty were given a copy of this report, and we discussed the committee’s findings for approximately 20 minutes. The committee’s findings have been incorporated into ongoing department discussions pertaining to teaching and the future directions of the history major.  

b. Based on the faculty responses, will there any curricular or assessment changes (such as plans for measurable improvements, or realignment of learning outcomes)?

Not at present. While our assessment indicates that we are currently quite strong with regard to the writing LOs that were investigated, we plan to continue regular discussions within our department regarding curriculum and assessment techniques.

 If yes, when will these changes be implemented?  

As indicated above, these are ongoing discussions.

Please include which outcome is targeted, and how changes will be measured for improvement.  If other criteria is used to recommend program changes (such as exit surveys, or employer satisfaction surveys) please explain how the responses are driving department, or program decisions.

c. When will the changes be next assessed? 
 

See above.

6. Closing the Loop
a) Based on assessment from previous years, can you demonstrate program level changes that have led to outcome improvements? As our assessment plan stands, we are consistently meeting our threshold. Our review process this year will help us to identify with more specificity where and how we can improve our program.


Submit report to programassessment@montana.edu

 


 

** Threshold value: At least 75% of students will be rated “Acceptable” or higher on every category of the scoring rubrics for both major and minor. 

 

LEARNING OUTCOMES ASSESSMENT RUBRICS

MAJOR LEARNING OUTCOMES (History/SETS)

  1. be able to present a clear thesis statement
  2. be able to distinguish between primary and secondary sources
  3. be able to marshal evidence from both primary and secondary sources to support an argument
  4. be able to communicate effectively
  5. be able to recognize that historical events are subject to multiple interpretations
  6. be able to cite sources according to the conventions of the discipline.

 

 

MAJORLEARNING OUTCOME 1 - Our graduates will be able to present a clear thesis statement.

 

Unacceptable

There is no recognizable thesis or it is unintelligible due to grammatical errors. 

Unacceptable

Acceptable

There is a thesis statement that takes a position on an arguable point, but it may not be fully developed.  It is largely free of grammatical errors.

Acceptable

Good

There is a thesis statement that takes a clear position on an arguable point.  It is written in grammatically correct language.  It demonstrates an effort to interpret a historical phenomenon.

Good

Excellent

There is a thesis statement that is original and/or creative in its presentation of an argument about a historical phenomenon.  It is forcefully or persuasively presented in well-written language.  It previews the argumentative line of the essay and the evidence that will be used.

Excellent

 

MAJORLEARNING OUTCOME 2 - Our graduates will be able to distinguish between primary and secondary sources

 

Unacceptable

the paper used only secondary sources with no sense that original research requires primary materials

Unacceptable

Acceptable

the paper demonstrated the use of primary and secondary sources but without notable distinction

Acceptable

Good

there is an embedded understanding of the difference between types of sources

Good

Excellent

there is an explicit discussion of the nature of sources used in the paper

Excellent

 

MAJORLEARNING OUTCOME 3 - Our graduates will be able to marshal evidence from both primary and secondary sources to support an argument

 

Unacceptable

makes a claim but doesn’t have convincing evidence

Unacceptable

Acceptable

makes a connection between a claim and a source, but uses limited sources, is overly dependent on a single source without explanation

Acceptable

Good

makes a connection between a claim and source materials, but does not contextualize the source

Good

Excellent

makes a clear connection between a claim and source material and uses more than one kind of material to support that claim, sometimes with a comment on the nature of the evidence

Excellent

 

MAJORLEARNING OUTCOME 4 – Our graduates will be able to communicate effectively

 

Unacceptable

has no argument; is poorly organized; is riddled with grammatical errors

Unacceptable

Acceptable

organizes essay with introduction, explanatory body and conclusion; paragraph are not always clear; and argument wanders about

Acceptable

Good

organizes essay with introduction, explanatory body and conclusion; has paragraphs with clear topic sentences, is grammatically correct and virtually error free

Good

Excellent

organizes essay with introduction, explanatory body and conclusion; has paragraphs with clear topic sentences, is grammatically correct and virtually error free, and shows evidence of a “voice” of their own and some stylistic flair

Excellent

 

MAJORLEARNING OUTCOME 5 – Our graduates will be able to recognize that historical events are subject to multiple interpretations

 

Unacceptable

does not show any understanding that the past may be subject to interpretation

Unacceptable

Acceptable

acknowledges that the event under study is subject to multiple interpretations but adheres to only one interpretation without serious consideration of other points of view

Acceptable

Good

acknowledges that the event under study is subject to multiple interpretations and attempts to use evidence from sources to demonstrate those interpretations

Good

Excellent

recognizes that the event/theory/phenomenon under study is subject to multiple interpretations and suggest the lines of competing interpretations, referring to a variety of texts or contradictory sources

Excellent

 

MAJOR LEARNING OUTCOME 6 - Our graduates will be able to cite sources according to the conventions of the discipline.

 

Unacceptable

Incomplete bibliographic information that does not permit traceability; so many errors in style and punctuation as to make information unusable.

Unacceptable

Acceptable

Citations have full bibliographic information that permits traceability; there may be inconsistency in style and errors of punctuation.

Acceptable

Good

Citations are consistent, with full bibliographic information that permits traceability; there may be errors of punctuation.

Good

Excellent

Citations meet journal standards of accuracy, consistency and punctuation.

Excellent

 

MINOR LEARNING OUTCOMES (History/ History Teaching)

  1. have acquired an introductory knowledge of Western Civilization, U.S. History, and one area of World History
  2. be able to marshal historical evidence from assigned texts, which may include primary and secondary sources, to support an argument
  3. be able to communicate historical ideas effectively

 

MINOR LEARNING OUTCOME 1 – Our minors will have acquired an introductory knowledge of Western Civilization, U.S. History, and one area of World History

 

 

Unacceptable

Demonstrates  no or very limited knowledge and understanding of the subject matter (Western Civilization, U.S. History, or World History, per selected class)

Unacceptable

Acceptable

Demonstrates a basic, rudimentary knowledge and understanding of the subject matter (Western Civilization, U.S. History, or World History, per selected class)

Acceptable

Good

Demonstrates more than a basic knowledge and understanding of the subject matter (Western Civilization, U.S. History, or World History, per selected class)

Good

Excellent

Demonstrates a comprehensive knowledge and understanding of the subject matter (Western Civilization, U.S. History, or World History, per selected class)

Excellent

 

MINOR LEARNING OUTCOME 2 – Our minors willbe able to marshal historical evidence from assigned texts, which may include primary and secondary sources, to support an argument

 

Unacceptable

makes a claim but doesn’t have convincing evidence

Unacceptable

Acceptable

makes a connection between a claim and a source, but uses limited sources, is overly dependent on a single source without explanation

Acceptable

Good

makes a connection between a claim and source materials, but does not contextualize the source

Good

Excellent

makes a clear connection between a claim and source material and uses more than one kind of material to support that claim, sometimes with a comment on the nature of the evidence

Excellent

 

MINOR LEARNING OUTCOME 3 - Our minors will be able to communicate historical ideas effectively

 

Unacceptable

Demonstrates no or very limited ability to communicate historical ideas

Unacceptable

Acceptable

Demonstrates a basic, rudimentary ability to communicate historical ideas

Acceptable

Good

Demonstrates more than a basic ability to communicate historical ideas

Good

Excellent

Clearly and effectively communicates historical ideas

Excellent