2019-2020 BA in History all Options and History Minor

A printable PDF of this information can be found here. 

Annual Program Assessment Report

Academic Year Assessed: 2019-2020
College: CLS               
Department: History & Philosophy
Submitted by: History and Philosophy, DH and History Assessment Committee

Program(s) Assessed:   
Indicate all majors, minors, certificates and/or options that are included in this assessment:

Annual Assessment Process (CHECK OFF LIST)

1. Data are collected as defined by Assessment Plan
   YES                        
2. Population or unbiased samples of collected assignments are scored by at least two faculty members using scoring rubrics to ensure inter-rater reliability.

                                YES. All papers reviewed separately by all three members of assessment committee.

3. Areas where the acceptable performance threshold has not been met are
                       NA         
4. Assessment scores were presented at a program/unit faculty meeting.
                       Presented at August 26 meeting with full department.

5. The faculty reviewed the assessment results, and responded accordingly (Check all appropriate lines)

             Gather additional data to verify or refute the result. _____

             Identify potential curriculum changes to try to address the problem _____

             Change the acceptable performance threshold, reassess _____

             Choose a different assignment to assess the outcome _____

             Faculty may reconsider thresholds_____
             Evaluate the rubric to assure outcomes meet student skill level _____
             Use Bloom’s Taxonomy to consider stronger learning outcomes _____
             Choose a different assignment to assess the outcome_____
OTHER: Will address options at upcoming meeting.

6. Does your report demonstrate changes made because of previous assessment results (closing the loop)?      YES

1. Assessment Plan, Schedule and Data Source.
a. Please provide a multi-year assessment schedule that will show when all program learning outcomes will be assessed, and by what criteria (data). (You may use the table provided, or you may delete and use a different format).

*Data sources: randomly selected essays from senior capstone courses (major) and randomly selected essays from 100-level courses essays (minor)

b. What are your threshold values for which you demonstrate student achievement? (Example provided in the table should be deleted before submission)

See below

2. What Was Done
a. Was the completed assessment consistent with the plan provided? YES.
If no, please explain why the plan was altered.

b. Please provide a rubric that demonstrates how your data was evaluated.
See rubrics below for major LOs 1 and 2, and minor LO 1.

3. How Data Were Collected
a. How were data collected? (Please include method of collection and sample size).

We selected 10 of 10 submitted essays from capstone course from Fall 2019 and selected 10 (every 14^th) papers from 100-level class with approximately 140 submissions in final paper assignment, also from Fall 2020. Given the nature in which the Spring 2020 semester concluded, we elected to not use papers from that semester in this year’s assessment.  

b. Explain the assessment process, and who participated in the analysis of the data.

The chair of history assessment committee contacted professors from the classes that were chosen to assist with assessment: 10 papers from the Capstone and 10 papers from the 100-level class. Two learning outcomes were assessed for the Capstone papers, one learning outcome was assessed in the papers from the 100-level class.

All three members of the assessment committee read all twenty papers and scored them individually according to the following four categories: excellent, good, acceptable, and unacceptable. The committee members then convened, and reported to one another the total number of papers they found to fall under each category, with the committee chair keeping score. Since there were 10 papers per class and 3 committee members reading them, there was a total of 30 scores per assessed learning outcome. In cases in which the quality of assessed learning outcomes was found to be “borderline” between two categories, the score was split (0.5 per category) between the two categories, which is why some scores end in .5. 

NOTE: Student names must not be included in data collection.  Totals of successful completions, manner of assessment (publications, thesis/dissertation, or qualifying exam) may be presented in table format if they apply to learning outcomes.

4. What Was Learned
Based on the analysis of the data, and compared to the threshold values provided, what was learned from the assessment?

a. Areas of strength

100% of student essays met the threshold (acceptable or above) on both objectives. We are meeting the goals established by the first assessment committee in 2010-11.

Minor:

Learning Outcome 1:  “Our graduates will be able to recognize that historical events are subject to multiple interpretations.”

                       Excellent                      10% (3 out of 30 scores)

                       Good                             23%  (7/30)        

                       Acceptable                 67%  (20/30)

                       Unacceptable            0%    (0/30)

            Total “Acceptable” and better:  100%. This result surpasses the goal of 75%.

Major:

Learning Outcome 1: “Our graduates will be able to present a clear thesis statement.”

                        Excellent                      0%  (0 out of 30 scores)

                        Good                             23%  (7/30)        

                        Acceptable                 52%  (15.5/30)

                        Unacceptable            12%   (3.5/30)

            Total “Acceptable” and better: 88%. This result surpasses the goal of 75%.

Learning Outcome 2: “Our graduates will be able to distinguish between primary and secondary sources”

                        Excellent: 13.3% (4 out of 30 scores)

                        Good: 20% (6/30)

                        Acceptable: 63.3% (19/30)

                        Unacceptable: 3.3% (1/30)

            Total “Acceptable” and better: 96.6%. This result surpasses the goal of 75%.

5. How We Responded

a. Describe how “What Was Learned” was communicated to the department, or program faculty. Was there a forum for faculty to provide feedback and recommendations?

The assessment committee presented its findings at a full meeting of the department on August 26, 2020. Faculty were given a copy of this report, and we discussed the committee’s findings for approximately 20 minutes. The committee’s findings have been incorporated into ongoing department discussions pertaining to teaching and the future directions of the history major.  

b. Based on the faculty responses, will there any curricular or assessment changes (such as plans for measurable improvements, or realignment of learning outcomes)?

Not at present. While our assessment indicates that we are currently quite strong with regard to the writing LOs that were investigated, we plan to continue regular discussions within our department regarding curriculum and assessment techniques.

 If yes, when will these changes be implemented?  

As indicated above, these are ongoing discussions.

Please include which outcome is targeted, and how changes will be measured for improvement.  If other criteria is used to recommend program changes (such as exit surveys, or employer satisfaction surveys) please explain how the responses are driving department, or program decisions.

c. When will the changes be next assessed?   

See above.

6. Closing the Loop
a) Based on assessment from previous years, can you demonstrate program level changes that have led to outcome improvements? As our assessment plan stands, we are consistently meeting our threshold. Our review process this year will help us to identify with more specificity where and how we can improve our program.

Submit report to programassessment@montana.edu

** Threshold value: At least 75% of students will be rated “Acceptable” or higher on every category of the scoring rubrics for both major and minor. 

LEARNING OUTCOMES ASSESSMENT RUBRICS

MAJOR LEARNING OUTCOMES (History/SETS)

2. be able to present a clear thesis statement
3. be able to distinguish between primary and secondary sources
4. be able to marshal evidence from both primary and secondary sources to support an argument
5. be able to communicate effectively
6. be able to recognize that historical events are subject to multiple interpretations
7. be able to cite sources according to the conventions of the discipline.

MAJORLEARNING OUTCOME 1 - Our graduates will be able to present a clear thesis statement.

MAJORLEARNING OUTCOME 2 - Our graduates will be able to distinguish between primary and secondary sources

MAJORLEARNING OUTCOME 3 - Our graduates will be able to marshal evidence from both primary and secondary sources to support an argument

MAJORLEARNING OUTCOME 4 – Our graduates will be able to communicate effectively

MAJORLEARNING OUTCOME 5 – Our graduates will be able to recognize that historical events are subject to multiple interpretations

MAJOR LEARNING OUTCOME 6 - Our graduates will be able to cite sources according to the conventions of the discipline.

MINOR LEARNING OUTCOMES (History/ History Teaching)

1. have acquired an introductory knowledge of Western Civilization, U.S. History, and one area of World History
2. be able to marshal historical evidence from assigned texts, which may include primary and secondary sources, to support an argument
3. be able to communicate historical ideas effectively

MINOR LEARNING OUTCOME 1 – Our minors will have acquired an introductory knowledge of Western Civilization, U.S. History, and one area of World History

MINOR LEARNING OUTCOME 2 – Our minors willbe able to marshal historical evidence from assigned texts, which may include primary and secondary sources, to support an argument

MINOR LEARNING OUTCOME 3 - Our minors will be able to communicate historical ideas effectively