Assessment at ESU -- A Status Report
Assessment & Teaching Enhancement Center
October 1999"Assessment is an ongoing process aimed at understanding and improving student learning. It involves making our expectations explicit and public; setting appropriate criteria and high standards for learning quality; systematically gathering, analyzing, and interpreting evidence to determine how well performance matches those expectations and standards; and using the resulting information to document, explain, and improve performance." --Thomas A. Angelo, AAHE Forum, 1995
Landmarks
1922 State of Kansas Scholarship Contest initiated by KSTC
1978 ESU Faculty Senate Adopts Minimum Competency Examination Requirement
1987 Kansas Board of Regents Mandates Development of Assessment Plans
1989 North Central Association Commission on Institutions of Higher Education Assessment Initiative: ". . . assessment of academic achievement is mandatory, for only by knowing what works and what does not can a professor, a department, a school, or an institution create and carry out plans for continuous educational improvement."
1989 ESU Assessment Plan Approved by Board of Regents
1991 Council on Postsecondary Accreditation/Fund for the Improvement of Postsecondary Education: " . . .after faculty credentials and the validity of the curriculum, an effective approach to assessment . . . is a foremost consideration in accreditation."
1994 The North Central Evaluation Team characterized ESU's approach to assessment as "commendable," and stated: "the assessment program at ESU . . . is working well, has the support of administration, faculty, and students; and has resulted in identifiable improvements of student learning."
1998 The American Productivity and Quality Center cited ESU as a "Best Practice" organization in the assessment of student learning: "One of the most important lessons learned is to get grass-roots involvement . . . pushing the assessment decisions to those who can use the results has been a critical factor in ESU's success."
Principles Underlying the Practice of Assessment at ESU
There are institution-wide commitments to attempt to understand what takes place when students learn and to improve the learning experience for students at ESU.
It is recognized that different approaches to assessment are appropriate at different levels and in different settings. Even in the same academic unit, different assessment techniques may be used for different programs.
The success of the assessment program is indicated by changes which attempt to improve student learning as well as by changes which can demonstrate such improvement. Experimentation and special study do not always produce solutions for problems, but they do signify a willingness to seek solutions.
Assessment Activities -- University Level
All undergraduate students must take and pass competency examinations in reading, writing, and mathematics.
Periodic surveys are conducted of recent graduates, of placement after graduation, and of employer satisfaction with ESU graduates.
A Student Perceptions of Instruction study is conducted every two years.
Special studies are also undertaken to assess achievement in particular areas, e.g., the development of critical thinking, knowledge about and sensitivity to multi-cultural issues, and computer literacy.
All programs which are eligible are encouraged to become accredited.
Assessment Activities -- Division Level
Table 1 - Summary of Assessment Techniques Employed
Assessment Activity |
1988 |
1991 |
1994 |
1998 (n=58) |
||||
Majors |
% |
Majors |
% |
Majors |
% |
Majors |
% |
|
Locally Developed Achievement Measures |
16 |
24% |
34 |
51% |
32 |
52% |
40 |
69% |
External Expert |
23 |
35% |
31 |
46% |
25 |
41% |
23 |
40% |
Self-Reported Data Collection* |
39 |
59% |
49 |
73% |
54 |
89% |
NA |
NA |
Student Surveys (or Focus Groups)* |
NA |
NA |
NA |
NA |
NA |
NA |
41 |
71% |
Alumni Surveys (or Focus Groups)* |
NA |
NA |
NA |
NA |
NA |
NA |
42 |
72% |
Nationally Standardized Achievement Tests |
12 |
18% |
13 |
19% |
10 |
16% |
11 |
19% |
Persistence Studies |
13 |
20% |
44 |
66% |
47 |
77% |
14 |
24% |
Portfolio Analysis |
0 |
0% |
50 |
75% |
48 |
79% |
19 |
33% |
Capstone Experience** |
NA |
NA |
NA |
NA |
NA |
NA |
34 |
59% |
Writing Skill Assessment** |
NA |
NA |
NA |
NA |
NA |
NA |
37 |
64% |
Exit Interviews** |
NA |
NA |
NA |
NA |
NA |
NA |
27 |
47% |
Placement of Graduates** |
NA |
NA |
NA |
NA |
NA |
NA |
43 |
74% |
Employer Satisfaction Surveys** |
NA |
NA |
NA |
NA |
NA |
NA |
26 |
45% |
* Self-Reported Data Collection" in the 1994 document included both Student Surveys and Alumni Surveys. **Technique not included in the 1994 document. |
||||||||
All but one of ESU's undergraduate majors and all of the graduate majors are evaluated by multiple measures. A majority of the undergraduate majors and almost that proportion of graduate majors employ six or more measurement techniques.
Attitudes toward Assessment
The overwhelming majority of faculty and staff believe that assessment activities are supported by the Board of Regents, administrators, and the faculty.
Eighty-two percent either agree or strongly agree with the statement that "our faculty are actively involved in assessment activities."
Fifty-nine percent believe that assessment activities have affected student learning, and seventy-seven believe that assessment has affected the quality of our academic programs.
Sixty-nine percent agree or strongly agree with the statement that "ESU's overall approach to assessment is generally effective."
Actions Taken as a Result of Assessment -- University Level
1. The general education curriculum was modified to require course work which emphasizes knowledge of multi-cultural issues.
2. A proposal to modify graduation requirements to include course work which develops computer literacy has been submitted to the VPAA.
3. The university's competency examination requirement ( a previous requirement) was modified to permit alternative ways in which high achieving students can demonstrate proficiency in reading, mathematics, and writing.
4. All academic divisions were encouraged to develop writing-intensive courses.
5. The General Education Council (in consultation with faculty in Biology, Teacher Education, and Psychology) launched a longitudinal study of correlates of critical thinking among ESU students.
6. The university received a major grant from the U.S. Department of Education to support the assessment of the effectiveness of multi-cultural/diversity education.
7. The General Education Council and the Office of Assessment are conducting a comprehensive assessment of the university's general education curriculum. A major grant to augment this assessment is being submitted to the U.S. Department of Education and the Fund for the Improvement of PostSecondary Education.
Actions Taken as a Result of Assessment -- Division Level
1. Revised student evaluations to reflect program goals more directly.
2. Establishment of exhibition and recital programs for students and alumni in the performing arts areas.
3. Renewed emphasis on student writing in lower division courses; requirements that undergraduate papers follow APA or MLA style format.
4. Incorporation of computer technology in courses in a number of non-science and science majors.
5. Improved advising checklists and program information sheets.
6. Revision of course requirements to increase flexibility and opportunity for interdisciplinary study.
7. Development of new courses and curricula to meet student needs in such area as theatre management, public relations, and space science.
8. Offering tutors and tutoring assistance for "difficult" courses.
9. Formation and rejuvenation of student organizations with an academic focus.
10. Field trips to laboratories, industrial organizations, and other educational institutions.
11. Development of an on-site teaching experience before student teaching in cooperation with local schools.
12. Addition of undergraduate research requirements; increased admission requirements in some majors.
13. Experimentation with various instructional styles.
14. Reorganization of developmental math courses.
15. Addition of writing assignments in nearly all general education classes.
16. Revision of syllabuses and readings to give more emphasis to women and people of color.
17. Provision of additional computing facilities for students.
18. Addition of foreign language requirements and electives.
19. Deletion of unnecessary and outdated courses.
20. Offering additional courses via Internet and other distance learning systems to meet needs of place-bound students.
Actions Taken as a Result of Assessment -- Changes in Assessment
1. Eight of the nineteen academic divisions now have formal Assessment Committees that meet and report on a regular basis.
2. While survey data are still collected and used, several divisions and the General Education Council are now using focus groups to obtain assessment data from students, alumni, and other constituency groups.
3. Capstone experiences have been designed in a number of undergraduate programs. Most of these emphasize undergraduate research or the synthesis of the entire academic experience.
4. Many chairs and assessment committees are now conducting exit interviews with graduating seniors to seek their advice about how the learning experience can be improved.
5. Some divisions have formed Advisory Boards consisting of potential employers, alumni, and others who also review assessment data.
6. The General Education Council has sponsored forums on such assessment issues as "enhancing student learning," "measuring critical thinking," and "intensive writing courses."
ESU Students Past and Present
The Summer 1996 New Students Computer Survey revealed that 62% of incoming students had a home computer they could use for classes at ESU. The Summer 1998 New Students Computer Survey indicated that 75% of incoming students had a home computer they could use. The 1996 Survey reported that 25% of new students were bringing a computer to campus; the 1998 Survey figure was 30.2%. Three percent of the 1996 Survey respondents said they had their own "home" page on the Internet; eleven percent have a personal web page according to the 1998 Survey.
The Kansas Board of Regents Student Perceptions Survey in 1996 revealed that 95% of ESU students were satisfied or very satisfied with the education they were receiving at ESU; the 1998 Survey found 86% giving the same appraisal. While 85% of the students rated their instructors as effective in 1996, 95% gave a similar opinion in 1998. In the 1996 Survey, 66% of ESU students reported that their educational experience at ESU was frequently or very frequently intellectually challenging; 72% of the respondents in the 1998 Survey voiced the same opinion.
In a Spring 1993 survey, 58% of ESU students said their high school prepared them adequately for college; only 43% of respondents to a Spring 1997 survey characterized their high school preparation as adequate.
Table 2 - Ten Years of Student Changes
In 1987-88 |
In 1997-98 |
65.5% of our students were full-time (registered for 12 hours or more) |
73.4% of our enrollment consisted of full-time students. |
average age for ESU undergraduate students was 22.29 years |
average age for ESU undergraduate students was 22.84 years |
average age for all students was 26.37 years |
average age for all students was 26.18 years. |
minority enrollment was about 4.0% |
minority enrollment was about 6.6%? |
non-resident alien enrollment was about 2.1% |
non-resident alien enrollment was about 2.5% |
white non-hispanic enrollment was about 93.9% |
white non-hispanic enrollment was about 84.3%% |
average high school GPA was 2.88 |
average high school GPA was 3.20 |
55% of grades received at ESU by undergraduates were A's & B's |
57% of grades received by ESU undergraduates were A's & B's |
85% of grades received at ESU by undergraduates were passing (NOT failure, incomplete, or withdrawal). |
85% of grades received at ESU by undergraduates were passing (NOT failure, incomplete, or withdrawal). |
Table 3 -- Test Scores of ESU Students
Test |
1995-96 |
1998-99 |
||
ESU |
National |
ESU |
National |
|
ACT Reading ACT English ACT Math ACT Science Reasoning ACT Composite |
21.6 20.4 19.4 21.0 20.7 |
22.1 21.1 20.8 21.6 21.5 |
21.6 20.4 20.2 21.1 20.9 |
22.2 21.2 21.2 21.7 21.7 |
CAAP Reading CAAP Writing CAAP Math |
62.6 65.5 57.2 |
62.8 64.4 57.9 |
62.9 64.8 57.7 |
62.9 64.4 57.9 |
CAAP Number of Examinees Passing All Tests Not Passing All Tests Not Passing Reading Not Passing Writing Not Passing Math |
587 465 (79.2%) 9 (1.5%) 27 (5%) 34 (4%) 83 (14%) |
302 226 (74.8%) 6 (1.9%) 30 (9.9%) 17 (5.6%) 51 (16.9%) |
||
PPST Reading PPST Writing PPST Math |
178 175 178 |
179 175 178 |
178 174 178.5 |
178 175 178 |
PPST Number of Examinees Passing All Tests Not Passing All Tests Not Passing Reading Not Passing Writing Not Passing Math |
268 187 (69.8%) 10 (3.7%) 24 (9%) 58 (22%) 30 (11%) |
271 157 (57.9%) 17 (6.3%) 54 (19.9%) 72 (26.6%) 52 (19.2%) |
||
Praxis Professional Knowledge |
666 |
663 |
664 |
663 |
1) Students come to ESU with slightly below average academic skills. By their junior year, ESU students have increased their academic skills to national average levels.
2) Students taking the CAAP test in 1998-99 have declined slightly in their academic skills by comparison with those taking the test in 1995-96.
3) Students taking the PPST test in 1998-98 include a greater number of less skilled students than in 1995-96.
4) A guess, rather than an interpretation: the "least skilled" ESU graduates exceed 5 to 10 percent of college graduates nationally in reading, writing, and math ability.
Last Updated March 19, 2007


