Student Assessment During the Pandemic

Table of Contents

1. THE QUESTIONNAIRE    

2. PARTICIPANTS LIST    

• Characteristics of the Sample    

3. SUMMARY OF MAIN FINDINGS    

• Annual Budget for Assessment Office, 2019-20 and 2020-21 Compared    
• Primary Changes in Assessment Due to Pandemic    
• Adjustments Made by the College Testing Center    
• Student Assessment of Instructors    
• College Policies on Grading During the Pandemic    
• Surveying of Students About their Online Learning Experience During the Pandemic    
• Use of New Assessment Diagnostic Tools Suitable to the New Environment    
• Results for Assessment of Survey of Students    
• Students Faring Better or Worse than Others During the Pandemic    
• Acceptance of Standardized Tests Taken at Other Institutions for Transfer Students    
• Criteria for Transfer Student Placement in View of the Absence of Standardized Testing    
• Confidence in College Preparatory Measures for Institutions Offering Such Services    
• Provision of Preparatory or Remedial Education Online    
• Role of the Academic Library In Student Assessment During the Pandemic    
• Role of the Distance Learning Program in Student Assessment During the Pandemic    
• Role of Finance and Audits in Student Assessment During the Pandemic    
• Role of Student Affairs in Student Assessment During the Pandemic    
• Role of Career Services in Student Assessment During the Pandemic    
• Role of Academic Advising in Student Assessment During the Pandemic    
• Role of Information Technology Departments in Student Assessment During the Pandemic    
• Evaluating the Flipped Classroom    
• Evaluation of Machine-Assessed Interactive Video    
• Evaluation of Artificial Intelligence Programs that Diagnose Gaps in Knowledge    
• Evaluation of Zoom    
• Evaluation of Skype    
• Evaluation of WebEx    
• Evaluation of Panopoto    
• Evaluation of Online Learning Efforts    
• Evaluation of the Splitting of Larger Classes Into Smaller Groups    
• Evaluation of Hybrid Learning    
• How well Coordinated are Various Campus Departments in the Assessment Effort    
• Role of the Assessment Office in Minimizing Student Attendance Losses Due to COVID    
• Interview of Departing Students    
• Adjustments that Needed to be Made During the Pandemic to Education Program Features    
• What Assessment Officials Need to Do in the Current Environment    

List of Tables

Table 1 What is the annual budget (in US $) of the assessment office, including salaries and overhead for each of the following periods?    
Table 1.1.1 What is the annual budget (in US $) of the assessment office, including salaries and overhead for the 2019-20 academic year?    
Table 1.1.2 What is the annual budget (in US $) of the assessment office, including salaries and overhead for the 2019-20 academic year? Broken out by university/college type    
Table 1.1.3 What is the annual budget (in US $) of the assessment office, including salaries and overhead for the 2019-20 academic year? Broken out by Public or Private    
Table 1.1.4 What is the annual budget (in US $) of the assessment office, including salaries and overhead for the 2019-20 academic year? Broken out by enrollment    
Table 1.1.5 What is the annual budget (in US $) of the assessment office, including salaries and overhead for the 2019-20 academic year? Broken out by tuition, $    
Table 1.2.1 What is the annual budget (in US $) of the assessment office, including salaries and overhead for 20-21 academic year    
Table 1.2.2 What is the annual budget (in US $) of the assessment office, including salaries and overhead for 20-21 academic year Broken out by university/college type    
Table 1.2.3 What is the annual budget (in US $) of the assessment office, including salaries and overhead for 20-21 academic year Broken out by Public or Private    
Table 1.2.4 What is the annual budget (in US $) of the assessment office, including salaries and overhead for 20-21 academic year Broken out by enrollment    
Table 1.2.5 What is the annual budget (in US $) of the assessment office, including salaries and overhead for 20-21 academic year Broken out by tuition, $    
What has primarily changed about the college assessment office's efforts and objectives as a result of the pandemic? Broken out by university/college type    
How has your college testing center adjusted to the online environment? Are they able to administer tests securely and fairly in an online environment? Broken out by university/college type    
Table 2.1 Which phrase best describes student assessment of instructors during the pandemic?    
Table 2.2 Which phrase best describes student assessment of instructors during the pandemic? Broken out by university/college type    
Table 2.3 Which phrase best describes student assessment of instructors during the pandemic? Broken out by Public or Private    
Table 2.4 Which phrase best describes student assessment of instructors during the pandemic? Broken out by enrollment    
Table 2.5 Which phrase best describes student assessment of instructors during the pandemic? Broken out by tuition, $    
Table 3.1 Your college's policies on grading have changed or not?    
Table 3.2 Your college's policies on grading have changed or not? Broken out by university/college type    
Table 3.3 Your college's policies on grading have changed or not? Broken out by Public or Private    
Table 3.4 Your college's policies on grading have changed or not? Broken out by enrollment    
Table 3.5 Your college's policies on grading have changed or not? Broken out by tuition, $    
Table 4.1 Is your office actively surveying students about their experience with online learning and other aspects of the college experience during the pandemic?    
Table 4.2 Is your office actively surveying students about their experience with online learning and other aspects of the college experience during the pandemic? Broken out by university/college type    
Table 4.3 Is your office actively surveying students about their experience with online learning and other aspects of the college experience during the pandemic? Broken out by Public or Private    
Table 4.4 Is your office actively surveying students about their experience with online learning and other aspects of the college experience during the pandemic? Broken out by enrollment    
Table 4.5 Is your office actively surveying students about their experience with online learning and other aspects of the college experience during the pandemic? Broken out by tuition, $    
Has the college adopted or developed any new diagnostic tools more amenable to an online environment that it can use in the absence of traditional classes?  If so, which ones? Broken out by university/college type    
If your office is conducting surveys of students to measure the effects of the coronavirus experience on learning outcomes what are some of the major themes that your research has turned up? Broken out by university/college type    
Are some groups of students faring much better than others in the new environment, defined by age, family situation, race, work status, income, academic major, or any other variable or characteristic? Broken out by university/college type    
Table 5.1 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions?    
Table 5.2 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by university/college type    
Table 5.3 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by Public or Private    
Table 5.4 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by enrollment    
Table 5.5 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by tuition, $    
What criteria has the college put in place for student placement of transfer and other incoming students in the absence of diagnostic testing? Broken out by university/college type    
Table 6.1 In light of the difficulty of staging actual classes, how confident are you in the effectiveness of preparatory measures that your college might take for students who do not immediately meet requirements in math, English or other core subjects?    
Table 6.2 In light of the difficulty of staging actual classes, how confident are you in the effectiveness of preparatory measures that your college might take for students who do not immediately meet requirements in math, English or other core subjects? Broken out by university/college type    
Table 6.3 In light of the difficulty of staging actual classes, how confident are you in the effectiveness of preparatory measures that your college might take for students who do not immediately meet requirements in math, English or other core subjects? Broken out by Public or Private    
Table 6.4 In light of the difficulty of staging actual classes, how confident are you in the effectiveness of preparatory measures that your college might take for students who do not immediately meet requirements in math, English or other core subjects? Broken out by enrollment    
Table 6.5 In light of the difficulty of staging actual classes, how confident are you in the effectiveness of preparatory measures that your college might take for students who do not immediately meet requirements in math, English or other core subjects? Broken out by tuition, $    
What has the college done post coronavirus epidemic inception to provide improve preparatory and remedial education online or through some other means? Broken out by university/college type    
Table 7 How involved are the following departments (or their equivalents) in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.1.1 How involved is the academic library department in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.1.2 How involved is the academic library department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by university/college type    
Table 7.1.3 How involved is the academic library department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by Public or Private    
Table 7.1.4 How involved is the academic library department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by enrollment    
Table 7.1.5 How involved is the academic library department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by tuition, $    
Table 7.2.1 How involved is the distance learning department in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.2.2 How involved is the distance learning department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by university/college type    
Table 7.2.3 How involved is the distance learning department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by Public or Private    
Table 7.2.4 How involved is the distance learning department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by enrollment    
Table 7.2.5 How involved is the distance learning department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by tuition, $    
Table 7.3.1 How involved is the finance and audits department in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.3.2 How involved is the finance and audits department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by university/college type    
Table 7.3.3 How involved is the finance and audits department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by Public or Private    
Table 7.3.4 How involved is the finance and audits department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by enrollment    
Table 7.3.5 How involved is the finance and audits department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by tuition, $    
Table 7.4.1 How involved is the student affairs department in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.4.2 How involved is the student affairs department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by university/college type    
Table 7.4.3 How involved is the student affairs department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by Public or Private    
Table 7.4.4 How involved is the student affairs department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by enrollment    
Table 7.4.5 How involved is the student affairs department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by tuition, $    
Table 7.5.1 How involved is the career services department in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.5.2 How involved is the career services department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by university/college type    
Table 7.5.3 How involved is the career services department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by Public or Private    
Table 7.5.4 How involved is the career services department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by enrollment    
Table 7.5.5 How involved is the career services department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by tuition, $    
Table 7.6.1 How involved is the academic advising department in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.6.2 How involved is the academic advising department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by university/college type    
Table 7.6.3 How involved is the academic advising department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by Public or Private    
Table 7.6.4 How involved is the academic advising department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by enrollment    
Table 7.6.5 How involved is the academic advising department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by tuition, $    
Table 7.7.1 How involved is the information technology department in your efforts to assess online learning or other foreseen new procedures necessary in the near future?    
Table 7.7.2 How involved is the information technology department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by university/college type    
Table 7.7.3 How involved is the information technology department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by Public or Private    
Table 7.7.4 How involved is the information technology department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by enrollment    
Table 7.7.5 How involved is the information technology department in your efforts to assess online learning or other foreseen new procedures necessary in the near future? Broken out by tuition, $    
Table 8 Which of the following technologies and practices have you evaluated in recent assessment efforts? (check all that apply)    
Table 8.1.1 Have you evaluated flipped classroom approaches in recent assessment efforts?    
Table 8.1.2 Have you evaluated flipped classroom approaches in recent assessment efforts?  Broken out by university/college type    
Table 8.1.3 Have you evaluated flipped classroom approaches in recent assessment efforts?  Broken out by Public or Private    
Table 8.1.4 Have you evaluated flipped classroom approaches in recent assessment efforts?  Broken out by enrollment    
Table 8.1.5 Have you evaluated flipped classroom approaches in recent assessment efforts?  Broken out by tuition, $    
Table 8.2.1 Have you evaluated use of machine-assessed, interactive video modules with modest or no instructor input in recent assessment efforts?    
Table 8.2.2 Have you evaluated using of machine-assessed, interactive video modules with modest or no instructor input in recent assessment efforts?  Broken out by university/college type    
Table 8.2.3 Have you evaluated using of machine-assessed, interactive video modules with modest or no instructor input in recent assessment efforts?  Broken out by Public or Private    
Table 8.2.4 Have you evaluated using of machine-assessed, interactive video modules with modest or no instructor input in recent assessment efforts?  Broken out by enrollment    
Table 8.2.5 Have you evaluated using of machine-assessed, interactive video modules with modest or no instructor input in recent assessment efforts?  Broken out by tuition, $    
Table 8.3.1 Have you evaluated artificial intelligence programs that diagnose gaps in knowledge and provide appropriate solutions in recent assessment efforts?    
Table 8.3.2 Have you evaluated artificial intelligence programs that diagnose gaps in knowledge and provide appropriate solutions in recent assessment efforts?  Broken out by university/college type    
Table 8.3.3 Have you evaluated the artificial intelligence programs that diagnose gaps in knowledge and provide appropriate solutions in recent assessment efforts?  Broken out by Public or Private    
Table 8.3.4 Have you evaluated the artificial intelligence programs that diagnose gaps in knowledge and provide appropriate solutions in recent assessment efforts?  Broken out by enrollment    
Table 8.3.5 Have you evaluated the artificial intelligence programs that diagnose gaps in knowledge and provide appropriate solutions in recent assessment efforts?  Broken out by tuition, $    
Table 8.4.1 Have you evaluated Zoom in recent assessment efforts?    
Table 8.4.2 Have you evaluated Zoom in recent assessment efforts?  Broken out by university/college type    
Table 8.4.3 Have you evaluated Zoom in recent assessment efforts?  Broken out by Public or Private    
Table 8.4.4 Have you evaluated Zoom in recent assessment efforts?  Broken out by enrollment    
Table 8.4.5 Have you evaluated Zoom in recent assessment efforts?  Broken out by tuition, $    
Table 8.5.1 Have you evaluated Skype in recent assessment efforts?    
Table 8.5.2 Have you evaluated Skype in recent assessment efforts?  Broken out by university/college type    
Table 8.5.3 Have you evaluated Skype in recent assessment efforts?  Broken out by Public or Private    
Table 8.5.4 Have you evaluated Skype in recent assessment efforts?  Broken out by enrollment    
Table 8.5.5 Have you evaluated Skype in recent assessment efforts?  Broken out by tuition, $    
Table 8.6.1 Have you evaluated WebEx in recent assessment efforts?    
Table 8.6.2 Have you evaluated WebEx in recent assessment efforts?  Broken out by university/college type    
Table 8.6.3 Have you evaluated WebEx in recent assessment efforts?  Broken out by Public or Private    
Table 8.6.4 Have you evaluated WebEx in recent assessment efforts?  Broken out by enrollment    
Table 8.6.5 Have you evaluated WebEx in recent assessment efforts?  Broken out by tuition, $    
Table 8.7.1 Have you evaluated Panopto in recent assessment efforts?    
Table 8.7.2 Have you evaluated Panopto in recent assessment efforts?  Broken out by university/college type    
Table 8.7.3 Have you evaluated Panopto in recent assessment efforts?  Broken out by Public or Private    
Table 8.7.4 Have you evaluated Panopto in recent assessment efforts?  Broken out by enrollment    
Table 8.7.5 Have you evaluated Panopto in recent assessment efforts?  Broken out by tuition, $    
Table 8.8.1 Have you evaluated online learning in recent assessment efforts?    
Table 8.8.2 Have you evaluated online learning in recent assessment efforts?  Broken out by university/college type    
Table 8.8.3 Have you evaluated online learning in recent assessment efforts?  Broken out by Public or Private    
Table 8.8.4 Have you evaluated online learning in recent assessment efforts?  Broken out by enrollment    
Table 8.8.5 Have you evaluated online learning in recent assessment efforts?  Broken out by tuition, $    
Table 8.9.1 Have you evaluated the splitting of large classes into many smaller groups in recent assessment efforts?    
Table 8.9.2 Have you evaluated the splitting of large classes into many smaller groups in recent assessment efforts?  Broken out by university/college type    
Table 8.9.3 Have you evaluated the splitting of large classes into many smaller groups in recent assessment efforts?  Broken out by Public or Private    
Table 8.9.4 Have you evaluated the splitting of large classes into many smaller groups in recent assessment efforts?  Broken out by enrollment    
Table 8.9.5 Have you evaluated the splitting of large classes into many smaller groups in recent assessment efforts?  Broken out by tuition, $    
Table 8.10.1 Have you evaluated hybrid distance/traditional classroom learning in recent assessment efforts?    
Table 8.10.2 Have you evaluated the hybrid distance/traditional classroom learning in recent assessment efforts?  Broken out by university/college type    
Table 8.10.3 Have you evaluated the hybrid distance/traditional classroom learning in recent assessment efforts?  Broken out by Public or Private    
Table 8.10.4 Have you evaluated the hybrid distance/traditional classroom learning in recent assessment efforts?  Broken out by enrollment    
Table 8.10.5 Have you evaluated the hybrid distance/traditional classroom learning in recent assessment efforts?  Broken out by tuition, $    
Table 9.1 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment?    
Table 9.2 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by university/college type    
Table 9.3 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by Public or Private    
Table 9.4 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by enrollment    
Table 9.5 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by tuition, $    
Many estimate that as many as 20% of currently enrolled students will not return for the fall semester 2020 at many colleges.  What is the role of the office of assessment in trying to ameliorate this situation? Broken out by university/college type    
Table 10 Approximately what percentage of the following group will the College interview. If none, please do not skip but put in "0".    
Table 10.1.1 What percentage of students do you interview who intend to transfer out of the college?    
Table 10.1.2 What percentage of students do you interview who intend to transfer out of the college? Broken out by university/college type    
Table 10.1.3 What percentage of students do you interview who intend to transfer out of the college? Broken out by Public or Private    
Table 10.1.4 What percentage of students do you interview who intend to transfer out of the college? Broken out by enrollment    
Table 10.1.5 What percentage of students do you interview who intend to transfer out of the college? Broken out by tuition, $    
Table 10.2.1 What percentage of students do you interview who say that they are unable to return for the fall semester?    
Table 10.2.2 What percentage of students do you interview who say that they are unable to return for the fall semester? Broken out by university/college type    
Table 10.2.3 What percentage of students do you interview who say that they are unable to return for the fall semester? Broken out by Public or Private    
Table 10.2.4 What percentage of students do you interview who say that they are unable to return for the fall semester? Broken out by enrollment    
Table 10.2.5 What percentage of students do you interview who say that they are unable to return for the fall semester? Broken out by tuition, $    
Provide some examples of instances when assessment procedures revealed program features that needed serious adjustment during the pandemic, how those adjustments were made, and what were the results? Broken out by university/college type    
Which colleges do you feel have developed particularly good assessment practices for higher education during the pandemic and can serve as role models for others? What do you like about what they do? Broken out by university/college type    
What do assessment officials have to do in the current difficult environment? Broken out by university/college type    

Samples

Sources / Contributors

• Alvin Community College
• Antioch College
• Champlain College St. Lambert, Quebec
• Colorado Technical University
• Doane University
• Florida Institute of Technology
• Garrett College
• Glendale Community College, AZ
• Hunter College, CUNY
• King University
• Meredith College
• Metropolitan Community College
• National Louis University
• Northern Michigan University
• Pittsburgh State University
• SCCC
• St. Edward's University
• St. Petersburg College
• Sullivan College of Pharmacy and Health Sciences
• Union Institute and University
• Union University
• University of Southern Maine
• University of Arkansas for Medical Sciences
• University of Hawai‘i at Mānoa
• University of Houston
• University of Illinois at Urbana-Champaign
• University of Louisiana at Lafayette
• University of Tennessee at Martin
• Western CT State University

Methodology