{"id":100,"date":"2022-12-13T18:09:53","date_gmt":"2022-12-13T18:09:53","guid":{"rendered":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/?page_id=100"},"modified":"2024-07-26T15:35:14","modified_gmt":"2024-07-26T15:35:14","slug":"general-education-assessments-the-faculty-collaborative","status":"publish","type":"page","link":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/general-education-assessments-the-faculty-collaborative\/","title":{"rendered":"General Education Assessments &amp; the Faculty Collaborative"},"content":{"rendered":"<p>Austin Community College has six general education competencies\u2014the skills, attitudes, and behaviors that characterize the educated person. The competencies are taught in many different courses across the Core Curriculum, reflecting relationships across programs and between classes. As such, they help to shape the experiences of nearly every student.<\/p>\n<h2 class=\"wp-block-heading\">Six Education Competencies<\/h2>\n<h3 class=\"wp-block-heading\">Communication Skills<\/h3>\n<p>Develop, interpret, and express ideas and information through written, oral and visual communication that is adapted to purpose, structure, audience, and medium.<\/p>\n<h3 class=\"wp-block-heading\">Critical Thinking Skills<\/h3>\n<p>Gather, analyze, synthesize, evaluate and apply information for the purposes of innovation, inquiry, and creative thinking.<\/p>\n<h3 class=\"wp-block-heading\">Empirical and Quantitative Skills<\/h3>\n<p>Apply mathematical, logical and scientific principles and methods through the manipulation and analysis of numerical data or observable facts resulting in informed conclusions.<\/p>\n<h3 class=\"wp-block-heading\">Personal Responsibility<\/h3>\n<p>Identify and apply ethical principles and practices to decision-making by connecting choices, actions and consequences.<\/p>\n<h3 class=\"wp-block-heading\">Social Responsibility (Civic and Cultural Awareness)<\/h3>\n<p>Analyze differences and commonalities among peoples, ideas, aesthetic traditions, and cultural practices to include intercultural competence, knowledge of civic responsibility, and the ability to engage effectively in regional, national, and global communities.<\/p>\n<h3 class=\"wp-block-heading\">Teamwork<\/h3>\n<p>Consider different points of view to work collaboratively and effectively in pursuit of a shared purpose or goal.<\/p>\n<p>Meaningful assessment of these general education competencies promotes continuous improvement and helps guide faculty and staff in pursuing strategies to help students to succeed. Every competency should be assessed every year. Moreover, there is an expectation that the assessment data will be used to develop action plans, which will, in turn, be evaluated to determine their impact.<\/p>\n<p>At the same time, there is a critical need to not overburden faculty and department chairs with demands that are overwhelming. As such, the following schedule has been created to promote less frequent but more meaningful assessment, while simultaneously meeting the expectations of both SACSCOC and the Coordinating Board. Wherever possible and appropriate, disciplines may address two competencies with one assessment, e.g. a writing assignment that requires critical thinking.<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"486\" height=\"630\" src=\"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-content\/uploads\/sites\/14\/2023\/05\/Screen-Shot-2023-05-16-at-10.14.48-AM.png\" alt=\"\" class=\"wp-image-955\" style=\"width:486px;height:630px\" srcset=\"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-content\/uploads\/sites\/14\/2023\/05\/Screen-Shot-2023-05-16-at-10.14.48-AM.png 486w, https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-content\/uploads\/sites\/14\/2023\/05\/Screen-Shot-2023-05-16-at-10.14.48-AM-231x300.png 231w, https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-content\/uploads\/sites\/14\/2023\/05\/Screen-Shot-2023-05-16-at-10.14.48-AM-116x150.png 116w\" sizes=\"auto, (max-width: 486px) 100vw, 486px\" \/><figcaption class=\"wp-element-caption\"><sub>* courses that are co-requisites or cross-listed in another Component Area follow the requirements of those areas.&nbsp; Otherwise courses in the CAO address all competencies except for Empirical &amp; Quantitative Skills.  Green boxes are those in which every course in a given component area must address that competency.&nbsp; Gray-brown boxes are those in which at least half of the courses address that competency.&nbsp; White boxes indicate that relatively few courses in that component area address that competency.<\/sub><\/figcaption><\/figure>\n<\/div>\n<p>The chart in the assessment schedule document above illustrates which general education competencies are taught in which areas and the years that they are assessed<em>.<\/em>  The three years of assessment are labeled, respectively, \u201c1,\u201d \u201c2,\u201d or \u201c3.\u201d Courses in each component area will assess the stated competencies in the designated year if they teach them. For example, in Year 1, every discipline that addresses Critical Thinking and Communication (i.e., everyone) should assess these competencies.&nbsp; In Year 2, disciplines teaching Empirical &amp; Quantitative Skills or Personal Responsibility will assess those.&nbsp;In Year 3, disciplines assessing Social Responsibility and\/or Teamwork will assess those competencies.&nbsp;<\/p>\n<p>In each case, only those courses in which the designated competency is identified as being addressed will be expected to assess it. So, for example, only those courses in the Life &amp; Physical Science that teach Social Responsibility will be expected to assess it in Year 3.<\/p>\n<\/p>\n<p><a href=\"https:\/\/drive.google.com\/file\/d\/1-3UaIC4CW6QzvY77dNlQ0sT0UTr1J9BL\/view?usp=sharing\">General Education Competency Assessment Schedule<\/a><\/p>\n<h2 class=\"wp-block-heading\">Faculty Collaborative FAQ<\/h2>\n<p><div class=\"list\"><p class=\"trigger\"><a href=\"#\">What is the Faculty Collaborative?<\/a><\/p><div class=\"toggle_container\"><div class=\"block\"><\/p>\n<p>ACC has a set of general education competencies, developed by our faculty, addressing what we expect all of our graduates to know, think, or be able to do. Many other schools have similar, broad learning outcomes regarding communication, critical thinking, and other skills that are expected of any educated person.<\/p>\n<p>Beginning in 2014, the American Association of Colleges &amp; Universities (AAC&amp;U) partnered with the Bill &amp; Melinda Gates Foundation, the State Higher Education Executive Officers&#8217; association (SHEEO), twelve state higher education systems, and 88 two- and four-year public schools to create the Multistate Collaborative to Advance Learning Outcomes Assessment (MSC). In brief, this effort collected student artifacts, ties them to demographic information, and has them evaluated by trained faculty reviewers using the <a href=\"https:\/\/www.aacu.org\/value-rubrics\" target=\"_blank\" rel=\"noreferrer noopener\">VALUE rubrics<\/a> developed by the National Institute for Learning Outcomes Assessment. By pooling student work from multiple courses and colleges and having them reviewed by trained individuals using the same criteria, meaningful results regarding students\u2019 performance were obtained for each campus and compared to that at other institutions.<\/p>\n<p>The Faculty Collaborative being implemented here at ACC remains an internal process but follows these same guidelines. Student work, also referred to as artifacts, is collected through the BlackBoard assignments tool and is randomly collected from multiple Core Curriculum courses and campuses. Trained faculty reviewers on the Assessment Task Force (ATF) score these artifacts using a common rubric. Because the student work is tied to the students\u2019 ACCeIDs, this approach allows the disaggregation of data to identify any potential patterns associated with ethnicity, gender, credit hour completion, or other demographic parameters. Identifying such patterns is the necessary first step to addressing concerns about equity and directing resources for improvement.<\/p>\n<p><\/div><\/div><\/div><\/p>\n<p><div class=\"list\"><p class=\"trigger\"><a href=\"#\">Why is this necessary?<\/a><\/p><div class=\"toggle_container\"><div class=\"block\"><\/p>\n<p>Fundamentally, the Faculty Collaborative is important for the same reasons as any assessment that we give our students: we want to determine what they know and identify any areas with which they struggle.<\/p>\n<p>But determining the extent to which students have achieved the general education competencies has been a challenge for every institution of higher education. Standardized tests are one option, but their expense, the problems of their administration, the lack of faculty control, and the way in which such assessments have been abused often make them a poor choice. Embedded assessments in the classroom are another approach, and one that is currently followed here at ACC. But such assessments usually (and appropriately enough) focus on course or program learning outcomes much more than general education. In addition, they are typically given only in a single course or even single section and do not usually provide a large enough sample to draw any meaningful conclusions regarding the performance of particular populations. ACC\u2019s <a href=\"https:\/\/www.austincc.edu\/business-community\/strategic-plan\" target=\"_blank\" rel=\"noreferrer noopener\">strategic plan<\/a> and <a href=\"https:\/\/www.austincc.edu\/provost\/academic-master-plan\" target=\"_blank\" rel=\"noreferrer noopener\">academic master plan<\/a> revolve around equity, and ACC was the first community college in the country to be chosen as a site for a <a href=\"https:\/\/students.austincc.edu\/truth-racial-healing-and-transformation-center\/\">Truth, Racial Healing &amp; Transformation (TRHT) Campus Center<\/a> by the Association of American Colleges and Universities. But the first step in addressing concerns is identifying where the inequities lie.&nbsp;Only then can plans be made and resources directed for improvement in order to create more equitable outcomes.<\/p>\n<p><\/div><\/div><\/div><\/p>\n<p><div class=\"list\"><p class=\"trigger\"><a href=\"#\">As a faculty member, what do I have to do?<\/a><\/p><div class=\"toggle_container\"><div class=\"block\"><\/p>\n<p>The general education competencies are taught in all Core Curriculum courses, and faculty teaching sections of those courses should identify at least one assignment that addresses one or more relevant general education competencies. A selected assignment does not need to address every competency; indeed, depending on the component area of the Core Curriculum to which they belong, courses themselves are only expected to address certain competencies. Life &amp; Physical Science courses, for example, are only expected to assess Communication, Critical Thinking Skills, Empirical &amp; Quantitative Skills, and Teamwork. A complete list of which areas address which competencies can be found in the General Education Assessment Schedule earlier on this page.<\/p>\n<p>Faculty teaching Core Curriculum courses are expected to \u201ctag\u201d one or more assignments in BlackBoard each semester, following the procedure outlined here. Since some general education competencies are taught in virtually every course, faculty teaching other courses are also encouraged to tag relevant assignments. Note that only the assignment itself needs to be tagged, not each piece of student work. If you are not sure if an assignment should be tied to a particular competency, then it is probably best not to do so.<\/p>\n<p>Once the assignment is tagged, it is eligible to become part of the random sample scored by the faculty reviewers. Once the assignment is tagged to the relevant competencies, which should take only a few minutes, the faculty member\u2019s work is done (as far as the faculty collaborative is concerned \u2013 obviously, our work as faculty never stops).<\/p>\n<p><\/div><\/div><\/div><\/p>\n<p><div class=\"list\"><p class=\"trigger\"><a href=\"#\">How does this affect my grading and academic freedom?<\/a><\/p><div class=\"toggle_container\"><div class=\"block\"><\/p>\n<p>In brief, it doesn\u2019t affect anything on the classroom side at all. The artifacts selected by the system to become part of the sample are copied into a database and randomly assigned to the reviewers. The reviewers score the artifacts in accordance with the general education rubric, completely independently of how the faculty member themselves graded the assignment. The student\u2019s work remains in your course shell, undisturbed.<\/p>\n<p>Some artifacts must meet general criteria to be suitable for scoring, depending on the competency being measured. For example, essays used to evaluate Written Communication should be at least 750 words in length, those used to measure Critical Thinking should have some critical analysis of a topic or position, etc. Any such requirements will be communicated to the department chairs and Assistant Deans of Assessment.<\/p>\n<p><\/div><\/div><\/div><\/p>\n<p><div class=\"list\"><p class=\"trigger\"><a href=\"#\">What about FERPA and student privacy?<\/a><\/p><div class=\"toggle_container\"><div class=\"block\"><\/p>\n<p><strong>&nbsp;<\/strong>FERPA allows the sharing of student work for educational purposes, and the Faculty Collaborative certainly qualifies in this regard. This same approach has been implemented at numerous colleges and universities and received approval from their respective institutional review boards that oversee research on human subjects. This initiative was submitted for review to ACC\u2019s Institutional Research Review Committee, which likewise gave its approval.<\/p>\n<p>Given the scope of the collaborative and a variety of technical hurdles, it is not feasible to redact any identifying information on the student work itself; names, course numbers, and other the like may well be on the artifacts being reviewed. Nevertheless, the individuals doing the scoring are all ACC employees and we all share a professionalism and an obligation to maintain student academic privacy. In addition, given the size of our institution, it is highly unlikely that a reviewer would know a particular student whose work they are scoring (or, in many cases, even the faculty member in whose class it was submitted).<\/p>\n<p><\/div><\/div><\/div><\/p>\n<p><div class=\"list\"><p class=\"trigger\"><a href=\"#\">What if a student of mine is scored poorly? Won\u2019t that reflect badly on me?<\/a><\/p><div class=\"toggle_container\"><div class=\"block\"><\/p>\n<p>In all honesty, no. Some students will succeed no matter what we do, while others will fail despite our best efforts. The focus of this approach is on the students as individuals, and discerning patterns correlated to student characteristics. The course from which the student work was collected is, frankly, irrelevant. The focus is solely on scoring each student\u2019s work as appropriately as possible.<\/p>\n<p><\/div><\/div><\/div><\/p>\n<p><div class=\"list\"><p class=\"trigger\"><a href=\"#\">How do I actually tag an assignment?<\/a><\/p><div class=\"toggle_container\"><div class=\"block\"><\/p>\n<p>Following is a step-by-step guide for tagging an assignment:<\/p>\n<p><a href=\"https:\/\/drive.google.com\/file\/d\/1BS1MHMfzcW_DYXWvMxvrEhsGCJekM0Ra\/view?usp=sharing\" target=\"_blank\" rel=\"noreferrer noopener\">How to Tag an Assignment in BlackBoard for the Faculty Collaborative<\/a><\/p>\n<p>This brief video explains the process step-by-step, including some background information:<\/p>\n<p><a href=\"https:\/\/drive.google.com\/file\/d\/1AQxldg_zMVWe9BLkplbKah_03u0ArAYd\/view?usp=sharing\" target=\"_blank\" rel=\"noreferrer noopener\">Tagging an Assignment: The Movie<\/a><\/p>\n<p>The most important part is from 4:18 to 6:18.<\/p>\n<p><\/div><\/div><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Austin Community College has six general education competencies\u2014the skills, attitudes, and behaviors that characterize the educated person. The competencies are taught in many different courses across the Core Curriculum, reflecting relationships across programs and between &hellip; <a href=\"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/general-education-assessments-the-faculty-collaborative\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-100","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-json\/wp\/v2\/pages\/100","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-json\/wp\/v2\/comments?post=100"}],"version-history":[{"count":0,"href":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-json\/wp\/v2\/pages\/100\/revisions"}],"wp:attachment":[{"href":"https:\/\/offices.austincc.edu\/institutional-effectiveness-and-grant-development\/wp-json\/wp\/v2\/media?parent=100"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}