Saturday, October 27, 2007

Group #2 Roundtable: Assessment and Discounted Dreams

What did the film Discounted Dreams say about assessment?

  • 50% of students fail to graduate from Community Colleges (Institutional assessment)
  • 45% pass rate on remedial math (Departmental assessment–course specific)
  • 2/3 of the Community College student population who wishes to transfer does not

    What do we do at CCP already with assessment?

  • Institutional Research is done (i.e., but data appears to be disconnected from course, departments’ and instructors’ daily activities)
  • Departments and/or Programs build their own efforts of assessment for better student outcomes (i.e., at the student level: entering and exiting student interviews provide useful feedback for course/program changes; at the instructor level: evaluation of Instructor performance–a rather sensitive topic-is a form of assessment when done well–each dept./program uses different approaches for peer evaluation and sensitivity comes into place in terms of reliability of the instrument used as well as biases and differentiation in evaluation when more than one instructor is asked to evaluate classes)
  • Sharing information on teaching practices among colleagues (i.e., use of assessment techniques in classroom–questions at the end of a class to see if students have learned new material; comprehension checks throughout presentation of new material; class-transitions, especially in the beginning of the class to activate schemata; games at the end of class where students [in groups] test each other on new material, etc.)
  • Curriculum Facilitation work (doesn’t really reach all Faculty)

    What have we learned from these efforts?

  • Overall, CCP is doing a lot with assessment as stated in #2; however, those efforts appear to be disconnected.

    What more do we need to do?

  • to serve best the students, CCP needs to find out reasons for which students take courses; orient students –in terms of time management and organizational skills as well as student learning styles;
  • provide students with ease of getting information as to where they need to go for different types of information
  • (more) assessment needs to be done on a course/class basis
    need to work more closely with high schools to target students left behind in material, especially with core courses (English/Math)

    How can we accomplish the "more" that we need to do?

  • Develop a well-thought orientation session (in-session and/or on-line) for students coming into the school where time management skills and student learning styles are addressed.
  • Provide some form of certification that ensures that students have taken this orientation session prior to taking courses at CCP.
  • Implement (again?) the old system of “asterisk” next to students’ names on class lists to inform instructors about student activity regarding how often they have attempted to take the course. That will give the Instructor the opportunity to open a dialog with students who may have problems with the respective courses.
  • More Instructor training is needed on teaching vs. learning styles especially for targeted courses (Math/English)

  • Group #1 Roundtable: Assessment and Discounted Dreams

    Professional Development Day - October 8, 2007
    Facilitator: Dawn Sinnott
    Recorder: Greg Bovasso

    The group, which was composed mostly of art department faculty was not familiar with the assessment plan, and so the facilitator described the plan. The group seemed to agree that assessment of student learning was critical to academic success at various organizational levels (e.g., courses, curricula, etc.).

    The group discussed the various methods of teaching and assessment depicted in the film shown prior to the session. The role of assessment in designating remediation for students was particularly notable, and the importance of assessment in serving a ‘gatekeeping” function was noted as having benefits, as well as costs, such as increased attrition. The group discussed the importance of creating a sense of social support in academic programs to reduce attrition. Active learning approaches, such as those depicted in the film and used by discussants in their classes were also seen as critical to student success. In addition, the use of art critiques was discussed as a method of teaching that employs assessment as part of the learning process in the classroom. Such techniques prevent the kind of non-participation and attrition by students shown in the film.

    The group discussed assessment as a collaborative process between students and faculty, as well as among faculty, such as when all art department faculty evaluate the portfolio of a single student majoring in art. The group noted that different performance criteria were employed in these assessments, though the goals and process of assessment were uniform. The content of assessment was determined by the skills needed for successful transfer, as defined by the transfer institution. Classroom projects that build these competencies through continuous formative assessments (e.g., ‘critiques’), and portfolio evaluations assess these competencies. Students are given continuous feedback in classes and in mid semester reviews to assure that they meet the program objectives evaluated in portfolio reviews. Students can also compare their work with that of other students in this process.

    Some of the competencies required to enter classes include skills learned in English classes given the importance of writing in art history classes and verbal skills in studio class critiques. Faculty described accommodations they make in classroom practices to remediate deficient skills in students. The faculty collaborate with the Architecture department in coordinating competencies and their assessments.

    The group agreed that the CCP assessment system resulted in students with a wide variety of basic skills being enrolled in their classes, and that a wide variety of learning outcomes resulted from this assessment process. Much remediation takes place in college-level courses.

    The most notable kind of formative assessment at CCP was the designation of students at remedial levels based on testing of their reading, writing and match skills. The completion of the first academic year was also viewed as a kind of formative assessment. Course-level evaluations also were viewed as providing clear feedback to students based on explicit objectives. However, assessment accommodates different student goals by applying a uniform assessment process to all students, but different standards based on students’ differing goals.

    The facilitator described the assessment model proposed by the assessment task force as one requiring a feedback loop to improve teaching processes based on assessment. She also described the five competencies at the course level which would be assessed across the curriculum in the model proposed by the assessment task force. This approach was differentiated from the ‘dimensions’ model proposed for the General Education curriculum, and tied to measurable competencies rather than general values. The competency of ‘information literacy’ was clarified, and seen as needing expansion beyond information technology. All courses were seen as developing the five competencies to different degrees but more communication across departments on these competencies was seen as being needed, particularly regarding the implementation of their assessment. Departments may differ widely on their definition of each competency and its assessment to the degree that these competencies would not be truly universal. All agreed that such competencies should not be dictated to a department because this would obstruct the teaching of competencies that a department regards as most valuable, and lead to “teaching to the test” to satisfy organizational requirements at the expense of education. All agreed that such assessments of common competencies cannot be used to evaluate departments or curricula, only individual students. Some believed that exit criteria for evaluating student learning outcomes differ by student based on individual academic goals (e.g., major vs. non-majors), and cannot be generalized across curricula, or even within curricula. A department may have common goals and assessments, but apply different standards of evaluation depending on students’ various academic goals.

    The advising process was seen as critical to ensuring that students were directed to meet their personal academic goals rather than institutional goals (e.g., degree requirements) which may not match their goals. The example of the student depicted in the film who repeatedly failed math was discussed as an example of a failed advising process. The importance of advising students to meet true educational goals (e.g., understanding math) rather than just credentialing goals (passing remedial math) was discussed. The system of portfolio evaluation was also seen as a method of providing students with feedback on how well they meet educational goals.