INCREASING SUCCESS IN DEVELOPMENTAL MATH:
In the October 2007 and January 2008 issues of The Learning MarketSpace, we described the Developmental Studies Redesign Initiative launched by the Tennessee Board of Regents (TBR) to reform its remedial and developmental math and English curriculum. Its goal is to develop and implement a more effective and efficient assessment and delivery system that will increase completion rates for students, reduce the amount of time that students spend in remedial and developmental courses, and decrease the amount of fiscal resources that students dedicate to remedial and developmental education.
Tennessee is not alone in dealing with the issues of remedial and developmental education. A September 2008 report “Diploma to Nowhere” (www.edin08.com/diplomatonowhere.aspx) issued by the advocacy group, Strong American Schools, estimates “conservatively” that 43% of students at two-year colleges and almost 30% of students enrolled in four-year public institutions nationwide have taken a remedial course, costing an annual $2.5 billion.
The TBR is partnering with NCAT to develop new delivery structures by building on the successful models and lessons learned from NCAT’s Program in Course Redesign. The new models will streamline course delivery, leverage new learning technologies, increase the quality of learning and reduce the cost of instruction. In order to address the problems identified by the TBR and its member institutions, it became clear early on that modularizing the curriculum would be a key strategy. The development of better placement systems combined with shorter, more tailored remedial and developmental modules would enable students to save time and money by only enrolling in the modules that address their deficiencies.
Preliminary results from the TBR initiative are very positive. In this article, we will focus on the achievements at Cleveland State Community College, a two-year institution in southeastern Tennessee. While many good things have happened in a very short time period in Tennessee (the six TBR redesign projects have piloted their redesign plans during spring and fall 2008), the scope and accomplishment of Cleveland State’s redesign are truly extraordinary.
Cleveland State Community College
Cleveland State Community College enrolls approximately 2,100 FTE and 3,100 headcount annually. The college is redesigning its developmental math program, which consists of three courses: Basic Math, Elementary Algebra and Intermediate Algebra. These courses have historically been offered primarily in a traditional lecture format, enrolling over 1200 students annually with ~200 students in Basic Math, ~500 students in Elementary Algebra, and ~500 students in Intermediate Algebra. Drop-Failure-Withdrawal (DFW) rates have averaged 45% in these courses. Elementary Algebra has presented the biggest obstacle to student success, often having DFW rates of more than 50%.
Cleveland State has redesigned these three math courses using the Emporium Model pioneered at Virginia Tech and replicated at many additional institutions. At CSCC, students meet one hour in class and two hours in a large computer lab. The one-hour class meetings are held in small labs (20 computers). Instructors do not lecture during class meetings. Instead, students work online and instructors help students individually. Instructors also review student progress and help students with their action plans for the coming week.
The large computer lab is available 54 hours per week to allow students to work at their convenience. The lab is staffed by instructors and peer tutors to provide individualized assistance to the students. The course material is organized into 10 to 12 modules, which students complete at the rate of one or more each week. All homework and testing is done online. Quizzes on each module can be re-taken multiple times until students display mastery. Students have the option of completing more than one module each week—i.e., they can move through each course at an accelerated pace. Students who complete a developmental math course before the end of the term are allowed to begin the next developmental course immediately.
The Impact of Redesign on Student Learning
As you read about these results, keep in mind that the first pilot of Cleveland State’s redesign occurred in spring 2008, only one year ago. Preparations for implementing the redesign occurred during summer and fall 2007. In addition, most NCAT redesigns focus on one course; Cleveland State simultaneously redesigned three developmental courses plus an additional three college-level courses. Finally, during this period Cleveland State experienced the usual start-up problems that occur with any large-scale redesign (technology glitches, registration problems, etc.) yet still produced outstanding results. This suggests that student achievement can increase even more as the redesign matures.
Student Learning Outcomes
Cleveland State assessed student learning outcomes by comparing common content items from selected departmental final exams administered in the traditional format during the previous five years to the redesigned sections in spring and fall 2008.
Course Completion Rates
Prior to the redesign, an average of 55% of students taking any developmental math course at Cleveland State earned a final grade of A. B or C. After the redesign during fall 2008, 72% earned an A, B or C, which represents a 31% increase in course completion rates.
The developmental math program consists of all three courses. Prior to the redesign, an average of 56% of students (N = 182) successfully exited the developmental math program. After the redesign during fall 2008, 268 students successfully exited the program, a 47% increase in moving students through developmental studies to college-level math courses.
Developmental Math Student Performance in College-Level Courses
One of the most important measures of success for any developmental math program is how well students perform in subsequent college-level math courses. Students at Cleveland State who took the redesigned developmental math courses primarily in spring 2008 were tracked to see how they performed in three college-level math courses during the fall semester.
The students who took the redesigned developmental math classes outperformed other students on every measure. Before the redesign, the completion rate of developmental students in college-level courses was 71% compared to a completion rate of 70% for other students. After the redesign, the completion rate of developmental students in college-level courses was 81% compared to a completion rate of 70% for other students. Redesign students also had higher average course grades (3.15 compared to 2.94). This is the first time developmental math students have done better than the other students at Cleveland State, and by a wide margin. These results suggest that the students exiting the redesigned developmental math program have been truly prepared to succeed in their college level math classes.
The increase in success cannot be attributed to “easier courses” as the overall success rates in the three college-level courses remained virtually unchanged at about 72% overall. In examining performance in the college-level courses individually, the Cleveland State team found that developmental math students performed equal to or better than the other students in each of the three courses. The developmental math students not only caught up to the other students in performance, but actually surpassed them.
Increased Student Success in College-Level Math Courses
Finally, the number of Cleveland State students enrolling in and passing a college-level math course during fall 2008 increased by 15% compared to the average of the past five years. During fall 2008, 281 of 391 students enrolled in and passed a college-level course vs. 245 of 340 students, the average of the previous five years. This is the result of higher enrollment in college-level courses rather than the result of higher passing rates, which overall remained at about 72%. This higher enrollment is due in large part to the increase in success rates in the developmental math program and the ability of students to exit the developmental math program and complete a college-level class in the same semester. More students completed Intermediate Algebra, the third course in the developmental sequence, in spring and summer 2008 than in previous years.
With a 47% increase in students exiting developmental math, the increase in enrollment in college-level courses should continue, and enrollment numbers for spring 2009 confirm this expectation. Enrollments in College Algebra, Introductory Statistics and Finite Math have increased from an average of 320 students in previous spring semesters to 480+ in the current term, an increase of approximately 50%.
Mobility within the Developmental Math Program
The traditional TBR developmental course sequence did not afford an opportunity for students to quickly get up to performance level in one stage so that they could move to the next stage sooner. Students were required to take an entire course even though they may have only been deficient in a portion of the topics. All students were required to learn at the same pace and with the same instructional strategies as the entire class.
Because learning in these skills-based courses occurs in specific increments and the time required to master each increment varies from person to person, the current three-course system lacked the flexibility that can lead to greater student success. Thus, an important goal of the TBR initiative was to allow students to start anywhere in the developmental course sequence based on their learning needs and progress though the content modules at their own pace, spending the amount of time needed to master the module content, proceeding at a faster pace if possible or at a slower pace if necessary.
At Cleveland State, students now have the option of completing more than one module each week—i.e., they can move through each course at an accelerated pace. Students who complete a developmental math course before the end of the term are allowed to begin the next developmental course immediately.
What has been the impact of this change at Cleveland State?
What’s Behind This Incredible Achievement?
Consistent with past successful NCAT redesigns in math, the Cleveland State team has identified a number of factors that have contributed to the success of their redesign project:
The Impact of Redesign on Reducing Costs
As of fall 2008, Cleveland State’s redesign has produced an annual savings of more than $50,000. This is a result largely of shifts in personnel as described below. Other savings include lower copying costs due to online homework and testing. This figure represents a significant savings for a department of eight faculty members and one staff member.
The primary goals of the redesign project were to increase success rates in the developmental math program, better prepare these students for success in college and increase the ability of students to move quickly through the developmental math program, removing the roadblocks to success. All of this was to be done with an eye towards producing actual cost savings. So far, the project has been an overwhelming success.
What about College-Level Math Courses?
During the same year, Cleveland State has also redesigned three college-level courses: College Algebra, Finite Math and Introductory Statistics. These redesigns have also achieved impressive results:
Cleveland State also plans to redesign three additional courses in spring 2009 and to implement those courses in fall 2009: Basic Calculus, Precalculus I and Precalculus II. Once these courses are offered under the new format, approximately 95% of the students at Cleveland State will be taking math courses in the redesigned format. John Squires, the project leader and math department chair, recognizes the advantages that can be realized when you look at department redesign as compared to course redesign. Economies of scale are more easily realized the bigger the redesign project is. Also, redefining faculty roles and duties as Cleveland State has done is easier to do when the entire department and most of its course offerings are involved in the redesign.
Implications for Others
Clearly the implications for colleges and universities around the country of the outcomes produced by Cleveland State are substantial. By putting students first and organizing their redesigns around the individual needs of students rather than the convenience of institutions, this pioneering institution is making a major contribution to improving the ways in which all of us help students prepare for college success and move more rapidly to degree completion.
I recently wrote to John Squires to congratulate him and his colleagues on their outstanding work. I said, “You guys are the poster children for how to do the right thing! You should be really proud.” John’s response: “Much of what we did is simply follow the NCAT playbook.”
That playbook is the product of the hard work and dedication of many, many extraordinary faculty and staff around the country that are showing the way to address one of our country’s most vexing academic problems. The message is simple: “Students learn math by doing math, not by listening to someone talk about doing math.”