Research & Teaching
An Interdisciplinary Problem-Solving Program
Journal of College Science Teaching—January/February 2022 (Volume 51, Issue 3)
By Stephanie Purington and Martina Nieswandt
Business leaders and researchers (e.g., Savery, 2006) have discussed the discrepancy between the skills of the current U.S. workforce, particularly in STEM fields, and the technical and 21st-century skills necessary to remain globally competitive. The top three 21st-century skills that human resource professionals have identified as weak or missing in the current workforce include problem-solving, critical thinking, and being innovative; an ability to deal with complexity and ambiguity; and an ability to communicate to various audiences through various media (Society for Human Resource Management, 2019). A study on STEM undergraduate experiences (National Academies of Sciences, Engineering, and Medicine, 2016) came to similar findings: Students graduating with STEM degrees lack the combination of technical and employable skills needed to succeed in the workplace. The study stresses “the growing need for students with a breadth of skills outside of their core STEM discipline . . . these include problem-solving, critical thinking, teamwork and collaboration, communication, and creativity” (National Academies of Sciences, Engineering, and Medicine, 2016, p. 2). The Integrated Concentration in Science (iCons) program at the University of Massachusetts Amherst is a 4-year, interdisciplinary program for STEM majors that aims to develop such 21st-century skills and prepare the next generation of STEM leaders “with the attitudes, knowledge, and skills needed to solve the inherently multi-faceted problems facing our world” (University of Massachusetts Amherst, n.d.).
Students with a STEM major can apply for iCons during their first year. Currently in its tenth year, iCons offers students the opportunity to address current issues in renewable energy and sustainability or biomedicine and biosystems through team-based projects.
iCons builds on the Process Oriented Guided Inquiry Learning (POGIL) model. POGIL classes are problem-based, feature learning teams with a defined team structure through assigned student roles and a learning cycle, value reflection and self-assessment, and position instructors as guides instead of directors (Hanson, 2006). In contrast to the more teacher-directed POGIL classes, iCons classes stress student-centered and student-directed team activities. Students define problems, objectives, and standards (Capon & Kuhn, 2004; Blumenfeld et al., 1991) and structure their teams in ways that work best for their tasks. A key goal of the iCons program is to make the courses as minimally predetermined as possible (Wass & Golding, 2014; Schmidt et al., 2007) while providing appropriate scaffolding depending on students’ needs. The first 2 years of iCons are foundational, centered on building 21st-century skills such as teamwork and collaboration, problem-solving, and communication while working on global challenges. Years 3 and 4 stress integrative and interdisciplinary experience in STEM research laboratories and a yearlong research-based project.
This study takes a closer look at iCons pedagogy to develop 21st-century skills during students’ first 2 years to assess whether there are discrepancies between the intended pedagogical approaches and the approaches that were actually implemented. Because iCons stresses student-directed activities, this study also investigates how students perceive the program’s pedagogy.
iCons semester-long courses are taught by faculty from STEM disciplines (e.g., biology, chemistry, environmental conservation, and physics). Faculty interested and experienced in student-directed projects are invited to teach in iCons. New faculty are paired with experienced iCons faculty for training, as they co-teach classes to both maintain and evolve the student-directed nature of the courses. Furthermore, regular program meetings allow faculty across all iCons courses to collaborate and focus on sequencing course goals and activities.
Students in all STEM majors receive information about iCons in their first-year STEM courses and at face-to-face information sessions in early fall. The iCons application is a two-step selection process evaluating students’ match to the program’s goals; a written application with essay questions pertaining to a student’s interest in collaboration and problem-solving determines who will be invited for an interview with program faculty. The interview establishes students’ potential to successfully complete iCons based on iCons goals. A maximum of 60 students are admitted to the program each year, with an attempt to balance gender and area of interest across STEM disciplines.
The first-year course (i1) aims to develop collaboration skills. Students work in interdisciplinary teams on global challenges, presented as real-world case studies, that have multiple scientific solutions. For example, students (a) work on a case on antibiotic resistance that they choose during their first class meetings; (b) model the spread of the Zika virus, an instructor-chosen case that allows for adaptation of a mathematical model; (c) focus on a case designed to utilize a given scientific instrument, such as a mass spectrometer; and (d) generate inception material for a new case of their choosing, such as hive collapse, which they then present at a public poster session. Students are placed into new collaborative groups for each of the 3-week-long cases, with an attempt to balance gender and academic focus. Each case study is graded based on student- and instructor-developed rubrics that include criteria for process, product, and student reflection on collaboration and problem-solving. After the first year, students choose whether they will pursue the renewable energy track (i2e) or the biomedicine/biosystems track (i2b).
The second-year course (i2) promotes scientific communication and expands students’ collaboration skills developed in the first year. Students select three communication goals for the semester (see Figure 1) and work toward achieving these goals in all their course products. The first half of the semester focuses on boosting communication skills. Students produce career-oriented documents such as résumés and personal statements; practice writing summaries, abstracts, critiques, and research reports from journal articles provided by the instructors (on topics such as carbon capture in i2e and different microbiomes in i2b); and create one-slide “pitches” to describe the problem they are studying. In the second half of the semester, students working in teams practice and deepen their communication skills by writing a proposal for collaborative projects appropriate to the course topic and designing slides and posters for talks about their projects. Teams are formed based on interest, though instructors encourage balancing majors and skills of team members. A culminating experience in i2e is a public debate between teams to argue for the best project, as determined by an audience vote; in i2b, the culminating experience is a public poster presentation of students’ projects. In both classes, significant feedback is given for all written and oral work, both from peers and instructors, using rubrics that students and instructors design collaboratively. At the end of the term, students write a persuasive essay describing how they met their communication goals using specific examples from their writing or oral presentations as evidence. Final grades are based on the degree to which they met each of the learning goals (Figure 1).
This study addresses two research questions about iCons pedagogy during the program’s first two courses:
To answer these questions, we utilized a convergent parallel mixed-methods design (Creswell & Clark, 2017), collecting quantitative data (student surveys for Research Question 2) and qualitative data (observations, interviews, and open-response survey questions for Research Questions 1 and 2) in parallel.
To answer Research Question 1, instructors of both courses (N = 5) were interviewed at the start of the course to determine their intended pedagogical approaches; observations were also conducted in two iCons 1 sessions, and all iCons 2 sessions. Because we were unable to observe all iCons 1 sessions, we interviewed three iCons 1 students to assess how the pedagogy intended by the instructors was actually implemented. The students were the only volunteers available at the time of the scheduled interview.
Each class session was 75 minutes. Observations focused on activities that took place in each class session and the types of interactions faculty had with students, especially noting the questions students asked.
To answer Research Question 2, students from both courses (iCons 1: N = 34; iCons 2: N = 33) were surveyed in the first and last class meetings, and six students (three from each year) were interviewed at the end of the semester. The i1 students were those we had interviewed to answer Research Question 1, and the i2 students were randomly selected from those who volunteered to a request for interviews. The survey, adapted from So and Brush (2008), included seven learning and seven collaboration items [α(Learning) = .85 and α(Collaboration) = .72] on a 5-point Likert scale (from strongly disagree to strongly agree), as well as four open-response questions asking about perceived learning outcomes and expectations (Figure 2).
Data were analyzed both statistically and qualitatively. For the qualitative data generated from the open-response questions, open coding was used to reflect how answers addressed the research questions (Strauss, 1990). Codes were organized into categories that allowed finding commonalities among responses. Interview responses were coded using predetermined codes focusing on pedagogy and collaboration.
For the Likert-scale survey items, a confirmatory factor analysis determined that items from each scale were well correlated and aligned with So and Brush’s (2008) findings [α(Learning) = .855; α (Collaboration) = .826]. Two-sample and paired-sample t-tests were used to compare the Learning and Collaboration data from iCons 1 and iCons 2 and the pre- and post-course responses.
The interviews revealed that all three iCons 1 instructors saw their role as introducing students to the structure and philosophy of the program and guiding students to ask questions and learn ways to find answers themselves. They saw this as different from the normal lecture format the students encountered in other courses. One iCons 1 instructor stated, “They have to come up with the ideas and go find out for themselves. What they learn will diverge and will differ by what they choose to research.” Similarly, both iCons 2 instructors stressed that they do not provide students with problems to solve “because once you provide examples, it’s virtually impossible for students to scrub them from their minds and all of their questions will just be small variations on the examples.” Instructors emphasized providing an external support structure as needed (e.g., asking questions, pointing to contradictions, or sharing strong and weak examples of professional writing genres), but one i2 instructor noted that he did not want to start by “building students a ladder,” as they would then never have the chance to “learn how to jump” to reach goals: “If you never ask a student to do what they cannot do, they never learn what they can do.”
According to the three students interviewed at the end of iCons 1, the instructors implemented student-directed learning. Interview and observation data confirmed that class time was generally dedicated to class discussions, teamwork, and student presentations. Only occasionally did instructors include short lectures on methodology-specific topics such as a Zika-modeling spreadsheet or certain statistical analyses. As intended, instructors provided some background information to the whole class on a problem, and the teams chose which aspect of the problem to address and how to address it. Observation data showed that this teaching approach, minimizing lecture and maximizing student-to-student interaction, was also implemented in iCons 2 classes, where students proposed and selected topics and then worked on them in teams.
All interviewed iCons 1 students agreed that the course had a student-directed approach. While the students reported that it sometimes left them “floundering,” they felt that they and their peers rose to the occasion. As one student noted, the “floundering” was “where a lot of the learning took place.” The interviewed students reported patterns that confirmed what instructors intended. For example, students noted that when they asked for help, the instructors did not give them an answer but instead asked questions that helped them refine or shift their thinking. Direct answers were occasionally provided around a more technical question, such as in the modeling project.
Along with the positive feedback about and appreciation of the student-centered teaching approach, iCons 1 students mentioned a couple of areas in which they would have liked more support. For example, they wished there had been more scheduled check-ins, where faculty helped the team evaluate their plan and progress, at the beginning of the semester, since they were working on their first problem. Speaking for the class, the interviewees pointed out that some groups were reluctant to ask for such meetings, though they felt they needed more guidance. While students understood that instructors did not want to give overly specific criteria, students wanted more explicit directions and criteria for the project presentations and products to avoid feeling that there were hidden expectations that might impact their grades in the course.
Observations showed that iCons 2 instructors made expectations for the products clear and made their strategies explicit to students. For example, instructors stressed that they purposefully selected sample documents or presentations that demonstrated both strong and weak aspects of the genre to spark discussions and help students identify and distinguish good products from weak ones. To increase students’ ability to evaluate their own and each other’s work, students and instructors worked together to develop assessment rubrics for each written assignment or presentation type. Students first brainstormed possible evaluation criteria for each section of a document (e.g., abstract, introduction, etc.), and then, with the instructor’s guidance, refined those criteria and created appropriate rubrics. Both instructors and students used these rubrics to assess their work (e.g., abstracts, project proposals, presentations). Because students assessed each other’s work at first more positively than the instructors felt was merited, instructors discussed with students the need for honest critique and reflection, which resulted in improved student feedback over the semester; however, students’ feedback never fully aligned with instructor feedback.
Observations confirmed the student-directed nature of planned activities. Throughout the semester, iCons 2 students were given many opportunities to decide on topics and activities. For example, students in the renewable energy course chose a debate for their final activity and decided on the debate question and rules. While students in the biomedicine course were assigned a poster presentation for their final product, they developed criteria for evaluating each other’s posters and conducted peer review and feedback sessions before the final presentations.
In summary, observations and interviews indicated that the iCons instructors in both levels of the course implemented the curriculum in the ways they had intended. They offered suggestions and questions instead of direct instruction, and i2 instructors provided examples for discussions about the structure of research projects and written work rather than exemplars to be followed for assignments.
How the students understood and perceived the planned and implemented curriculum was the focus of Research Question 2. To explore that question, we compared the students’ learning goals with their self-reported outcomes and asked students how satisfied they expected to be and actually were with their learning and collaboration in iCons.
In the open-response section of the surveys, students were asked to describe what they wanted to learn in the iCons course. The most popular learning goals for iCons 1 students (N = 34) were working on real-world global issues (44%), collaboration and teamwork (41%), problem-solving (29%), and learning to work with multiple perspectives (26%), followed by critical and creative thinking (20%) and expanding their knowledge (15%), as seen in feedback from one i1 student: “I wish to learn how to address real-world problems and utilize scientific solutions to achieve impactful change. I wish to learn from engaged and enthusiastic peers whose unique and varied perspectives and specialties will help me to attack problems from as many angles as possible.”
For iCons 2 students (N = 33), communication (72%) and expanding their knowledge (48%) were the top learning goals, along with collaboration (18%) and problem-solving (18%), as reflected in a comment from one i2b student: “I want to learn how to articulate my ideas and plans in a clear manner. I want to learn how to continue collaborating with others even if we have opposing views. I want to learn more about the field of biomedicine and the careers it impacts. I want to learn how to make a difference.”
Students from both years gave similar answers to the question of how they planned to meet their own learning goals: More than half of all the respondents named participation and engagement, especially in discussion (52%); using peers as resources through collaboration (51%); and putting in the time to do the required work (52%). One-third of iCons 1 students also identified listening to others’ points of view as a path to meeting their learning goals: “[L]istening to my peers, helping them, and letting them help me will take me far.”
When asked what kind of support they expected from their iCons instructors to help them meet their learning goals, the responses were largely similar for both courses, with a few points of divergence. iCons 1 students (N = 34) acknowledged the planned student-directed nature of the course, and most embraced it. They wanted their instructors to provide guidance and advice (67%) but not “hand-holding.” They also identified independence (32%) as something they wanted the instructors to give them, along with providing resources (11%) and facilitating discussion (17%). One i1student stated, “I expect my iCons instructor to help point me in the right direction and help with any questions I may have, but for the most part I expect to work independent of the iCons instructors.”
iCons 2 students (N = 33) also identified expectations that were coded under the category of guidance as a primary type of instructor support (48%), along with constructive feedback (30%) and being understanding about workload (21%). Direct instruction and delivery of information were also selected by some of the iCons 2 students (24%), likely in response to the skills-oriented communication focus of the course. One of the i2e students wrote, “iCons is a course known for perhaps a ‘lack’ of instructor support. However, a guiding hand and an instructor that encourages ideas would be beneficial in this course.”
Students completed Likert-scale survey items on their expectations for the course during their first meeting, as well as items to measure their overall satisfaction with their learning and the collaborative aspects of the class during their last meeting (Table 1). The post-survey results of the learning and collaboration scales show that students in both courses were satisfied with their learning and their collaborative experiences (Table 1).
Though students generally were satisfied with their learning and collaboration experiences, a paired-sample t-test indicated there was a small but significant decrease in the Learning scale mean from the pre-course (4.36) to the post-course (4.15) survey (p < .01). There was no significant difference in the Collaboration scale mean (pre-course = 4.38, post-course = 4.33, p = .388). Comparing the two levels of the course using a two-sample t-test, iCons 1 students had higher pre-course ratings for both Learning (i1 = 4.54, i2 = 4.17, p < .01) and Collaboration (i1 = 4.50, i2 = 4.27, p = .02) but post-course, only the Learning items showed a significant difference (i1 = 4.29, i2 = 4.00, p = .03).
When asked what they had learned in the course (end-of-course open-response item; Figure 2), students from both courses identified working effectively in teams as a primary outcome (iCons 1 = 74%; iCons 2 = 36%), followed by communication (18%) and problem-solving (15%). iCons 2 students also identified presentation skills as a notable area of learning (73%).
End-of-year surveys provided evidence that instructors had taught in the manner expected and that students were satisfied with the student-directed nature of the courses. When asked about the support they had received to meet their learning goals, most responses (68%) from all three sections identified feedback, critique, and guidance. Some students (9%) mentioned that information or help was given if a student or group was “stuck,” but that independence to pursue projects was the norm (13%), as reflected in an iCons 1 student comment: “It seems to me that the goal of the course is for the students to be as independent as possible without being totally unstructured and I think the instructors do a good job of this by making us set our own goals and standards at the beginning of each case study. This allows us to be realistic in our expectations for ourselves but also lets us pursue ideas that perhaps would not have fit if we had concrete guidelines laid out for us in advance.”
Talking about the feedback offered by instructors, one i2e student said: “The iCons instructors provided a lot of helpful feedback and tips for ways of improvement. I really like constructive criticism. I’d rather have someone nitpick at my project than say, ‘Yeah, that looks fine.’ There are always ways to improve, and the iCons instructors are very good at pointing those out in a constructive manner.” From these responses, it seems that the iCons instructors have met their goal of providing scaffolded support (Research Question 1).
When asked if they had wanted or needed other support, 33% of students answered that no further support was needed. Those who did want more support fell into three categories: those who wanted clearer expectations from the instructors about assignments or the flow of the class (17%), those who wanted to have more personal input about the scope or timing of assignments (9%), and those who would have liked financial support for laboratory activities (11%). Only a handful of students (5%) wished there had been more direct instruction or focused feedback: “Personally, I like more strict instruction, but I also feel like I learned better having to do my own thinking on how things should be done,” one iCons 1 student said.
With respect to changes in their collaboration skills throughout the semester, students’ responses were generally split among four categories: improved communication or sharing ideas (30%); better at taking into account other points of view and appreciating the skills and knowledge of others (26%); speaking up or taking charge more often (19%); and improvements in adapting to changing roles or dividing up tasks depending on the needs of the group (24%). One i2e student commented, “I have learned better ways to clearly communicate. I have come to regard communication with increased importance as the semester has progressed. With a shared purpose and clear communication, collaboration happens organically in a small group such as the one I am a part of in iCons 2.” Another student responded, “I think I have lost any fear I previously had to speak freely. If I feel a certain way or have any idea, I don’t hesitate to share. I think this has helped my collaboration and teamwork skills this semester, as I have found team communication to be a large component of being effective and successful. I have found my collaboration skills have improved this semester.”
In summary, results show that, in general, iCons 1 and 2 students perceived the pedagogy as intended by the instructors, worked collaboratively in teams, communicated their research to peers and the campus community, and developed collaboration skills.
Findings indicate that the instructors did implement the curriculum in the student-directed way that they intended (Research Question 1) and that students expected and were satisfied with the implementation (Research Question 2). iCons 1 students grasped the course goals early in the semester and aligned their learning expectations accordingly, which speaks to the clear and explicit messages that iCons 1 instructors communicated throughout the course. Since iCons 2 students had successfully completed iCons 1 and, thus, were familiar with the nature of the program, it seems less surprising that their responses around expectations also aligned with the iCons 2 course goals centered around scientific communication.
Students from both years identified collaboration, communication, and problem-solving as course goals and learning outcomes. Given the push from industry to equip students with these soft skills (National Academies of Sciences, Engineering, and Medicine, 2016; Society for Human Resource Management, 2019), the results of this study indicate that a program such as iCons can provide a model for learning these skills within an application-based context. However, further research is necessary to explore whether iCons students transfer these skills to the work environment and demonstrate an appropriate combination of technical and soft skills needed to succeed in the workplace.
Stephanie Purington (firstname.lastname@example.org) is a professional lecturer in the Education Department at Marist College in Poughkeepsie, New York. Martina Nieswandt is the associate vice chancellor for research and engagement and a professor of science education in the College of Education at the University of Massachusetts Amherst in Amherst, Massachusetts.
Blumenfeld, P. C., Soloway, E., Marx, R. W., Krajcik, J. S., Guzdial, M., & Palincsar, A. (1991). Motivating project-based learning: Sustaining the doing, supporting the learning. Educational Psychologist, 26(3–4), 369–398.
Capon, N., & Kuhn, D. (2004). What’s so good about problem-based learning? Cognition and Instruction, 22(1), 61–79.
Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. Sage.
Hanson, D. M. (2006). Instructor’s guide to process-oriented guided-inquiry learning. Pacific Crest.
National Academies of Sciences, Engineering, and Medicine. (2016). Promising practices for strengthening the regional STEM workforce development ecosystem. National Academies Press.
Savery, J. R. (2006). Overview of problem-based learning: Deﬁnitions and distinctions. Interdisciplinary Journal of Problem-Based Learning, 1(1), 3.
Schmidt, H. G., Loyens, S. M., Van Gog, T., & Paas, F. (2007). Problem-based learning is compatible with human cognitive architecture: Commentary on Kirschner, Sweller, and Clark (2006). Educational Psychologist, 42(2), 91–97.
So, H. J., & Brush, T. A. (2008). Student perceptions of collaborative learning, social presence and satisfaction in a blended learning environment: Relationships and critical factors. Computers & Education, 51(1), 318–336.
Society for Human Resource Management. (2019). The global skills shortage: Bridging the talent gap with education, training and sourcing. https://www.shrm.org/hr-today/trends-and-forecasting/research-and-surveys/documents/shrm%20skills%20gap%202019.pdf
Strauss, A. L. (1990). Systematic coding in qualitative research. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 27(1), 52–62.
University of Massachusetts Amherst. (n.d.). Why iCons? https://icons.cns.umass.edu/academics/why-icons
Wass, R., & Golding, C. (2014). Sharpening a tool for teaching: The zone of proximal development. Teaching in Higher Education, 19(6), 671–684.
Curriculum New Science Teachers Preservice Science Education Teacher Preparation College