Publications

Five questions to ask if you think teaching problem-solving works. By John Sweller

Every few decades there is a campaign to include general problem-solving and thinking skills in school curricula. The motivation is understandable. Everyone would like our schools to enhance students’ critical thinking and problem-solving skills. Because it is so obviously important for students to have such skills, these campaigns are frequently successful in including thinking and

Read More

Lessons Learned from PISA 2018 Statistics and Other International Student Assessments

2021, Crato, N. (Ed.) Improving a Country’s Education: PISA Results in 10 Countries PISA 2018 was the largest large-scale international assessment to date. Its results confirm the improvements of some countries, the challenges other countries face, and the decline observed in a few others. This chapter reflects on the detailed analyses of ten countries policies,

Assessment Background: What PISA Measures and How

This chapter provides a short description of what the Programme for International Student Assessment (PISA) measures and how it measures it. First, it details the concepts associated with the measurement of student performance and the concepts associated with capturing student and school characteristics and explains how they compare with some other International Large-Scale Assessments(ILSA). Second,

A fragmented-periodogram approach for clustering big data time series

AbstractWe propose and study a new frequency-domain procedure for characterizing and comparing large sets of long time series. Instead of using all the information available from data, which would be computationally very expensive, we propose some regularization rules in order to select and summarize the most relevant information for clusteringpurposes. Essentially, we suggest to use

Relationship between equity and excellence in education: Multilevel analysis of international students assessment data with a focus on Turkey.

/

Özdemir, Caner Ph.D., Department of Sociology Supervisor: Prof. Dr. Ayşe Gündüz Hoşgör July 2015, 236 pages

ABSTRACT: This dissertation aims at finding the relationship between equity and excellence in education and how these two dimensions interplay in Turkey. It is found that inequalities in education are not functional as suggested by functionalist theories. On the other hand, findings of this dissertation show that more equity brings more success. Results also show that Turkish education system is neither equitable nor excellent. Moreover, it is found that current education structure in Turkey worsens existing social inequalities. One of the main research questions of this thesis is: “What is the relationship between equity and excellence in education?” It is found that there is a positive relationship between equity and excellence. Unlike earlier claims about a trade-off between equity and excellence, there are serious hints about a relationship in which these two dimensions of education are enabling each other.

A fragmented-periodogram approach for clustering big data time series

/

Abstract
We propose and study a new frequency-domain procedure for characterizing and comparing large sets of long time series. Instead of using all the information available from data, which would be computationally very expensive, we propose some regularization rules in order to select and summarize the most relevant information for clustering
purposes. Essentially, we suggest to use a fragmented periodogram computed around the driving cyclical components of interest and to compare the various estimates. This procedure is computationally simple, but able to condense relevant information of the time series. A simulation exercise shows that the smoothed fragmented periodogram works in general better than the non-smoothed one and not worse than the complete periodogram for medium to large sample sizes. We illustrate this procedure in a study of the evolution of several stock markets indices. We further show the effect of recent financial crises over these indices behaviour.

Lessons Learned from PISA 2018 Statistics and Other International Student Assessments

/

2021, Crato, N. (Ed.) Improving a Country’s Education: PISA Results in 10 Countries

PISA 2018 was the largest large-scale international assessment to date. Its results confirm the improvements of some countries, the challenges other countries face, and the decline observed in a few others. This chapter reflects on the detailed analyses of ten countries policies, constraints, and evolutions. It highlights key factors, such as investment, curriculum, teaching, and student assessment. And it concludes by arguing that curriculum coherence, an emphasis on knowledge, student observable outcomes, assessment, and public transparency are key elements. These elements are crucial both for education success in general and for its reflection on PISA and other international assessments.

Download the article here.

Assessment Background: What PISA Measures and How

This chapter provides a short description of what the Programme for International Student Assessment (PISA) measures and how it measures it. First, it details the concepts associated with the measurement of student performance and the concepts associated with capturing student and school characteristics and explains how they compare with some other International Large-Scale Assessments(ILSA). Second, it provides information on the assessment of reading, the main domain in PISA 2018. Third, it provides information on the technical aspects of the measurements in PISA. Lastly, it offers specific examples of PISA 2018 cognitive items, corresponding domains (mathematics, science, and reading), and related performance levels.

Download the article here.

Five questions to ask if you think teaching problem-solving works. By John Sweller

/

Every few decades there is a campaign to include general problem-solving and thinking skills in school curricula. The motivation is understandable. Everyone would like our schools to enhance students’ critical thinking and problem-solving skills. Because it is so obviously important for students to have such skills, these campaigns are frequently successful in including thinking and problem-solving skill modules in the curriculum. Unfortunately, success in introducing thinking and problem-solving into curricula has not been matched by successful educational outcomes. Across the world, there is a consistent failure to actually improve problem-solving performance. We now know enough about human cognition to know why attempts to teach general cognitive skills such as problem-solving will always fail. Here are a few questions that those advocating for the curriculum to include problem solving in areas such as mathematics might want to consider.

  1. What sophisticated, learnable and teachable problem-solving strategies do you personally use when solving a novel problem? If you cannot describe the strategies you use, what hope do you have of teaching them? At least consider the possibility that there are no learnable and teachable general problem-solving strategies.
  2. Ignoring the problem that no novel, general problem-solving strategies have ever been devised, what evidence is there from randomised, controlled trials that teaching general problem-solving strategies improves problem-solving performance? If, after dozens of years attempting to find a body of evidence for the efficacy of teaching general problem-solving strategies, no such bodies of evidence exist, we must at least consider the possibility that they will never exist.
  3. The relevant randomised controlled trials have been run. Within a cognitive load theory context (Lovell, 2020; Garnett, 2020; Sweller, Ayres and Kalyuga, 2011) dozens of experiments from around the globe have compared learners solving classroom problems as opposed to studying a worked example demonstrating the solution. For novice learners in an area, the results overwhelmingly indicate improved performance by the worked-example group over the problem-solving group. Why? Humans are amongst the very few species that have evolved to obtain information from other members of the species. We are very good at it. We can obtain information by problem solving but it is a slow, inefficient technique. If available, novel, complex information always should be obtained from others during instruction rather than attempting to generate it ourselves.
  4. There is evidence that problem solving can be superior to studying solutions but it only occurs when students are already knowledgeable in the area. They need to practice problem solving. There is no evidence that knowledgeable students are better at solving novel problems outside of their areas of knowledge. Why does practice at solving problems only become effective once we become reasonably knowledgeable in the relevant curriculum area? Cognitive load theory provides an answer that is beyond the scope of this statement (see also Martin and Evans, 2018 ).
  5. Ignoring the lack of evidence from randomised, controlled trials, why do correlational studies on data from international tests consistently demonstrate that the less guidance learners are given when learning, the less they learn? (Note, problem solving is associated with minimal guidance.) (Oliver, McConney and Woods-McConney, 2019; Jerrim, Oliver and Sims, 2019)

As indicated above, cognitive load theory provides one answer to this set of questions. The theory uses our knowledge of human cognition and evolutionary psychology to devise novel instructional procedures. It explains why (a) when dealing with novel, complex problems, studying worked examples is superior to solving the equivalent problems, (b) why solving problems is superior to studying worked examples when levels of expertise have increased in a particular domain, and (c) why attempting to teach non-existent problem-solving strategies, by taking time away from teaching subject matter, reduces students’ performance on international tests.

So, how can we increase problem-solving skill? By increasing domain-specific knowledge. Expecting anyone to engage in sophisticated problem solving and critical thinking in areas where they have minimal knowledge is futile. Lots of domain knowledge allows critical thinking and effective problem solving to occur naturally and automatically. Attempting to teach general problem-solving skills rather than knowledge, does not.

John Sweller is the emeritus professor of educational psychology in the School of Education at UNSW.

 

This article was originally published on EduResearch Matters. Read the original article.AARE