OECD Education Working Papers

ISSN :
1993-9019 (online)
DOI :
10.1787/19939019
Hide / Show Abstract
This series is designed to make available to a wider readership selected studies drawing on the work of the OECD Directorate for Education. Authorship is usually collective, but principal writers are named. The papers are generally available only in their original language (English or French) with a short summary available in the other.
 

Comparing the Similarities and Differences of PISA 2003 and TIMSS You or your institution have access to this content

Click to Access: 
    http://oecd.metastore.ingenta.com/content/5km4psnm13nx.pdf
  • PDF
  • http://www.keepeek.com/Digital-Asset-Management/oecd/education/comparing-the-similarities-and-differences-of-pisa-2003-and-timss_5km4psnm13nx-en
  • READ
Author(s):
Margaret Wu1
Author Affiliations
  • 1: University of Melbourne, Australia

Publication Date
22 Apr 2010
Bibliographic information
No.:
32
Pages
103
DOI
10.1787/5km4psnm13nx-en

Hide / Show Abstract

This paper makes an in-depth comparison of the PISA (OECD) and TIMSS (IEA) mathematics assessments conducted in 2003. First, a comparison of survey methodologies is presented, followed by an examination of the mathematics frameworks in the two studies. The methodologies and the frameworks in the two studies form the basis for providing explanations for the observed differences in PISA and TIMSS results. At the country level, it appears that Western countries perform relatively better in PISA as compared to their performance in TIMSS. In contrast, Asian and Eastern European countries tend to do better in TIMSS than in PISA. This paper goes beyond making mere conjectures about the observed differences in results between PISA and TIMSS. The paper provides supporting evidence through the use of regression analyses to explain the differences. The analyses showed that performance differences at the country level can be attributed to the content balance of the two tests, as well as the sampling definitions – age-based and grade-based – in PISA and TIMSS respectively. Apart from mathematics achievement, the paper also compares results from the two studies on measures of self-confidence in mathematics. Gender differences are also examined in the light of contrasting results from the two studies. Overall, the paper provides a comprehensive comparison between PISA and TIMSS, and, in doing so, it throws some light on the interpretation of results of large-scale surveys more generally.