%40تخفیف

The Washback Effect of Iranian High School Final Examinations on Students’ Test-taking and Test-preparation Strategies

تعداد146 صفحه در فایل word

Master of Arts in Teaching English as a Foreign Language (TEFL)

The Washback Effect of Iranian High School Final Examinations on Students’ Test-taking and Test-preparation Strategies

Abstract

The Washback or Backwash effect has drawn the attentions of many testing specialists from different parts of the world in the last decades. Numerous researchers have investigated the phenomenon for different purposes.  Many studies have been conducted to explore the effects that tests may have on teachers and teaching. There are, however, little empirical studies available in the literature on the washback effects of tests on learners and learning. (Green, 2006;

 Reynolds, 2010; Lin 2010) Hence, this study investigated the effect of high school final examinations on students’ test-taking and test-preparation strategy use. To achieve this end, eighty freshman high school learners were asked to take high school final examinations. Adopting the ex post facto design, the researcher collected both concurrent and retrospective protocols to identify the processes through which the learners go to get prepared for the final examinations and the strategies that they employ to overcome test tasks. A subject-by-subject and item-by-item analysis of the acquired protocols revealed that high school final examinations made students employ certain types of test-taking and test-preparation strategies which seemed to exert a drastically negative influence on their learning by directing them toward following a measurement- driven (learn-to-test) approach of learning, though among the findings were some strategies which seemed to foster their mental ability and activate their knowledge of cohesion and semantics. Moreover, it was found that students utilized significantly different test-taking and test-preparation strategies when they dealt with different sections of the high school examinations. The results also proved a significantly positive relationship between students ‘strategy use and their scores on the high school final examinations. Finally, the findings of the study can be applied to some schools.

Key Words: Washback effect, Test-taking strategy, Test-preparation strategy

 

TABLE OF CONTENTS

DEDICATION……………………………………………………………….………………………..iii

ACKNOWLEDGEMENTS……………………………………………………………..………..iv

ABSTRACT……………………………………………………………………………………………v

TABLE OF CONTENTS……………………………………………………………….………….vi

LIST OF TABLES……………………………………………………………………………………. xi

LIST OF FIGURES………………………………………………………………………………….xii

LISt OF ABBREVIATIONS………………………… …………………………………………xiii

LIST OF APPENDICES……..…………………………………………………………………..xv

Chapter One: Introduction

  • Overview…………………………………………………………………………………….2

  • Statement of the Problem……………………………………………………………………3

  • Significance of the Study……………………………………………………………………6

  • Research Questions and Hypotheses……………………………………………………….10

  • Definitions of Key Words………………………………………………………………….11

  • Limitations and Delimitations of the Study………………………………………………..12

Chapter Two: Review of the Related Literature

2.1. Overview…………………………………………………………………………………….14

2.2. Washback and Language Testing…………………………………………………………..14

Theoretical Background…………………………………………………………………………14

2.2.1 The Concept of Washback…………………………………………………………………14

 2.2.2. The Nature of Washback…………………………………………………………………16

           2.2.2.1. Negative (harmful) Washback……………………………………………………16

           2.2.2.2. Positive (beneficial) Washback…………………………………………………..18

 2.2.3. Washback and Related Concepts…………………………………………………………21

            2.2.3.1. Washback and Test Impact………………………………………………………21

            2.2.3.2. Washback and Curriculum Alignment…………………………………………..22

            2.2.3.3. Washback and Validity………………………………………………………….23

             2.2.3.4. Systemic Validity……………………………………………………………….24

             2.2.3.5. Washback Validity………………………………………………………………25

              2.2.3.6. Consequential Validity …………………………………………………………26

2.2.4. Washback Mechanism…………………………………………………………………….27

           2.2.4.1. Alderson and Wall’s Hypothesis…………………………………………………27

           2.2.4.2. Hughes’s Trichotomy Framework……………………………………………….29

2.2.4.3. Bailey’s Model of Washback……………………………………………………………30

           2.2.4.4. Green’s Comprehensive Model of Washback……………………………………31

           2.2.4.5. Pan’s (2008) model of Washback………………………………………………..33

2.2.5. Factors Affecting Washback………………………………………………………………34

2.2.6. Washback Effect of High Stake Tests…………………………………………………….35

 2.2.7.  Washback and Curriculum Innovation…………………………………………………..36

Empirical research on washback…………………………………………………………………38

  2.2.2.1. Washback on the Classroom Setting……………………………………………………38

               2.2.2.1.1. Washback on Learners………………………………………………………38

                               2.2.2.1.1.1. Learners’ Learning………………………………………………39

                               2.2.2.1.1.2. Learners’ Attitudes and Perspectives……………………………42

               2.2.2.1.2. Washback on Teachers………………………………………………………44

                                2.2.2.1.2.1. Teachers’ Methodologies………………………………………44

                                2.2.1.2.2.2. Teachers’ Attitudes and Perspectives………………………….47

2.2.2.2. Washback on Curriculum……………………………………………………………….49

2.2.2.3. Washback on Teaching Materials……………………………………………………….52

2.3. Test-taking Strategies in Language Testing…………………………………………………54

 Theoretical Background…………………………………………………………………………54

         2.3.1. Defining Test-taking Strategies……………………………………………………..54

         2.3.2. Conceptualization of Test-taking Strategies…………………………………………55

         2.3.3. Test-taking strategies and test Validity……………………………………………….56

         2.3.4. Methods for Investigating Test-taking strategies……………………………………57

          2.3.5. Factors Affecting Test-taking Strategy Use…………………………………………59

          2.3.6. Impact of Test-Taking Strategies on Test Scores…………………………………..60

A selected Review of Empirical Researches on Test-taking Strategies…………………………61

2.4. Test-preparation strategies…………………………………………………………………..65

 Theoretical Background…………………………………………………………………………65

2.4.1. Defining Test-Preparation Strategies………………………………………………………65

2.4.2. Ethicality of Test Preparation practices……………………………………………………65

Empirical Studies on Test-preparation strategies………………………………………………..67

Chapter 3: Methodology

 3.1. Overview……………………………………………………………………………………71

3.2. Participants…………………………………………………………………………………..71

3.3. Instrumentation………………………………………………………………………………72

3.4. Data Collection Procedure…………………………………………………………………..74

3.5. Data Analysis Procedure…………………………………………………………………….74

3.6. Design……………………………………………………………………………………….77

 

Chapter 4: Results and Discussion

 

  1. 1. Overview……………………………………………………………………………………77

  2. 2. Restatement of the Research Questions……………………………………………………77

4.3. Results……………………………………………………………………………………….80

        4.3.1. Test-Taking Strategies……………………………………………………………….80

         4.3.2. Test-Preparation strategies…………………………………………………………..83

         4.3.3. The Relationship between Test-taking Strategies and Test Scores…………………87

         4.3.4. The Relationship between Test-preparation Strategies and Test Scores……………87

         4.3.5. Nature of the washback……………………………………………………………..87

4.4. Discussion……………………………………………………………………………………89

Chapter 5: Conclusion, Implications, and Suggestions for Further Research

 

5.1. Overview……………………………………………………………………………………98

 5.2. Conclusion………………………………………………………………………………….98

5.3. Implications and Application………………………………………………………………100

5.4. Suggestions for Further Research………………………………………………………….102

REFERENCES…………………………………………………………………………………103

APPENDICES………………………………………………………………………………….121

Lists of Tables

Table                                                                                                                                         page

  1. 2.1. A summary of the negative washback effect of tests (pan, 2009: p.261)…………..17

  2. 2. 2. A summary of positive washback effect of tests (pan, 2009: p.261)…………….20

  3. 2.3. Fifteen Washback Hypotheses. Alderson and Wall, (1993, p. 120-121)…………28

  4. 2.4. The trichotomy of backwash model (Hughes, 1993, p. 2)………………………..29

  5. 2.5. Appropriate and Inappropriate Test Preparation Practices (Mehrens 1991, cited in Gulek, 2003)…………………………………………………………………………………66

  6. 4.1. Test-taking strategies with their identified frequencies in protocols………….80-81

  7. 4.2. Chi-Square Tests for the subcategories of vocabulary section……………………81

  8. 4.3. Chi-Square Tests for the subcategories of grammar section……………………..83

  9. 4.4. Chi-Square Tests for the between vocabulary and grammar sections…………….83

  10. 4.5. Test-preparation strategies with their obtained frequencies in protocols…….84-85

  11. Table 4.6. Chi-Square Tests for the subcategories of vocabulary component……………….85

  12. Table 4.7.Chi-Square Tests for the subcategories of grammar component………………….86

  13. 4.8. Chi-Square Test for the between vocabulary and grammar……………………..86

List of Figures

Figure                                                                                                                                        Page

  1. 2.1. Washback continuum……………………………………………………………16

  2. 2.2. Test Impact (Bachman and Palmer, 1996, p.3o)………………………………..21

  3. 2.3. The relationship between Authenticity/Directness, validity and washback…….24

  4. 2.4. Bailey’s Basic Model of Washback (1996, p. 264)……………………………………….31

  5. 2.5. Green’s Model of Washback. (Green, 2007, p.24)………………………………32

  6. 2.6. A proposed holistic model of washback. (Pan, 2008, p. 12)…………………….33

قبلا حساب کاربری ایجاد کرده اید؟
گذرواژه خود را فراموش کرده اید؟
Loading...
enemad-logo