Harefield

Harefield
Harefield
Showing posts with label Evidence-based practice. Show all posts
Showing posts with label Evidence-based practice. Show all posts

Friday, 28 March 2014

Should we dispense with the D word?


By Kevin Wheldall, Anne Castles and Mandy Nayton

[Note: This article appeared in a more abbreviated form in The Conversation:


The word dyslexia seems to arouse strong emotions, both for and against, and has a chequered history. Viewed by some as a device to spare the blushes of middle class parents whose children struggle to learn to read, it is seen by others as a credible explanation for the reading difficulties their child has been experiencing.

In their recently published book, The Dyslexia Debate (http://www.cambridge.org/us/academic/subjects/psychology/educational-psychology/dyslexia-debate), Joe Elliott and Elena Grigorenko open up a can of worms. But it is a can that needed opening, and we applaud these authors for bringing this important issue up for discussion and debate. Elliott and Grigorenko argue that the term “dyslexia” should be abandoned – that it is an imprecise and unhelpful label that does nothing to assist the individuals to whom it is applied.

So what do Elliott and Grigorenko say, and why do they say it?

Two key points need to be made before proceeding. First of all, this debate is largely about terminology. Elliott and Grigorenko are not denying the reality of children’s reading difficulties, or that these difficulties need to be identified and treated as early as possible. What they are arguing is that giving the label of “dyslexia” to children who experience such problems is not helpful.

Secondly, it is important to keep in mind that reading ability falls on a continuum in the population; it is normally distributed like height or weight. This means that deciding whether a child does or does not have a reading difficulty will always involve applying a somewhat arbitrary cut-off. In this sense, a diagnosis of dyslexia is similar to a diagnosis of obesity, but quite different from a diagnosis of, say, measles where it is clear when someone has it and when they don’t.

With these points in mind, let’s look more closely at Elliott and Grigorenko’s two main arguments:

1.    There is no agreement about how to diagnose dyslexia

Elliott and Grigorenko’s first key point is that applying the label of dyslexia is intrinsically unscientific because there is no universally agreed set of criteria for its diagnosis. What one clinician might call dyslexia, another does not. Some apply the label to any child who struggles with learning to read; others apply it only when the reading difficulty is accompanied by strengths in other intellectual domains; still others when the reading difficulty is associated with particular cognitive “markers” such as phonological or visual deficits. And even within these different definitions, there is variability associated with where the cut-off for an impairment is applied: consequently, estimates of the prevalence of dyslexia may range from 3% - 20% of the population.

It is undoubtedly true that the term “dyslexia” has been used in a wide variety of contexts over the years, and that this has led to considerable confusion. We think that three particular factors have contributed to the problem:

Firstly, there has been a failure to distinguish between research and clinical uses of the term. Researchers often select samples of “dyslexics” with very specific profiles. They do so in order to answer particular research questions, or to control for factors in which they are not interested in a certain context. For example, they may select their sample to have average or above average IQ, so that this factor does not influence their results. But the fact that the use of these specific selection criteria can be valuable in a research context does not mean that they should necessarily inform a clinical diagnosis of dyslexia. Similarly, researchers may decide that, for their experimental purposes, ‘dyslexia’ will be defined very generously as those students scoring below one standard deviation from the mean. But this does not necessarily mean that this (relatively large) proportion of the population (about 16%) should be regarded as dyslexic and hence in need of special treatment and/or afforded educational dispensations.

Secondly, there has been a tendency to conflate symptoms and causes within definitions of dyslexia. Sometimes the condition is defined purely in terms of the presenting problem – a reading accuracy and/or fluency difficulty  – with the diagnostician remaining agnostic as to its underlying cause. In other cases, the definition incorporates a particular theoretical perspective as to why the reading difficulty arose in the first place.  The most prominent and certainly widely-supported of these theories centres on underlying language-based phonological deficits, but there are also a host of other neural, visual and attentional theories.  Given the wide range of theories as to the causes of dyslexia, it is not surprising that this has generated an equally wide range of definitions.

Thirdly, the term is widely used, and very frequently misused, by non-experts in the field and by the mainstream media. The label is particularly popular with promoters of dyslexia “cures” of dubious merit, including such things as: nutritional supplements, exercise regimes, coloured glasses and ‘high frequency’ ear plugs. The briefest of Google searches confirms this fact - and this, of course, only serves to add to the confusion.

But, these points aside, is it the case that there is no generally agreed set of criteria for the diagnosis of dyslexia? We think that this may be overstating the case. Amongst experts in the field, there is in fact a substantial degree of consensus about what is meant by the term and how it should be defined in a clinical context. Dyslexia is widely viewed as a severe and enduring reading difficulty that persists despite high quality instruction and evidence-based intervention. This is enshrined in documents such as the Rose report (http://webarchive.nationalarchives.gov.uk/20130401151715/https://www.education.gov.uk/publications/eOrderingDownload/0201-2006pdf-EN-01.pdf)
in the UK  and the report of the Australian Dyslexia Working Party (2010) (http://www.dyslexiaaustralia.com.au/DYSWP.pdf).

The definition of dyslexia above is effectively couched within the widely-accepted “Response to Intervention” model of remediation (RTI) (http://www.musec.mq.edu.au/community_outreach/musec_briefings#17):
a model that  seeks to match the amount and nature of reading intervention to the support needs of the child. In doing so, it provides relatively straightforward means of distinguishing between children who are performing poorly on reading measures because they have not received the appropriate instruction for some reason and children who are performing poorly because they have severe and enduring learning difficulties that require sustained intervention (whom we might classify as having “dyslexia” or some other label).

The RTI model works as follows: All children receive a systematic program of scientific evidence-based reading instruction right from the outset of schooling, ie a program of instruction that is predicated upon what reading scientists have found to be critical and most effective in terms of teaching children to learn to read. This is referred to as Tier 1 instruction. The reading progress of all students is closely monitored, and those children whose performance, following instruction, is poor on curriculum-based measures, regardless of the reason, are identified as low-progress readers and are provided with more intensive small-group reading instruction. This is referred to as Tier 2 and typically involves about 20% of the age cohort.  (In some socially disadvantaged areas, of course, this figure will be much higher.) The progress of Tier 2 children is again closely monitored and those who continue to have low scores, that is, who are not “responding to Tier 2 intervention”, are provided with even more intensive one-on-one intensive remediation and support. This is Tier 3 instruction.

Children who still struggle following a period of intensive Tier 3 intervention or who progress at an unusually slow rate, are viewed as having, a severe and enduring reading difficulty that persists despite high quality instruction and evidence-based intervention. This has been estimated to be about 3% of the population of students. Thus, without needing to look to underlying causes, or to associated deficits, a small subgroup of children can be identified who can reliably and consistently be given a diagnosis of “dyslexia” on the basis of their need for continuing intensive literacy instruction. However, it is generally viewed as important to gather additional clinical information from appropriate professionals at this point to contribute to the development of effective individual education plans (IEPs) with recommendations for both remediation and accommodations.

There are two key features of this definition. First, it makes a distinction between children who are struggling with reading because they have not had the appropriate instruction (perhaps because they have not attended school regularly, or have had poor teaching) and those who are struggling despite having had sufficient opportunities. Secondly, it focuses the diagnosis at the level of reading itself. Scientists have come a long way in developing precise and detailed theories of the reading process, and these have been translated into valid and reliable clinical assessment tools. It is our view that, armed with these tools, well-trained clinical experts are in a stronger position to provide a scientifically-informed diagnosis of dyslexia than Elliott and Grigorenko suggest. Whether the actual term ‘dyslexia’ is used or some other label is employed, this small group exists and can be identified.

It is only fair to note, however, that while RTI does have the potential to: improve reading outcomes significantly and will, in addition, identify students at risk of reading failure far earlier, create a more equitable system and should result in better ongoing monitoring and assessment of all students, we are only seeing a minority of schools implementing anything even vaguely resembling RTI at this stage in Australia. This makes the use of it, at this point, as the mainstay identification model challenging, to say the least. This is not to say, however, that it should not be an important goal. It also means that until RTI is established, students will not necessarily be picked up as falling behind until later in primary school or even into secondary school. This means that the transition through the three tiers is not as straightforward as it is in the early years. Identified students will simply move straight into a Tier 2 or even Tier 3 intervention. And finally, while it is our firm view that the RTI model has many advantages, it is viewed by some as being limited in that it does not individualise, it does not diagnose, and it does not classify.

2.    Reading interventions will be the same whether dyslexia is diagnosed or not.

The second key point made by Elliott and Grigorenko is that a diagnosis of dyslexia does not have any implications for treatment. Again, they are broadly correct. Let us suppose that two 8-year old girls present at a clinic, both of whom can barely read. One girl has frequently been ill and has attended school only intermittently over the past two years. As a result she has fallen behind in learning to read. The other girl has a history of struggling to learn to read in spite of having been provided with additional instruction. The latter child might well be diagnosed with “dyslexia”; the former most likely not. But the programs of intervention put in place for each child would most likely differ very little in both content and method. A large body of evidence tells us that the most effective thing we can do for each of these children is to provide them with systematic, intensive evidence-based reading remediation, targeted at the gaps in their reading skills.

So does this mean, as Elliott and Grigorenko argue, that a diagnosis of dyslexia (or some other label) is unnecessary and redundant? Again, we feel that this may overstate things. Although the nature of the treatments provided to these children will be similar, the evidence tells us that their length and intensity are likely to be quite different. Our first girl should respond quickly and well once she receives the required intervention; our second girl, by definition based on the RTI model, is likely to need sustained and ongoing support. She may need one-on-one assistance and, ultimately, compensatory technology.

More generally, the fact that the treatment is similar across the spectrum of a condition does not mean that there is no justification for giving a label to those at the extreme end. In the same way that the diagnosis of “obesity” serves to identify the most severe and at-risk cases along the continuum of weight, and the diagnosis of “hypertension” serves to identify the most severe and at-risk cases along the continuum of blood pressure, a diagnosis of dyslexia can identify the most severe and at-risk cases along the continuum of reading. Such labels focus attention and resources where they are most urgently needed. Where we might disagree is in the term we use to describe such children and their condition.

There remain the quibbles about terminology. Many researchers and clinicians do not like the term “dyslexia” because it medicalises the condition and invokes a disease model that is not appropriate. They prefer a term like “reading disability” or “reading impairment”. Others, however, counter that the use of a medical term like dyslexia attracts attention and resources to a problem that may not be so forthcoming if these other terms were used. And as Dorothy Bishop notes, this concern seems to be borne out in the case of the much less visible condition of “Specific Language Impairment” (http://deevybee.blogspot.com.au/2010/12/whats-in-name.html). Finally, not to be underestimated is the positive effect that a diagnosis of dyslexia has on the parents and children involved, validating their concerns and often providing a much-needed boost to self-esteem. For these reasons, there is considerable divergence in the field as to which label should be preferred (and indeed divergence even amongst we three authors!)

Elliott and Grigorenko argue that the most important thing is that all children who encounter literacy difficulties receive the help that they need. We could not agree more. At the end of the day, what we choose to call the small proportion of students with severe and persistent reading problems is not nearly so important as ensuring that they receive the support that they need. In the past, passionate advocates for dyslexia may have gilded the lily by claiming that up to 20% of children are dyslexic (and some still do). This is unhelpful and ultimately counter-productive since government agencies will baulk at the expense of providing special treatment and dispensations for such a large proportion of the population. Nor is such expenditure warranted when the reading difficulties of the vast majority of low-progress readers may readily be attended to in school with effective small group Tier 2 and individualised Tier 3 interventions.


Kevin Wheldall is an Emeritus Professor of Macquarie University and Director of the MultiLit Research Unit. You can follow him on Twitter (@KevinWheldall) where he comments on reading and education (and anything else that takes his fancy).

Professor Anne Castles is Head of the Department of Cognitive Science at Macquarie University and Deputy Director of the ARC Centre of Excellence in Cognition and its Disorders. You can follow her on Twitter (@annecastles), where she comments on issues related to reading difficulties and other cognitive disorders.


Mandy Nayton is currently the Executive Officer of DSF Literacy and Clinical Services in Perth, Western Australia as well as President of AUSPELD, The Australian Federation of SPELD Associations. She is an educational and developmental psychologist and qualified teacher with extensive experience in the field of literacy education. Mandy is an Adjunct Research Fellow at Curtin University’s School of Psychology and Speech Pathology, and a member of the Federal Government’s Schools Disability Advisory Council.




Friday, 18 January 2013

PIRLS before Swine: Or why Australia sucks at reading


John Lennon was renowned for his sharp, and oft times acidic, wit. When asked if Ringo was the best drummer in the world, he responded that Ringo was not even the best drummer in the Beatles! I was reminded of this when reviewing the latest (2011) results from the Progress in International Reading Literacy Study (or PIRLS). Not only were Australian students not the best readers in the world, they were not even the best readers among the English speaking nations surveyed. They were, in fact, the worst. We can take small comfort from the fact that New Zealand performed only marginally (and not significantly) better than Australia.
The PIRLS project essentially assesses reading comprehension by requiring students to read selected texts and then to answer questions about the material read. Year 4 students are assessed because this typically marks the point of transition from learning to read to reading to learn. (Note that 2011 was the first time that Australia had taken part in PIRLS.)
Overall, 45 countries were included in the study (excluding those countries who tested older or younger readers or who took part for their own internal benchmarking purposes, and whose results are not reported). Australia came 27th in the league table of countries (with a mean score of 527), below all other English speaking countries and significantly lower than 21 other countries overall, including all other English speaking countries except New Zealand (mean score 531).
To put this in perspective let’s look at how some of these other English-speaking countries performed. Singapore (mean score 567), for example, came 4th, one of the four top performing countries significantly above the others. Northern Ireland came fifth (mean score 558) and the United States came 6th (mean score 556) (compared with 14th out of 40 in 2006). England came 11th (compared with 15th out of 40 in 2006) and Canada (mean score 548) came 12th. (Note the improvements in performance from 2006 to 2011 by both England and the United States.)
As well as reporting mean scores by country, PIRLS also provides details of performance against four benchmarks: Advanced, High, Intermediate, and Low (and those who fail even to qualify for Low ie Below Low). In Australia 7% of students failed even to meet the Low benchmark and a further 17% met only the Low benchmark. Here are comparison percentage figures for other English speaking countries of interest: 
                        Below Low    Low     Combined              

    


Northern Ireland 3 10 13
Singapore 3 10 13
Canada 2 12 14
United States 2 12 14
England 5 12 17
New Zealand 8 17 25
(Australia) 7 17 24
In summary, Australia and New Zealand have over twice as many students failing to meet even the minimal Low standard as Northern Ireland, Singapore, Canada and the United States; and over one and three quarters times as many low-performing students overall (Below Low and Low combined). England falls in the middle of these two groups of countries.
These results may have come as a shock to many educationists who had been blithely arguing that there was no literacy crisis in Australia. But they provided simple confirmation for Australian reading scientists who had been warning of this problem for some time and had argued (remarkably accurately, as it turns out) that a quarter of Australia’s students could be regarded as low-progress readers. In 2004, a group of Australian reading scientists and clinicians wrote an open letter to the then Federal Minister of Education, Brendan Nelson, arguing the need for reform regarding the way reading is taught in Australia and the need for literacy teaching to be based on the available scientific evidence. The subsequent National Inquiry into the Teaching of Reading reported at the end of 2005, essentially reiterating these concerns and stating clearly what needed to be done to improve reading standards in Australia. In short, the Report was subsequently simply ignored.
Moreover, following the implementation of the National Assessments Program – Literacy and Numeracy (or NAPLAN) from 2008, we were subsequently assured (annually) that all was well on the reading front. As recently as in 2012, we were reassured that for the performance of Year 3 students in Reading only 4.4% were in Band 1, having failed to meet the National Minimum Standard, and only a further 9.4% were in Band 2 ie at the national Minimum Standard (a combined total of 13.8% of students). (Note that the NAPLAN measure of reading is similar to the reading comprehension measure employed by PIRLS.)
Clearly, we have been deluding ourselves by measuring student reading performance against unrealistically low benchmarks that do not withstand international scrutiny. NAPLAN, as a reading performance measure, needs to be recalibrated against international standards so that Bands 1 and 2 combined ‘capture’ the bottom performing 25% (not the current 14%) of students. (These low-progress readers should subsequently be earmarked for immediate additional instructional support.) Moreover, it should not be beyond the wit of the NAPLAN methodologists to tie the NAPLAN scale to the metric employed by PIRLS so that progress towards achieving the international standards could readily be monitored
Finally, it is interesting to note that two English-speaking countries that have begun to take reading instruction seriously in recent years, and who have urged that reading instruction be based on the best available scientific evidence, namely the US and England, have both improved their international standing substantially in the PIRLS league table from 2006 to 2011. Similarly, the two English-speaking countries that have performed so poorly, namely Australia and New Zealand, are those that have clung most tenaciously to the discredited ‘philosophy’ of whole language literacy instruction. Can this be simple coincidence? I think not.

Reference note:
A summary of Australia’s performance in PIRLS 2011 is provided in:
Thompson, S., Hillman, K., Wernert, N., Schmid, M., Buckley, S., & Munene, A. (2012). Highlights from TIMMS & PIRLS 2011from Australia's perspective. Melbourne: Australian Council for Educational Research.

Tuesday, 16 October 2012

Guest post: Tiger by the Tail




The parlous state of ‘Aboriginal education’ was highlighted again with the release of the NSW Auditor General’s report on the failure to meet the ‘closing the gap’ targets. The report also makes the point that there are a good many Indigenous students who can read and write as well as their non-Indigenous peers.  This is something to be celebrated. But, as many have said before, the problem is that the ‘tail’ of underachieving students is very long (and muscular).

Why is lifting the literacy (and numeracy) level of the majority of Indigenous students such an intractable problem?  It is clear that there are instructional issues stemming from the fact that education systems are not necessarily committed to mandating that proven approaches to the teaching of reading be used in their classrooms.  Even if they were, the teacher training institutions do not necessarily turn out teachers who know how to teach reading effectively. This is a problem for all young Australians and it seems to be a matter of ‘luck’ whether you will be taught to read effectively or not in one of the nation’s classrooms. But that is an argument for another day. 

We consistently read that the poorest performing students are Indigenous students who live in remote and very remote areas of our country. Here the likely instructional inadequacies are overlaid by the myriad problems that are inherent in these ‘hard to staff’ areas.  High rates of staff turnover, young and inexperienced staff, weather events (like cyclone Larry), fresh food shortages, vast distances to be travelled, road closures, lack of replacement staff, lack of housing for school staff (and the list goes on), play havoc with delivering consistent and adequate teaching.

It does not take long in a remote community to come to grips with the enormous challenges that exist for anyone with a vision and passion for redressing this dreadful social ill; that generations of young Indigenous Australians are being relegated to lives devoid of the opportunities that are afforded by education.  We are presently failing to provide even a basic education to a sizeable minority of Indigenous students. At times this apparently intractable problem can seem quite overwhelming.

There is a solution to the provision of effective literacy instruction to these struggling students, however.  This comes in the form of the marriage of two forms of instructional technology. When one hears this term, most people think of computer hardware and its applications. But the instructional technology that informs how and what to teach predates the emergence of the information technology that most of us now take for granted. This form of ‘instructional technology’ forms the bedrock of the skills and expertise that special educators bring to the field of generic basic skills teaching.

Direct, systematic and explicit instruction that is evidence-based is what these students need to get on the road to learning success.  But how do we put those who know how to use such effective instructional technology in touch with the most needy students in remote and very remote areas?

With the advent of fast broadband technology (often excellent in these remote areas), and indeed the coming of the National Broadband Network, we are now able to by-pass all of the staffing and resourcing issues that have hampered the delivery of even the most basic schooling for so long.  We now have the means by which a struggling low-progress reader in, say, Aurukun, Coen, or Baniyala in East Arhem Land, can be taught to read directly, explicitly, systematically and intensively every day by a trained tutor or a teacher at the other end of a broadband connection.  An individual program may be delivered in this one-to-one mode thereby meeting the idiosyncratic needs of each student.

We have been trialing such an approach in Multilit and are confident that it can deliver the instruction that these students most urgently need.  The cost of providing such a service is a grain of sand compared to the desert of costs that are required to attract, retain and maintain staff in these remote areas.  All that is required at each end is a computer, a camera and a headset (also reducing some of the problems of ‘white noise’ in a classroom for students with hearing impairment) and a student ready to learn. Moreover, the integrity and fidelity of the instruction can be assured as monitoring such instruction from the ‘hub’ is easily done.

When we first started our work on Cape York in 2004, a skeptical local educator of some stature said to me, “So….. you’re going to catch the tiger by the tail, are you ?”.  I took it as a challenge. Our subsequent years of work on the Cape confirmed that we could in fact get students moving and learning to read using scientific evidence-based methods, such as are employed in our MultiLit programs.  The logistics around the human element of the exercise was the really challenging thing – we knew what to teach, and we did it. The students learned.  We got the results.

Some seven or so years later, we can now see a way of delivering effective and intensive instruction to the large numbers of students who need it. As a society, we will be judged, quite rightly, by our failures not our successes in the years to come. It is time to grab this tiger firmly by the tail.

Dr Robyn Wheldall (Beaman) is an Honorary Fellow of Macquarie University and is a director of MultiLit Pty Ltd. Email: robyn.wheldall@multilit.com

[Thanks to http://www.free-predator-pics.com for image.]