The movement towards evidence-based practices attempts to encourage and, in some instances, require professionals and other decision-makers to pay more attention to evidence to inform their decision-making. The goal of evidence-based practice is to eliminate unsound or outdated practices in favor of more-effective ones by shifting the basis for decision making from tradition, intuition, and unsystematic experience to firmly grounded scientific research.
An individual or organisation is justified in claiming that a specific practice is evidence-based if, and only if, three conditions are met. First, the individual or organisation possesses comparative evidence about the effects of the specific practice in comparison to the effects of at least one alternative practice. Second, the specific practice is supported by this evidence according to at least one of the individual's or organisation's preferences in the given practice area. Third, the individual or organisation can provide a sound account for this support by explaining the evidence and preferences that lay the foundation for the claim.
History
For most of history, professions have based their practices on expertise derived from experience passed down in the form of tradition. Many of these practices have not been justified by evidence, which has sometimes enabled quackery and poor performance. Even when overt quackery is not present, quality and efficiency of tradition-based practices may not be optimal. As the scientific method has become increasingly recognized as a sound means to evaluate practices, evidence-based practices have become increasingly adopted.
One of the earliest proponents of evidence-based practice was Archie Cochrane, an epidemiologist who authored the book Effectiveness and Efficiency: Random Reflections on Health Services in 1972. Cochrane's book argued for the importance of properly testing health care strategies, and was foundational to the evidence-based practice of medicine. Cochrane suggested that because resources would always be limited, they should be used to provide forms of health care which had been shown in properly designed evaluations to be effective. Cochrane maintained that the most reliable evidence was that which came from randomised controlled trials.
The term "evidence-based medicine" was introduced by Gordon Guyatt in 1990 in an unpublished program description, and the term was later first published in 1992. This marked the first evidence-based practice to be formally established. Some early experiments in evidence-based medicine involved testing primitive medical techniques such as bloodletting, and studying the effectiveness of modern and accepted treatments. There has been a push for evidence-based practices in medicine by insurance providers, which have sometimes refused coverage of practices lacking in systematic evidence of usefulness. It is now expected by most clients that medical professionals should make decisions based on evidence, and stay informed about the most up-to-date information. Since the widespread adoption of evidence-based practices in medicine, the use of evidence-based practices has rapidly spread to other fields.
More recently, there has been a push for evidence-based education. The use of evidence-based learning techniques such as spaced repetition can improve students' rate of learning. Some commentators have suggested that the lack of any substantial progress in the field of education is attributable to practice resting in the unconnected and noncumulative experience of thousands of individual teachers, each re-inventing the wheel and failing to learn from hard scientific evidence about 'what works'. Opponents of this view argue that it is hard to assess teaching methods because it depends on a host of factors, not least those to do with the style, personality and beliefs of the teacher and the needs of the particular children. Others argue the teacher experience could be combined with research evidence, but without the latter being treated as a privileged source. This is in line with a school of thought suggesting that evidence-based practice has limitations and a better alternative is to use Evidence-informed Practice (EIP). This process includes quantitative evidence, does not include non-scientific prejudices, but includes qualitative factors such as clinical experience and the discernment of practitioners and clients.
Versus tradition
Evidence-based practice is a philosophical approach that is in opposition to tradition. Some degree of reliance on "the way it was always done" can be found in almost every profession, even when those practices are contradicted by new and better information.
Some critics argue that since research is conducted on a population level, results may not generalise to each individual within the population. Therefore, evidence-based practices may fail to provide the best solution to each individual, and traditional practices may better accommodate individual differences. In response, researchers have made an effort to test whether particular practices work better for different subcultures, personality types etc. Some authors have redefined evidence-based practice to include practice that incorporates common wisdom, tradition, and personal values alongside practices based on evidence.
Evaluating evidence
Evaluating scientific research is extremely complex. The process can by greatly simplified with the use of a heuristic that ranks the relative strengths of results obtained from scientific research called a hierarchy of evidence. The design of the study and the endpoints measured (such as survival or quality of life) affect the strength of the evidence. Typically, systematic reviews and meta-analysis rank at the top of the hierarchy while randomized controlled trials rank above observational studies, and expert opinion and case reports rank at the bottom. There is broad agreement on the relative strength of the different types of studies, but there is no single, universally-accepted hierarchy of evidence. More than 80 different hierarchies have been proposed for assessing medical evidence.
Applications
Medicine
Evidence-based medicine is an approach to medical practice intended to optimize decision-making by emphasizing the use of evidence from well-designed and well-conducted research. Although all medicine based on science has some degree of empirical support, evidence-based medicine goes further, classifying evidence by its epistemologic strength and requiring that only the strongest types (coming from meta-analyses, systematic reviews, and randomized controlled trials) can yield strong recommendations; weaker types (such as from case-control studies) can yield only weak recommendations. The term was originally used to describe an approach to teaching the practice of medicine and improving decisions by individual physicians about individual patients. Use of the term rapidly expanded to include a previously described approach that emphasized the use of evidence in the design of guidelines and policies that apply to groups of patients and populations ("evidence-based practice policies").
Whether applied to medical education, decisions about individuals, guidelines and policies applied to populations, or administration of health services in general, evidence-based medicine advocates that to the greatest extent possible, decisions and policies should be based on evidence, not just the beliefs of practitioners, experts, or administrators. It thus tries to assure that a clinician's opinion, which may be limited by knowledge gaps or biases, is supplemented with all available knowledge from the scientific literature so that best practice can be determined and applied. It promotes the use of formal, explicit methods to analyze evidence and makes it available to decision makers. It promotes programs to teach the methods to medical students, practitioners, and policymakers.
A process has been specified that provides a standardised route for those seeking to produce evidence of the effectiveness of interventions. Originally developed to establish processes for the production of evidence in the housing sector, the standard is general in nature and is applicable across a variety of practice areas and potential outcomes of interest.
Mental health
To improve dissemination of evidence-based practices, the Association for Behavioral and Cognitive Therapies (ABCT) and the Society of Clinical Child and Adolescent Psychology (SCCAP, Division 53 of the American Psychological Association) maintain updated information on their websites on evidence-based practices in psychology for practitioners and the general public. An evidence-based practice consensus statement was developed at a summit on mental healthcare in 2018. As of June 23, 2019, this statement has been endorsed by 36 organizations.
Metascience
There has since been a movement for the use of evidence-based practice in conducting scientific research in attempt to address the replication crisis and other major issues affecting scientific research. The application of evidence-based practices to research itself is called metascience, which seeks to increase the quality of scientific research while reducing waste. It is also known as "research on research" and "the science of science", as it uses research methods to study how research is done and where improvements can be made. The five main areas of research in metascience are methodology, reporting, reproducibility, evaluation, and incentives. Metascience has produced a number of reforms in science such as the use of study pre-registration and the implementation of reporting guidelines with the goal of bettering scientific research practices.
Education
Evidence-based education (EBE), also known as evidence-based interventions, is a model in which policy-makers and educators use empirical evidence to make informed decisions about education interventions (policies, practices, and programs). In other words, decisions are based on scientific evidence rather than opinion.
EBE has gained attention since English author David H. Hargreaves suggested in 1996 that education would be more effective if teaching, like medicine, was a "research-based profession".
Since 2000, studies in Australia, England, Scotland and the USA have supported the use of research to improve educational practices in teaching reading.
In 1997, the National Institute of Child Health and Human Development convened a national panel to assess the effectiveness of different approaches used to teach children to read. The resulting National Reading Panel examined quantitative research studies on many areas of reading instruction, including phonics and whole language. In 2000 it published a report entitled Teaching Children to Read: An Evidence-based Assessment of the Scientific Research Literature on Reading and its Implications for Reading Instruction that provided a comprehensive review of what was known about best practices in reading instruction in the U.S.
This occurred around the same time as such international studies as the Programme for International Student Assessment in 2000 and the Progress in International Reading Literacy Study in 2001.
Subsequently, evidence-based practice in education (also known as Scientifically based research), came into prominence in the U.S. under the No child left behind act of 2001, replace in 2015 by the Every Student Succeeds Act.
In 2002 the U.S. Department of Education founded the Institute of Education Sciences to provide scientific evidence to guide education practice and policy .
English author Ben Goldacre advocated in 2013 for systemic change and more randomized controlled trials to assess the effects of educational interventions. In 2014 the National Foundation for Educational Research, Berkshire, England published a report entitled Using Evidence in the Classroom: What Works and Why. In 2014 the British Educational Research Association and the Royal Society of Arts advocated for a closer working partnership between teacher-researchers and the wider academic research community.
Reviews of existing research on education
The following websites offer free analysis and information on education research:
- The Best Evidence Encyclopedia is a free website created by the Johns Hopkins University School of Education's Center for Data-Driven Reform in Education (established in 2004) and is funded by the Institute of Education Sciences, U.S. Department of Education. It gives educators and researchers reviews about the strength of the evidence supporting a variety of English programs available for students in grades K–12. The reviews cover programs in areas such as Mathematics, Reading, Writing, Science, Comprehensive school reform, and Early childhood Education; and includes such topics as effectiveness of technology and struggling readers.
- The Education Endowment Foundation was established in 2011 by The Sutton Trust, as a lead charity in partnership with Impetus Trust, together being the government-designated What Works Centre for UK Education.
- Evidence for the Every Student Succeeds Act began in 2017 and is produced by the Center for Research and Reform in Education at Johns Hopkins University School of Education. It offers free up-to-date information on current PK-12 programs in reading, writing, math, science, and others that meet the standards of the Every Student Succeeds Act (the United States K–12 public education policy signed by President Obama in 2015). It also provides information on programs that do meet the Every Student Succeeds Act standards as well as those that do not.
- What Works Clearinghouse, established in 2002, evaluates numerous educational programs, in twelve categories, by the quality and quantity of the evidence, and the effectiveness. It is operated by the federal National Center for Education Evaluation, and Regional Assistance, part of Institute of Education Sciences.
- Social programs that work is administered by the Arnold Ventures LLC's Evidence-Based Policy team. The team is composed of the former leadership of the Coalition for Evidence-Based Policy, a nonprofit, nonpartisan organization advocating the use of well-conducted randomized controlled trials (RCTs) in policy decisions. It offers information on twelve types of social programs including education.
A variety of other organizations offer information on research and education.
The movement towards evidence-based practices attempts to encourage and, in some instances, require professionals and other decision-makers to pay more attention to evidence to inform their decision-making. The goal of evidence-based practice is to eliminate unsound or outdated practices in favor of more-effective ones by shifting the basis for decision making from tradition, intuition, and unsystematic experience to firmly grounded scientific research.
An individual or organisation is justified in claiming that a specific practice is evidence-based if, and only if, three conditions are met. First, the individual or organisation possesses comparative evidence about the effects of the specific practice in comparison to the effects of at least one alternative practice. Second, the specific practice is supported by this evidence according to at least one of the individual's or organisation's preferences in the given practice area. Third, the individual or organisation can provide a sound account for this support by explaining the evidence and preferences that lay the foundation for the claim.
History
For most of history, professions have based their practices on expertise derived from experience passed down in the form of tradition. Many of these practices have not been justified by evidence, which has sometimes enabled quackery and poor performance. Even when overt quackery is not present, quality and efficiency of tradition-based practices may not be optimal. As the scientific method has become increasingly recognized as a sound means to evaluate practices, evidence-based practices have become increasingly adopted.
One of the earliest proponents of evidence-based practice was Archie Cochrane, an epidemiologist who authored the book Effectiveness and Efficiency: Random Reflections on Health Services in 1972. Cochrane's book argued for the importance of properly testing health care strategies, and was foundational to the evidence-based practice of medicine. Cochrane suggested that because resources would always be limited, they should be used to provide forms of health care which had been shown in properly designed evaluations to be effective. Cochrane maintained that the most reliable evidence was that which came from randomised controlled trials.
The term "evidence-based medicine" was introduced by Gordon Guyatt in 1990 in an unpublished program description, and the term was later first published in 1992. This marked the first evidence-based practice to be formally established. Some early experiments in evidence-based medicine involved testing primitive medical techniques such as bloodletting, and studying the effectiveness of modern and accepted treatments. There has been a push for evidence-based practices in medicine by insurance providers, which have sometimes refused coverage of practices lacking in systematic evidence of usefulness. It is now expected by most clients that medical professionals should make decisions based on evidence, and stay informed about the most up-to-date information. Since the widespread adoption of evidence-based practices in medicine, the use of evidence-based practices has rapidly spread to other fields.
More recently, there has been a push for evidence-based education. The use of evidence-based learning techniques such as spaced repetition can improve students' rate of learning. Some commentators have suggested that the lack of any substantial progress in the field of education is attributable to practice resting in the unconnected and noncumulative experience of thousands of individual teachers, each re-inventing the wheel and failing to learn from hard scientific evidence about 'what works'. Opponents of this view argue that it is hard to assess teaching methods because it depends on a host of factors, not least those to do with the style, personality and beliefs of the teacher and the needs of the particular children. Others argue the teacher experience could be combined with research evidence, but without the latter being treated as a privileged source. This is in line with a school of thought suggesting that evidence-based practice has limitations and a better alternative is to use Evidence-informed Practice (EIP). This process includes quantitative evidence, does not include non-scientific prejudices, but includes qualitative factors such as clinical experience and the discernment of practitioners and clients.
Versus tradition
Evidence-based practice is a philosophical approach that is in opposition to tradition. Some degree of reliance on "the way it was always done" can be found in almost every profession, even when those practices are contradicted by new and better information.
Some critics argue that since research is conducted on a population level, results may not generalise to each individual within the population. Therefore, evidence-based practices may fail to provide the best solution to each individual, and traditional practices may better accommodate individual differences. In response, researchers have made an effort to test whether particular practices work better for different subcultures, personality types etc. Some authors have redefined evidence-based practice to include practice that incorporates common wisdom, tradition, and personal values alongside practices based on evidence.
Evaluating evidence
Evaluating scientific research is extremely complex. The process can by greatly simplified with the use of a heuristic that ranks the relative strengths of results obtained from scientific research called a hierarchy of evidence. The design of the study and the endpoints measured (such as survival or quality of life) affect the strength of the evidence. Typically, systematic reviews and meta-analysis rank at the top of the hierarchy while randomized controlled trials rank above observational studies, and expert opinion and case reports rank at the bottom. There is broad agreement on the relative strength of the different types of studies, but there is no single, universally-accepted hierarchy of evidence. More than 80 different hierarchies have been proposed for assessing medical evidence.
Applications
Medicine
Evidence-based medicine is an approach to medical practice intended to optimize decision-making by emphasizing the use of evidence from well-designed and well-conducted research. Although all medicine based on science has some degree of empirical support, evidence-based medicine goes further, classifying evidence by its epistemologic strength and requiring that only the strongest types (coming from meta-analyses, systematic reviews, and randomized controlled trials) can yield strong recommendations; weaker types (such as from case-control studies) can yield only weak recommendations. The term was originally used to describe an approach to teaching the practice of medicine and improving decisions by individual physicians about individual patients. Use of the term rapidly expanded to include a previously described approach that emphasized the use of evidence in the design of guidelines and policies that apply to groups of patients and populations ("evidence-based practice policies").
Whether applied to medical education, decisions about individuals, guidelines and policies applied to populations, or administration of health services in general, evidence-based medicine advocates that to the greatest extent possible, decisions and policies should be based on evidence, not just the beliefs of practitioners, experts, or administrators. It thus tries to assure that a clinician's opinion, which may be limited by knowledge gaps or biases, is supplemented with all available knowledge from the scientific literature so that best practice can be determined and applied. It promotes the use of formal, explicit methods to analyze evidence and makes it available to decision makers. It promotes programs to teach the methods to medical students, practitioners, and policymakers.
A process has been specified that provides a standardised route for those seeking to produce evidence of the effectiveness of interventions. Originally developed to establish processes for the production of evidence in the housing sector, the standard is general in nature and is applicable across a variety of practice areas and potential outcomes of interest.
Mental health
To improve dissemination of evidence-based practices, the Association for Behavioral and Cognitive Therapies (ABCT) and the Society of Clinical Child and Adolescent Psychology (SCCAP, Division 53 of the American Psychological Association) maintain updated information on their websites on evidence-based practices in psychology for practitioners and the general public. An evidence-based practice consensus statement was developed at a summit on mental healthcare in 2018. As of June 23, 2019, this statement has been endorsed by 36 organizations.
Metascience
There has since been a movement for the use of evidence-based practice in conducting scientific research in attempt to address the replication crisis and other major issues affecting scientific research. The application of evidence-based practices to research itself is called metascience, which seeks to increase the quality of scientific research while reducing waste. It is also known as "research on research" and "the science of science", as it uses research methods to study how research is done and where improvements can be made. The five main areas of research in metascience are methodology, reporting, reproducibility, evaluation, and incentives. Metascience has produced a number of reforms in science such as the use of study pre-registration and the implementation of reporting guidelines with the goal of bettering scientific research practices.
Education
Evidence-based education (EBE), also known as evidence-based interventions, is a model in which policy-makers and educators use empirical evidence to make informed decisions about education interventions (policies, practices, and programs). In other words, decisions are based on scientific evidence rather than opinion.
EBE has gained attention since English author David H. Hargreaves suggested in 1996 that education would be more effective if teaching, like medicine, was a "research-based profession".
Since 2000, studies in Australia, England, Scotland and the USA have supported the use of research to improve educational practices in teaching reading.
In 1997, the National Institute of Child Health and Human Development convened a national panel to assess the effectiveness of different approaches used to teach children to read. The resulting National Reading Panel examined quantitative research studies on many areas of reading instruction, including phonics and whole language. In 2000 it published a report entitled Teaching Children to Read: An Evidence-based Assessment of the Scientific Research Literature on Reading and its Implications for Reading Instruction that provided a comprehensive review of what was known about best practices in reading instruction in the U.S.
This occurred around the same time as such international studies as the Programme for International Student Assessment in 2000 and the Progress in International Reading Literacy Study in 2001.
Subsequently, evidence-based practice in education (also known as Scientifically based research), came into prominence in the U.S. under the No child left behind act of 2001, replace in 2015 by the Every Student Succeeds Act.
In 2002 the U.S. Department of Education founded the Institute of Education Sciences to provide scientific evidence to guide education practice and policy .
English author Ben Goldacre advocated in 2013 for systemic change and more randomized controlled trials to assess the effects of educational interventions. In 2014 the National Foundation for Educational Research, Berkshire, England published a report entitled Using Evidence in the Classroom: What Works and Why. In 2014 the British Educational Research Association and the Royal Society of Arts advocated for a closer working partnership between teacher-researchers and the wider academic research community.
Reviews of existing research on education
The following websites offer free analysis and information on education research:
- The Best Evidence Encyclopedia is a free website created by the Johns Hopkins University School of Education's Center for Data-Driven Reform in Education (established in 2004) and is funded by the Institute of Education Sciences, U.S. Department of Education. It gives educators and researchers reviews about the strength of the evidence supporting a variety of English programs available for students in grades K–12. The reviews cover programs in areas such as Mathematics, Reading, Writing, Science, Comprehensive school reform, and Early childhood Education; and includes such topics as effectiveness of technology and struggling readers.
- The Education Endowment Foundation was established in 2011 by The Sutton Trust, as a lead charity in partnership with Impetus Trust, together being the government-designated What Works Centre for UK Education.
- Evidence for the Every Student Succeeds Act began in 2017 and is produced by the Center for Research and Reform in Education at Johns Hopkins University School of Education. It offers free up-to-date information on current PK-12 programs in reading, writing, math, science, and others that meet the standards of the Every Student Succeeds Act (the United States K–12 public education policy signed by President Obama in 2015). It also provides information on programs that do meet the Every Student Succeeds Act standards as well as those that do not.
- What Works Clearinghouse, established in 2002, evaluates numerous educational programs, in twelve categories, by the quality and quantity of the evidence, and the effectiveness. It is operated by the federal National Center for Education Evaluation, and Regional Assistance, part of Institute of Education Sciences.
- Social programs that work is administered by the Arnold Ventures LLC's Evidence-Based Policy team. The team is composed of the former leadership of the Coalition for Evidence-Based Policy, a nonprofit, nonpartisan organization advocating the use of well-conducted randomized controlled trials (RCTs) in policy decisions. It offers information on twelve types of social programs including education.
A variety of other organizations offer information on research and education.
