
The difference between the Terra Nova and other National Assessment of Educational Progress (NAEP) tests
By Inderbir Kaur Sandhu, Ph.D
Q:
I am curious about the differences between the Terra Nova
standardized test and the other NAEP test. How do the two
tests compare at the grade school level?
What is the population for grade school children that take
each test, i.e percentage or number of grade school students
taking the Terra Nova test compared to taking the NAEP test?
A: I would like to refer you to
a very interesting and informative site which will answer
most, if not all of your concerns. Please visit the
following site:
Duke Gifted Letter.
The complete article can be found below:
Benefits and Drawbacks of State-level Assessments for
Gifted Students: NCLB and Standardized Testing
Volume 7 / Issue 1 / Fall 2006
By Michael S. Matthews, PhD
If it seems like students have a lot more standardized
testing these days than when you were in school, you are
absolutely right. The No Child Left Behind Act of 2001 (NCLB)
mandates annual testing in math and reading for all students
in grades 3-8 and, at least once more, in grades 9-12. In
addition, many states are piloting standardized testing in
science, because NCLB will begin to require such testing in
the 2007-08 school year.
Rather than developing entirely new standardized tests,
which can be expensive and time-consuming, many states
contract with major testing companies to develop
state-specific versions of existing tests. Generally, these
modifications match the test questions more closely to state
curriculum standards and frameworks. For example, CTB/McGraw
Hill's Terra Nova test is the basis for the Florida
Comprehensive Achievement Test (FCAT), given to
approximately 1.8 million students annually in Florida. The
FCAT questions are aligned with the Sunshine State
Standards, Florida's K-12 educational framework.
NCLB requires all schools to make adequate yearly progress
toward the goal of having all students proficient by 2014.
The states themselves select the assessments, an arrangement
that inadvertently offers them an incentive to select tests
that demonstrate strong student performance. Although NCLB
requires states to implement accountability systems, the act
does not set national standards for student knowledge level
at each grade. In response to these influences, some states
have set demanding proficiency levels for their students
while others have adopted lower standards that artificially
inflate the performance of students in these states.
Concerns for Parents
The increased emphasis on standardized testing concerns
parents of highly able students. Due to their design, paper
and pencil tests emphasize memorization of facts at the
expense of higher-level academic skills and competencies.
Since these complex abilities are not being tested,
classroom instruction in these competencies may be
minimized. Schools may see little need to support academic
acceleration or enrichment for the child who has been
classified as meeting proficiency, a goal that many gifted
students can achieve with limited effort. In addition, state
funding for gifted programs has been reduced—in several
states drastically—as schools reallocate their resources to
focus on raising the competency of their lowest-performing
students.
Criticism of mandatory high-stakes testing is by no means
limited to concern about its effects on gifted students and
programs. Observers note that when facing rewards or
punishments based on test scores, many schools respond by
devoting additional time to test-taking drills and basic
skills development in core areas of reading and math. The
time set aside for these efforts often comes at the expense
of time formerly spent in academic and enrichment areas such
as science, social studies, art, music, and even recess.
Instruction in test-taking skills may be focused so narrowly
on the requirements of one particular test that students are
unable to apply these abilities to other related areas.
Topics that are not on the test may never be covered in
class, or may be limited to the few weeks of school that
remain after annual testing has been completed. These
troublesome effects are most evident at schools with lower
scores, which often tend to be those schools located in low
socio-economic areas or that have more students who are
minorities or English language learners.
Connecting Testing to Performance
As a parent, how can you determine how rigorous your state's
testing regimen is? One approach might involve examining the
proportion of students who score at each level of
performance on your state's accountability test. This
information is usually available from your state's
department of education Web site, or locally through your
school or district officials. You can compare your child's
performance to other students at the school, district, and
state level to determine how your child compares to other
students in these groups.
For example, you might find that 75 percent of the students
at your child's school scored at the top level of
performance on your state's assessment. This may indicate
that the majority of students are performing well, as might
be the case if your child attends a particularly effective
school. However, it could also mean that the criteria
established for this level of performance are not rigorous.
In contrast, if only 6 percent of students score at the top
level, the test may be more rigorous or, perhaps, the school
is less effective. In either scenario, how can you determine
whether it is primarily the quality of the school's
instruction or the difficulty of the test that is producing
the results you have observed?
In-State versus National Comparisons
As mentioned, the structure of NCLB requirements presents a
strong temptation for states to water down their
assessments. As someone who may not be an educator, how can
you determine whether your state has strong or weak
standards?
Fortunately there is a way to compare student achievement
across states, albeit indirectly. The National Assessment of
Educational Progress or NAEP, also referred to as the
Nation's Report Card, is a nationally administered
standardized test of student ability in various subject
areas. The NAEP has been administered voluntarily to
representative samples of students in both public and
private schools since the program's inception in the late
1960s. Although your child's district or school may not
participate in NAEP testing, the schools that do are
selected in such a manner that the NAEP results can be
generalized to other schools in the same state. The NCLB act
now requires all states to participate in NAEP testing, so
your state will have scores available for comparison.
Unfortunately, NAEP does not release scores for individual
students or schools, so, these data cannot be used directly
to evaluate your child or your child's school. However, the
NAEP does provide scores aggregated by state and region,
which can be used to evaluate the rigor of your state's
testing program. If students from your state score
approximately the same on the NAEP as on the state exam,
this suggests that the questions on the state test are of
approximately the same level of difficulty as the questions
on the NAEP. Conversely, if their performance on the NAEP is
substantially lower than that obtained on the state exam,
this suggests either that the state exam is less rigorous or
that the content of the two assessments is not comparable.
Many experts believe that differences in rigor, rather than
in content, are primarily responsible when performance
differences between the NAEP and state tests are observed.
This suggests that if you find performance differences, they
are likely a reflection of actual differences in the
difficulty level of the two measures. Such comparisons are
reported on from time to time in local media. By keeping an
eye out for this information, you can get a good sense of
how your child's performance compares to other students
around the country.
Discussing test comparisons with your child in a supportive
manner can be beneficial, particularly for the child who
wishes to pursue career interests in a nationally or
internationally competitive field. Repeated exposure to
tests that are too easy may lead students to adopt the
mistaken belief that they do not need to study. Students
with this mindset often experience a rude awakening upon
entering a selective college, when their poor performance
leads to the sudden realization that they should have
studied harder when they were younger.
Explaining test scores from an early age and in a positive
way can help your child to understand that their goals
should be greater than simply being the best student on a
test in their school. For the child who excels in
test-taking skills, such comparisons also may help them to
understand that there will always be a more rigorous test
ahead. Being aware of how your state's tests compare to
national standards can help you and your child to make
informed educational decisions.
Michael Matthews is an assistant professor in the
gifted
education program at the University of South Florida in
Tampa.
|