Results of an Astronomy Literacy Survey
Kristine Larsen
CCSU
In the spring of 1994, an anonymous survey was given in the first week of classes to all students enrolled in non-science major level ESCI courses that had an astronomy component, namely ESCI 110, 111, 117, and 118. 444 students completed the survey, 160 males and 284 females. The survey was repeated in the spring of 2005. 251 students were surveyed, 99 males and 152 females. The lower number of students is a direct result of a decline in the number of sections of ESCI 111 offered, and limiting the number of seats offered in ESCI 118. What follows is a preliminary analysis of the results, mainly comparing results by sex and year administered.
The first eleven questions tested basic astronomical knowledge. The correct answer is noted in italics. For the sake of this preliminary analysis, a difference of 5 percentage points or greater will be considered a “significant difference.”
1) How many known planets are there in the solar system?
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
7 |
8.8 |
15.8 |
10.1 |
16.4 |
|
8 |
11.9 |
10.2 |
6.1 |
8.6 |
|
9 |
73.8 |
66.2 |
75.8 |
63.2 |
|
10 |
3.8 |
3.9 |
2.0 |
7.2 |
|
11 |
1.9 |
3.5 |
6.1 |
4.6 |
No significant change is seen over time, with males scoring significantly higher than females. The one difference of interest is in students choosing 10 or 11, which increased from 6.7 and 7.4 % in 1994 to 8.1 and 11.8% in 2005. This is probably due to media coverage of the Kuiper Belt objects Quaoar and Sedna, which some articles called planets. Another explanation could be media coverage of the discovery of extrasolar planets, and student assumptions that all planets belong to our solar system.
2) The seasons are caused by
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
The earth’s distance from the sun |
24.4 |
31.0 |
20.2 |
29.6 |
|
The tilt of the earth’s axis |
75.6 |
68.0 |
77.8 |
69.1 |
|
Seasons are only a figment of the calendar |
0 |
0.35 |
0 |
0.7 |
|
Scientists don’t know |
0 |
0.35 |
1.0 |
0.7 |
No significant change is seen over time, with males consistently scoring significantly higher than females.
3) The phases of the moon are caused by
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
The orbit of the moon around the earth |
51.9 |
58.8 |
61.6 |
56.6 |
|
The shadow of the earth on the moon |
47.5 |
38.0 |
38.4 |
41.4 |
|
Clouds on the moon |
0.6 |
2.5 |
0 |
1.3 |
|
Scientists don’t know |
0 |
0.35 |
0 |
0.7 |
In 1994, this was the sole question answered correctly by more females than males (a significant difference at that). However, in 2005 males scored significantly higher than females on this question.
4) The universe is
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
Shrinking |
3.8 |
9.9 |
0 |
3.9 |
|
Expanding |
40.6 |
38.4 |
54.5 |
54.6 |
|
A constant size |
16.3 |
27.5 |
15.2 |
20.4 |
|
Scientists don’t know |
37.5 |
22.5 |
30.3 |
21.1 |
Both males and females significantly improved their responses to this question in 2005. This may be due to extensive media coverage of discoveries in cosmology, such as the acceleration of the expansion of the universe.
5) Night and day are caused by
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
The sun orbiting the earth |
3.1 |
11.3 |
7.1 |
11.2 |
|
The earth spinning on its axis |
66.3 |
50.4 |
59.6 |
48.7 |
|
The earth orbiting the sun |
30.0 |
38.4 |
33.3 |
40.1 |
|
Scientists don’t know |
0.6 |
0 |
0 |
0 |
In both data sets, males scored significantly higher than females. However, there was a significant drop in the correct answer among males from 1994 to 2005.
6) Which of the following is most correct
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
The earth goes around the sun |
93.8 |
85.2 |
91.9 |
86.8 |
|
The sun goes around the earth |
5.6 |
14.4 |
8.1 |
11.8 |
|
Scientists don’t know |
0.6 |
0.35 |
0 |
0.7 |
No significant change was noted in these responses. Males significantly outscored females in both data sets.
7) Why do the sun and stars look different in size?
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
The sun appears larger because it is much closer than any of the stars |
70.6 |
59.5 |
81.8 |
62.5 |
|
The sun is actually much larger than any of the stars |
22.5 |
28.9 |
13.1 |
27.6 |
|
The sun is not a star |
2.5 |
6.7 |
3.0 |
4.6 |
|
The sun is hotter than any of the stars |
3.8 |
4.2 |
2.0 |
4.6 |
|
Scientists don’t know |
0.6 |
0.7 |
0 |
0 |
In both data sets, males significantly outscored females. Males improved their scores by 11.2 percentage points between 1994 and 2005. No obvious reason is apparent for this improvement.
8) A _________ is a tool that astronomers use to view distant planets and stars.
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
Microscope |
0.6 |
2.5 |
0 |
4.6 |
|
Telescope |
98.8 |
96.8 |
96.0 |
92.8 |
|
both |
0.6 |
0.7 |
4.0 |
2.6 |
No significant difference is found by sex or year.
9) An eclipse of the sun is caused by
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
The earth passing between the sun and moon |
6.9 |
16.2 |
12.1 |
17.8 |
|
The moon passing between the sun and earth |
90.0 |
65.1 |
80.8 |
67.1 |
|
The sun passing between the earth and moon |
2.5 |
16.5 |
6.1 |
13.8 |
|
The sun suddenly dimming unexpectedly |
0 |
1.8 |
1.0 |
0.7 |
|
Scientists don’t know |
0 |
0.35 |
0 |
0.7 |
In 1994, there was a nearly 25 percentage points difference between male and female correct responses. In 2005, the difference was roughly halved, because correct male responses significantly fell.
10) Is it ever possible to see the moon during the day?
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
No, never |
1.3 |
1.8 |
2.0 |
5.3 |
|
Only during an eclipse |
5.0 |
11.3 |
8.1 |
8.6 |
|
Yes, sometimes |
93.8 |
87.0 |
89.9 |
86.2 |
There was no significant change in the responses from 1994 to 2005. In 1994, males significantly outscored females, while the difference was cut to 3.7 percentage points in 2005 because of a drop in correct male responses.
11) The length of the year is determined by
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
The time it takes the moon to go around the earth |
2.5 |
4.2 |
3.0 |
3.9 |
|
The time it takes for the earth to go around the sun |
80.0 |
61.6 |
81.8 |
66.4 |
|
The time it takes for the earth to spin once on its axis |
13.1 |
26.8 |
14.1 |
26.3 |
|
The year has always been determined without regard to astronomy |
4.4 |
7.0 |
1.0 |
3.3 |
No significant change was noted between the 1994 and 2005 data. In both cases, males significantly outscored females.
Overall, males outperformed females in both samples. In 1994, males did better on 10 of the 11 questions, and significantly better on 8 out of 11. Females did significantly better on one. In 2005, males scored better on 10 out of 11, and significantly better on 8 out of 11. On one question, there was no difference between males and females.
Comparing the 1994 and 2005 data, males essentially scored the same on 6 questions, significantly improved on 3 questions, and significantly worsened on 2 questions, while females remained the same on 10 questions and improved on 1. Therefore, the basic astronomical knowledge of students has not significantly increased from 1994 to 2005.
12) Sex
|
|
1994 |
2005 |
|
Male |
36.0 |
39.4 |
|
Female |
64.0 |
60.6 |
The gender difference did not significantly change between the data sets. Females outnumbered males nearly 2-to-1. This may reflect a self-selection process where females avoid chemistry and physics courses, opting instead for earth science.
13) How many years of math did you have in high school?
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
1 or less |
3.8 |
1.4 |
2.0 |
0 |
|
2 |
15.0 |
12.7 |
5.1 |
2.6 |
|
3 |
31.3 |
36.6 |
22.2 |
26.3 |
|
4 |
45.0 |
44.4 |
66.7 |
68.4 |
|
5 |
4.4 |
4.6 |
4.0 |
2.6 |
Average: 3.3 3.35 3.66 3.71
In both data sets, females had slightly more math courses in high school than their male counterparts, and both sexes had on average a third of a year more math courses in high school in 2005 than 1994. Unfortunately, this did not appear to have any affect on the answers to the astronomy fact questions.
14) How many years of science did you have in high school?
|
|
1994 M |
1994 F |
2005 M |
2005 F |
|
1 or less |
6.9 |
10.2 |
3.0 |
3.9 |
|
2 |
32.5 |
35.2 |
11.1 |
20.4 |
|
3 |
36.9 |