Results of an Astronomy Literacy Survey

Kristine Larsen

CCSU

In the spring of 1994, an anonymous survey was given in the first week of classes to all students enrolled in non-science major level ESCI courses that had an astronomy component, namely ESCI 110, 111, 117, and 118. 444 students completed the survey, 160 males and 284 females. The survey was repeated in the spring of 2005. 251 students were surveyed, 99 males and 152 females. The lower number of students is a direct result of a decline in the number of sections of ESCI 111 offered, and limiting the number of seats offered in ESCI 118. What follows is a preliminary analysis of the results, mainly comparing results by sex and year administered.

The first eleven questions tested basic astronomical knowledge. The correct answer is noted in italics. For the sake of this preliminary analysis, a difference of 5 percentage points or greater will be considered a “significant difference.”

1) How many known planets are there in the solar system?

No significant change is seen over time, with males scoring significantly higher than females. The one difference of interest is in students choosing 10 or 11, which increased from 6.7 and 7.4 % in 1994 to 8.1 and 11.8% in 2005. This is probably due to media coverage of the Kuiper Belt objects Quaoar and Sedna, which some articles called planets. Another explanation could be media coverage of the discovery of extrasolar planets, and student assumptions that all planets belong to our solar system.

2) The seasons are caused by

No significant change is seen over time, with males consistently scoring significantly higher than females.

3) The phases of the moon are caused by

In 1994, this was the sole question answered correctly by more females than males (a significant difference at that). However, in 2005 males scored significantly higher than females on this question.

4) The universe is

Both males and females significantly improved their responses to this question in 2005. This may be due to extensive media coverage of discoveries in cosmology, such as the acceleration of the expansion of the universe.

5) Night and day are caused by

In both data sets, males scored significantly higher than females. However, there was a significant drop in the correct answer among males from 1994 to 2005.

6) Which of the following is most correct

No significant change was noted in these responses. Males significantly outscored females in both data sets.

7) Why do the sun and stars look different in size?

In both data sets, males significantly outscored females. Males improved their scores by 11.2 percentage points between 1994 and 2005. No obvious reason is apparent for this improvement.

8) A _________ is a tool that astronomers use to view distant planets and stars.

No significant difference is found by sex or year.

9) An eclipse of the sun is caused by

In 1994, there was a nearly 25 percentage points difference between male and female correct responses. In 2005, the difference was roughly halved, because correct male responses significantly fell.

10) Is it ever possible to see the moon during the day?

There was no significant change in the responses from 1994 to 2005. In 1994, males significantly outscored females, while the difference was cut to 3.7 percentage points in 2005 because of a drop in correct male responses.

11) The length of the year is determined by

No significant change was noted between the 1994 and 2005 data. In both cases, males significantly outscored females.

Overall, males outperformed females in both samples. In 1994, males did better on 10 of the 11 questions, and significantly better on 8 out of 11. Females did significantly better on one. In 2005, males scored better on 10 out of 11, and significantly better on 8 out of 11. On one question, there was no difference between males and females.

Comparing the 1994 and 2005 data, males essentially scored the same on 6 questions, significantly improved on 3 questions, and significantly worsened on 2 questions, while females remained the same on 10 questions and improved on 1. Therefore, the basic astronomical knowledge of students has not significantly increased from 1994 to 2005.

12) Sex

The gender difference did not significantly change between the data sets. Females outnumbered males nearly 2-to-1. This may reflect a self-selection process where females avoid chemistry and physics courses, opting instead for earth science.

13) How many years of math did you have in high school?

Average:                                                                       3.3              3.35             3.66              3.71

In both data sets, females had slightly more math courses in high school than their male counterparts, and both sexes had on average a third of a year more math courses in high school in 2005 than 1994. Unfortunately, this did not appear to have any affect on the answers to the astronomy fact questions.

14) How many years of science did you have in high school?

Average:                                                                       2.76           2.65                 3.34             3.13

In both data sets, females had slightly fewer years of science than their male counterparts, but both groups showed an increase in science background from 1994 to 2005 (about half a year). Unfortunately, this did not appear to have any affect on the answers to the astronomy fact questions.

15) Were you taught any astronomy in high school?

Between 1994 and 2005, significantly more male students seemed to receive some astronomy background in high school, but the figures for females remained the same. However, even in 2005 only half the students remembered receiving any high school education in astronomy.

16) How many math courses have you completed in college?

A significant shift is seen from 1994 to 2005. This may reflect a concerted effort to have students complete MATH 099 and/or 101 during their freshman year. In addition, it appears that more students with a significant math background are electing to take basic earth science courses as electives. Unfortunately, this did not appear to have any affect on the answers to the astronomy fact questions.

17) How many science courses have you completed in college?

A significant shift is seen in both sexes from 1994 to 2005. It appears that Earth Science is commonly the second science courses taken by many students. Unfortunately, this did not appear to have any affect on the answers to the astronomy fact questions.

18) Do you consider yourself to have “math phobia”?

In 1994, 38.8% of males and 43.6% of females reported having some math phobia. In 2005, these figures are 46.5% and 50% for females. This increase is obviously alarming, especially given the fact that these same students had taken more math courses, both in high school and college, than their 1994 counterparts.

19) Do you consider yourself to have “science phobia”?

In 1994, 26.9% of males and 44% of females self-reported some science phobia. In 2005, the figures were 27.2% and 36.2 %. The significant drop in science phobia among female students is heartening, but did not appear to have any affect on the answers to the astronomy fact questions.

20) Do you believe in astrology (horoscopes)?

These results were perhaps the most distressing of the entire survey. In 1994, 20.6% of males and 50% of females admitted some belief in astrology. In 2005, these figures had risen to 34.4% and 54% respectively. These results may lead one to question the effectiveness of CCSU general education in honing a student’s critical thinking skills.

21) How important do you believe is a basic knowledge of astronomy?

In 1994, 80.7% of males and 84.6% of females believed a basic knowledge of astronomy has some importance. In 2005 these figures were 86.9 and 84.2, respectively. Although there was a significant change in the male responses, this did not appear to have any affect on the answers to the astronomy fact questions.