Using Technology to Accelerate the Construction of Concept Inventories - Latent Semantic Analysis and the Biology Concept Inventory

Kathy Garvin-Doxas, Michael Klymkowsky, Isidoros Doxas, Walter Kintsch

Abstract

Concept Inventories are multiple choice instruments that map students’ conceptual understanding in a given subject area. They underpin some of the most effective teaching methods in science education, but they are labour intensive and expensive to construct, which limits their wide use in instruction. We describe how we use Latent Semantic Analysis to accelerate the construction of Concept Inventories in general, and the Biology Concept Inventory in particular.

References

  1. Bloom, B. S., The 2 Sigma Problem: the Search for Methods of Group Instruction as Effective as One-onOne Tutoring, Educ. Res. 13, 4 (1984).
  2. Garvin-Doxas, K. and M. W. Klymkowsky. Understanding Randomness and its impact on Student Learning: Lessons from the Biology Concept Inventory (BCI). CBE Life Sci Educ 7: 227-233 (2008).
  3. Garvin-Doxas, K., I. Doxas, and M.W. Klymkowsky. Ed's Tools: A web-based software toolset for accelerated concept inventory construction. Proceedings of the National STEM Assessment Conference 2006. D. Deeds & B. Callen, eds. Pp. 130-139 (2007).
  4. Hake, R., Interactive engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses, American Journal of Physics, 66, pp. 64 (1998).
  5. Kalas P, O'Neill A, Pollock C, Birol G., Development of a meiosis concept inventory, CBE Life Sci Educ. 12(4):655-64. doi: 10.1187/cbe.12-10-0174 (2013).
  6. Kintsch, E., D. Steinhart, G. Stahl, Developing summarization skills through the use of LSA-based feedback, Interactive Learning Environments, 8 (2000).
  7. Klymkowsky, M.W. and K. Garvin-Doxas. Recognizing Student Misconceptions through Ed's Tool and the Biology Concept Inventory. PLoS Biology, 6(1): e3. doi:10.1371/journal.pbio.0060003, (2008).
  8. Landauer, T. K., P. Foltz, and D. Laham, An introduction to Latent Semantic Analysis. Discourse Processes, 25, 259-284 (1998).
  9. Landauer, T. K. and Dumais, S. T., A solution to Plato's problem: the Latent Semantic Analysis theory of acquisition, induction and representation of knowledge. Psychological Review, 104(2), 211-240 (1997).
  10. Libarkin, J., and S. Anderson, Development of the Geoscience Concept Inventory, Proceedings of the National STEM Assessment Conference, Washington DC, p. 148-158, (2006).
  11. McDermott, L.C., P.S. Schaffer, and the Physics Education Group at the University of Washington, Tutorial in Introductory Physics, Prentice Hall, New York (1998).
  12. Midkiff, K. C., T. A. Litzinger, D. L. Evans, Development of Engineering Thermodynamics Concept Inventory Instrument, 31st ASEE/IEEE Frontiers in Education Conference, Reno, NV (2001).
  13. Rasch, G. On General Laws and the Meaning of Measurement in Psychology. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 4: Contributions to Biology and Problems of Medicine, 321--333, University of California Press, Berkeley, Calif., (1961).
  14. Smith, M. K., W. B. Wood, and J. K. Knight, The Genetics Concept Assessment: A New Concept Inventory for Gauging Student Understanding of Genetics, CBE Life Sci Educ 7, 422, (2008).
  15. Zeilik, Michael, C. Schau, N. Mattern, S. Hall, K. W. Teague, and W. Bisard, Conceptual astronomy: A novel approach for teaching postsecondary science courses. American Journal of Physics 65:10, 987-996, (1997).
Download


Paper Citation


in Harvard Style

Garvin-Doxas K., Klymkowsky M., Doxas I. and Kintsch W. (2014). Using Technology to Accelerate the Construction of Concept Inventories - Latent Semantic Analysis and the Biology Concept Inventory . In Proceedings of the 6th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-021-5, pages 301-308. DOI: 10.5220/0004957403010308


in Bibtex Style

@conference{csedu14,
author={Kathy Garvin-Doxas and Michael Klymkowsky and Isidoros Doxas and Walter Kintsch},
title={Using Technology to Accelerate the Construction of Concept Inventories - Latent Semantic Analysis and the Biology Concept Inventory},
booktitle={Proceedings of the 6th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2014},
pages={301-308},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004957403010308},
isbn={978-989-758-021-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Using Technology to Accelerate the Construction of Concept Inventories - Latent Semantic Analysis and the Biology Concept Inventory
SN - 978-989-758-021-5
AU - Garvin-Doxas K.
AU - Klymkowsky M.
AU - Doxas I.
AU - Kintsch W.
PY - 2014
SP - 301
EP - 308
DO - 10.5220/0004957403010308