Conception of scientific literacy in the development of scientific literacy assessment tools: A systematic theoretical review
DOI:
https://doi.org/10.36681/tused.2023.016Keywords:
Scientific literacy, Scientific literacy framework, Instrument development, Systematic literature review, Science educationAbstract
Scientific literacy has become the goal of science education throughout the world. To assess scientific literacy, the development of a scientific literacy instrument is imperative. Several scientific literacy instruments have been created, such as those for the Programme for International Student Assessment (PISA) and Project 61 for Science for All America. In this study, the authors conducted a systematic literature reviewof journal articles that report on the development of instruments to measure scientific literacy. This study used Publish or Perish 7 software to study all related articles from the SCOPUS database using keywords related to scientific literacy instrument assessment. The result shows that of 290 articles there were 46 articles that developed scientific literacy instruments and 43 articles that used at least one framework to create scientific literacy instruments. This study found 12 frameworks that had been used to develop scientific literacy instruments. However, the authors also found an article that did not use any framework to create a scientific literacy instrument. In this article, the authors discuss the trend of scientific literacy instrument development and its framework, how the framework has been used, and possibilities for future studies regarding the development of scientific literacy instruments.
Downloads
References
Ahmada, R. F., Suwono, H., & Fachrunnisa, R. (2021). Development scientific literacy through STEM project in biology classroom: A mixed method analysis. AIP Conference Proceedings, 2330(Query date: 2021-03-22 14:24:27). https://doi.org/10.1063/5.0043260
Anderson, L. W., & Krathwohl, D. W. (2001). A Taxonomy for Learning Teaching, and Assessing A Revision of Bloom’s Taxonomy of Educational Objectives. Longman.
Astriawati, F., & Djukri. (2019). Developing Chamilo-Based E-Learning in Environmental Change Material to Enhance Students’ Scientific Literacy Skills. Journal of Physics: Conference Series, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1742-6596/1397/1/012049/meta
Baker, D. R., & Piburn, M. (1991). Process skills acquisition, cognitive growth, and attitude change of ninth grade students in a scientific literacy course. Journal of Research in Science Teaching, 28(5), 423–436. https://doi.org/10.1002/tea.3660280506
Benjamin, T. E., Marks, B., Demtrikopoulos, M. K., Rose, J., Pollard, E., Thomas, A., & Muldrow, L. L. (2017). Development and Validation of Scientific Literacy Scale for College Preparedness in STEM with Freshmen from Diverse Institutions. International Journal of Science and Mathematics Education, 15(4), 607–623. https://doi.org/10.1007/s10763-015-9710-x
Biggs, J. (n.d.). SOLO Taxonomy. Retrieved from https://www.johnbiggs.com.au/academic/solo-taxonomy/
Biggs, J. B., & Collis, K. F. (1982). Evaluating the Quality of Learning: The SOLO Taxonomy. Academic Press.
Black, P. (2004). Issues in assessment. Paper Presented at the Assessment Systems for the Future Project Seminar, January 2004. http://www.assessment-reform-group.org
Bybee, R., McCrae, B., & Laurie, R. (2009). PISA 2006: An assessment of scientific literacy. Journal of Research in Science …, Query date: 2020-08-14 14:24:03. https://onlinelibrary.wiley.com/doi/abs/10.1002/tea.20333
Chang, S., & Chiu, M.-H. (2005). The development of authentic assessments to investigate ninth graders’ scientific literacy: In the case of scientific cognition concerning the concepts of chemistry and physics. International Journal of Science and Mathematics Education, 3(1), 117–140. https://doi.org/10.1007/s10763-004-5239-0
Chiappetta, E. L., Sethna, G. H., & Fillman, D. A. (1991). A quantitative analysis of high school chemistry textbooks for scientific literacy themes and expository learning aids. Journal of Research in Science Teaching, 28(10), 939–951.
Cronin, P., Ryan, F., & Coughlan, M. (2008). Undertaking a literature review: A step-by-step approach. British Journal of Nursing (Mark Allen Publishing), 17, 38–43. https://doi.org/10.12968/bjon.2008.17.1.28059
D’Agostino, E. M. (2020). Teens learning epidemiology? A cohort study on epidemiology instruction for high school youth. Annals of Epidemiology, 47(Query date: 2021-03-22 14:25:57), 8–12. https://doi.org/10.1016/j.annepidem.2020.05.010
Fensham, P. J. (2008). Science Education Policy-Making. UNESCO.
Fives, H., Huebner, W., Birnbaum, A. S., & Nicolich, M. (2014). Developing a Measure of Scientific Literacy for Middle School Students. Science Education, 98(4), 549–580. https://doi.org/10.1002/sce.21115
Gormally, C., Brickman, P., & Lutz, M. (2012). Developing a test of scientific literacy skills (TOSLS): Measuring undergraduates’ evaluation of scientific information and arguments. CBE Life Sciences Education, 11(4), 364–377. https://doi.org/10.1187/cbe.12-03-0026
Gunawan, G., Jufri, A. W., Nisrina, N., Al-Idrus, A., Ramdani, A., & Harjono, A. (2021). Guided inquiry blended learning tools (GI-BL) for school magnetic matter in junior high school to improve students’ scientific literacy. Journal of Physics: Conference Series, 1747(1). https://doi.org/10.1088/1742-6596/1747/1/012034
Hardianti, R. D., & Wusqo, I. U. (2020). Fostering students’ scientific literacy and communication through the development of collaborative-guided inquiry handbook of green chemistry experiments. Journal of Physics: Conference Series, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1742-6596/1567/2/022059/meta
Harlen, W. (2005). Teachers’ summative practices and assessment for learning – tensions and synergies. Curriculum Journal, 16(2), 207–223. https://doi.org/10.1080/09585170500136093
Hartini, S. (2018). Developing of Physics Learning Material Based on Scientific Literacy to Train Scientific Process Skills. Journal of Physics: Conference Series, 1097(1). https://doi.org/10.1088/1742-6596/1097/1/012032
Holbrook, J., & Rannikmae, M. (2009). The Meaning of Scientific Literacy. International Journal of Environmental & Science Education, 4(3), 275–288.
Hudha, M. N., Batlolona, J. R., & Wartono, W. (2019). Science literation ability and physics concept understanding in the topic of work and energy with inquiry-STEM. AIP Conference …, Query date: 2020-08-14 14:24:03. https://aip.scitation.org/doi/abs/10.1063/1.5141676
Hufri. (2019). Practicality and effectiveness of physics teaching materials based on contextual through inquiry to increase studentsscience literacy. Journal of Physics: Conference Series, 1317(1). https://doi.org/10.1088/1742-6596/1317/1/012159
Hurd, P. D. (1958). Science Literacy: Its meaning for American Schools. Educational Leadership, 16(1), 13–16.
Peraturan Presiden Republik Indonesia Nomor 87 Tahun 2017 tentang Penguatan Pendidikan Karakter, (2017) (testimony of Indonesia).
Jalil, R. M., Prastowo, T., & Widodo, W. (2019). Development of A-SSI Learning Media (Android Social Scientific Issues) to Improve Science Literation in Earth Coating Subject for First Grade of Junior High School. Journal of Physics: Conference …, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1742-6596/1417/1/012085/meta
Jufri, A. W., Hakim, A., & Ramdani, A. (2019). Instrument Development in Measuring the Scientific Literacy Integrated Character Level of Junior High School Students. Journal of Physics: Conference …, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1742-6596/1233/1/012100/meta
Laugksch, R. C. (2000). Scientific literacy: A conceptual overview. Science Education, 84(1), 71–94. https://doi.org/10.1002/(SICI)1098-237X(200001)84:1<71::AID-SCE6>3.0.CO;2-C
Laugksch, R. C., & Spargo, P. E. (1996). Development of a pool of scientific literacy test-items based on selected AAAS literacy goals. Science Education, 80(2), 121–143. https://doi.org/10.1002/(SICI)1098-237X(199604)80:2<121::AID-SCE1>3.0.CO;2-I
Mawaddah, K., Mahanal, S., Gofur, A., Setiawan, D., & Zubaidah, S. (2021). RICOSRE: An innovative learning model to promote scientific literacy. AIP Conference Proceedings, 2330(Query date: 2021-03-22 14:24:27). https://doi.org/10.1063/5.0043303
Millar, R. (1997). Science education for democracy. What can the school curriculum achieve? In Science today: problem or crisis? (pp. 87–101). Routledge Ltd.
Miller, J. D. (1983). Scientific Literacy: A Conceptual and Empirical Review. Daedalus, 112(2), 29–48.
Nafiah, K., Suhadi, S., & Sari, M. S. (2020). The effectiveness of teaching instruments about management invasive alien species Acacia nilotica (L.) Willd. ex Del. through problem based learning (PBL) models toward students scientific literacy and cognitive learning outcomes. AIP Conference Proceedings, 2215(Query date: 2021-03-22 14:24:16). https://doi.org/10.1063/5.0000698
Naganuma, S. (2017). An assessment of civic scientific literacy in Japan: development of a more authentic assessment task and scoring rubric. International Journal of Science Education, Part B: Communication and Public Engagement, 7(4), 301–322. https://doi.org/10.1080/21548455.2017.1323131
Nasution, I. B., Liliawati, W., & ... (2019). Effectiveness problem-based learning (PBL) with reading infusion strategic to improving scientific literacy for high school students on topic global warming. Journal of Physics …, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1742-6596/1280/5/052013/meta
O’Grady, K., & Houme, K. P. (2015). PCAP 2013: Report on the pan-Canadian assessment of science, reading, and mathematics. Council of Ministers of Education, Canada.
OECD. (2009a). PISA 2006 Technical Report. https://www.oecd.org/pisa/data/42025182.pdf
OECD. (2009b). PISA 2009 Assessment Framework: Key competencies in reading, mathematics and science. https://www.oecd.org/pisa/pisaproducts/44455820.pdf
OECD. (2013). PISA 2012 Assessment and Analytical Framework: Mathematics, Reading, Science, Problem Solving and Financial Literacy. OECD Publishing. https://doi.org/10.1787/9789264190511-en
OECD. (2017). PISA 2015 Assessment and Analytical Framework Science, Reading, Mathematic, Financial Literacy and Collaborative Problem Solving, revised edition. PISA, OECD Publishing. http://dx.doi.org/10.1787/9789264281820-en
OECD. (2019). PISA 2018 Assessment and Analytical Framework. PISA, OECD Publishing. https://doi.org/10.1787/b25efab8-en.
Retno, A. T. P., Saputro, S., & Ulfa, M. (2018). Properness test: Development of an inquiry-based learning module to improve science literacy in thermochemistry subject. AIP Conference Proceedings, https://aip.scitation.org/doi/abs/10.1063/1.5062822
Roberts, D. A. (2007). Scientific literacy/science literacy. In S. K. Abell & N. G. Lederman (Eds.), Handbook of Research on Science Education (pp. 729–780). Lawrence Erlbaum Associates.
Rubini, B., Ardianto, D., & Pursitasari, I. D. (2017). Professional development model for science teachers based on scientific literacy. IOP Conference Series …, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1757-899X/166/1/012037/meta
Rusilowati, A., Nugroho, S. E., Susilowati, E. S. M., Mustika, T., Harfiyani, N., & Prabowo, H. T. (2018). The development of scientific literacy assessment to measure student’s scientific literacy skills in energy theme. Journal of Physics: Conference Series 983, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1742-6596/983/1/012046/meta
Sastradika, D., & Jumadi. (2018). Development of subject-specific pedagogy based on guided inquiry about newton’s law to improve senior high school students’ scientific literacy ability. Journal of Physics: Conference Series, 1097(1). https://doi.org/10.1088/1742-6596/1097/1/012017
Scopus. (2022). Title Suggestion. Scopus.
Shofiyah, N., Afrilia, I., & Wulandari, F. E. (2020). Scientific Approach and the Effect on Students Scientific Literacy. Journal of Physics: Conference Series, 1594(1). https://doi.org/10.1088/1742-6596/1594/1/012015
Sinaga, P., Kaniawati, I., & Setiawan, A. (2017). Improving secondary school students’ scientific literacy ability through the design of better science textbooks. Journal of Turkish Science Education, Query date: 2020-08-14 14:24:03. http://www.tused.org/index.php/tused/article/view/176
Suryanti, S. (2021). Gadget-Based Interactive Multimedia on Socio-Scientific Issues to Improve Elementary Students’ Scientific Literacy. International Journal of Interactive Mobile Technologies, 15(1), 56–69. https://doi.org/10.3991/IJIM.V15I01.13675
Susandi, D., Jannati, E. D., Rachmat, A., Karniawati, I., & Siahaan, P. (2020). Development of science literacy instruments in the direct current. PervasiveHealth: Pervasive Computing Technologies for Healthcare, 1(Query date: 2021-03-22 14:24:27), 603–606. https://doi.org/10.4108/eai.12-10-2019.2296478
Tomas, L., & Ritchie, S. M. (2015). The Challenge of Evaluating Students’ Scientific Literacy in a Writing-to-Learn Context. Research in Science Education, 45(1), 41–58. https://doi.org/10.1007/s11165-014-9412-3
Turner, R. (2017). Processing Responses to Open‐Ended Survey Questions. In P. Lietz, J. C. Cresswell, K. F. Rust, & R. J. Adams (Eds.), Implementation of Large‐Scale Education Assessments. John Wiley & Sons.
Vogelzang, J., Admiraal, W. F., & Driel, J. H. van. (2020). Effects of Scrum methodology on students’ critical scientific literacy: The case of Green Chemistry. Chemistry Education Research and Practice, 21(3), 940–952. https://doi.org/10.1039/d0rp00066c
Widowati, A., Anjarsari, P., Zuhdan, K. P., & Dita, A. (2018). Applying innovative approach “Nature of Science (NoS) within inquiry” for developing scientific literacy in the student worksheet. JPhCS, Query date: 2020-08-14 14:24:03. https://iopscience.iop.org/article/10.1088/1742-6596/983/1/012199/met
Downloads
Issue
Section
Published
License
Copyright (c) 2023 Journal of Turkish Science Education
This work is licensed under a Creative Commons Attribution 4.0 International License.