Sociologický časopis / Czech Sociological Review 2024, 60(4): 381-413 | DOI: 10.13060/csr.2023.044

The Effect of Different Secondary School Tracks on Cognitive and Non-cognitive Learning Outcomes – the Application of the Propensity Score Matching Method to Longitudinal Data

Jana Straková ORCID...1, Jaroslava Simonová ORCID...1, Petr Soukup ORCID...2
1 Pedagogická fakulta, Univerzita Karlova, Praha
2 Fakulta sociálních věd, Univerzita Karlova, Praha

Available statistics and research show that there are large differences in the content and conditions of education and the socio-economic composition of students between the tracks offered in the Czech secondary school system (the vocational track, technical track, and academic track). The graduates of these different tracks show large differences in educational outcomes, including non-cognitive outcomes such as motivation to study, self-concept, and civic attitudes. There is no consensus on whether differences in outcomes are primarily due to differences in the knowledge and attitudes that young people already have upon entering the different tracks, or whether the school or the school environment is also responsible for these differences. Using the method of propensity score matching, this study seeks to reveal the differences in knowledge and attitudes of eighteen-year-old students in individual secondary school tracks who had the same characteristics when entering high school, i.e. they had similar study prerequisites and family background. Analyses of a sample of 1,231 academic track students and 1,097 vocational track students suggest that differences in cognitive and non-cognitive outcomes are amplified by the track students attend, but that in many characteristics there are also strong similarities between students across different tracks.

Keywords: upper secondary school tracks, cognitive outcomes, non-cognitive outcomes, propensity score matching

Received: January 9, 2022; Revised: July 24, 2023; Accepted: July 24, 2023; Prepublished online: July 31, 2023; Published: September 5, 2024  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Straková, J., Simonová, J., & Soukup, P. (2024). The Effect of Different Secondary School Tracks on Cognitive and Non-cognitive Learning Outcomes – the Application of the Propensity Score Matching Method to Longitudinal Data. Sociologický časopis / Czech Sociological Review, 60(4), 381-413. doi: 10.13060/csr.2023.044
Share...
Download citation
  • BibTeX (.bib)
  • Bookends (.ris)
  • EasyBib (.ris)
  • EndNote (.enw)
  • EndNote 8 (.xml)
  • ISI WoS (.isi)
  • Medlars (.medlars)
  • Mendeley (.ris)
  • MODS (.xml)
  • Papers (.ris)
  • RefWorks (.txt)
  • RefManager (.ris)
  • RIS (.ris)
  • MS Word (.xml)
  • Zotero (.ris)
    • Open full article

    References

    1. Alm, S. (2011). The worried, the competitive and the indifferent - approaches to the future in youth, their structural roots and outcomes in adult life. Futures, 43(5), 552-562. https://doi.org/10.1016/j.futures.2011.01.012 Go to original source...
    2. Alm, S. a Låftman, S. B. (2016). Future orientation climate in the school class: Relations to adolescent delinquency, heavy alcohol use, and internalizing problems. Children and Youth Services Review, 70, 324-331. https://doi.org/10.1016/j.childyouth.2016.09.021 Go to original source...
    3. Alm, S., Låftman, S. B., Sandahl, J. a Modin, B. (2019). School effectiveness and students' future orientation: A multilevel analysis of upper secondary schools in Stockholm, Sweden. Journal of Adolescence, 70, 62-73. https://doi.org/10.1016/j.adolescence.2018.11.007 Go to original source...
    4. Arens, K., Marsh, H. W., Pekrun, R., Lichtenfeld, S., Murayama, K. a Vom Hofe, R. (2017). Math self-concept, grades, and achievement test scores: Long-term reciprocal effects across five waves and three achievement tracks. Journal of Educational Psychology, 109(5), 621-634. https://doi.org/10.1037/edu0000163 Go to original source...
    5. Austin, P. C. (2008). A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003. Statist. Med., 27, 2037-2049. https://doi.org/10.1002/sim.3150 Go to original source...
    6. Austin, P. C. (2011). An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies. Multivariate Behavioral Research, 46, 399-424. https://doi.org/10.1080/00273171.2011.568786 Go to original source...
    7. Brookover, W. B. a Schneider, J. M. (1975). Academic Environments and Elementary School Achievement. Journal of Research and Development in Education, 9, 82-91.
    8. Byrne, B. M. (2002). Validating the measurement and structure of self-concept: Snapshots of past, present, and future research. The American Psychologist, 57(11), 897-909. https://doi.org/10.1037/0003-066X.57.11.897 Go to original source...
    9. Centrum pro zjišťování výsledků vzdělávání. (2019). Maturitní zkouška 2013-2019 - jarní zkušební období. Signální výsledky částí MZ a zkoušek. Centrum pro zjišťování výsledků vzdělávání.
    10. Cerasoli, C. P., Nicklin, J. M. a Ford, M. T. (2014). Intrinsic motivation and extrinsic incentives jointly predict performance: A 40-year meta-analysis. Psychological Bulletin, 140(4), 980-1008. https://doi.org/10.1037/a0035661 Go to original source...
    11. Conner, J. O., Mason, M. a Mennis, J. (2012). Valuing but Not Liking School: Revisiting the Relationship Between School Attitudes and Substance Use Among Urban Youth. Education and Urban Society, 44(6), 672-687. https://doi.org/10.1177/0013124511406915 Go to original source...
    12. DeAngelis, C. A. (2021). Divergences between effects on test scores and effects on non-cognitive skills. Educational Review, 73(4), 503-514. https://doi.org/10.1080/00131911.2019.1646707 Go to original source...
    13. Deci, E. L., Koestner, R. a Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125(6), 627-668, https://doi.org/10.1037/0033-2909.125.6.627 Go to original source...
    14. Demanet, J. a Van Houtte, M. (2011). Social-etnic composition and school misconduct: Does sense of futility clarify this picture? Sociological Spectrum, 31(2), 224-256. https://doi.org/10.1080/02732173.2011.541343 Go to original source...
    15. Diener, E., Suh, E. M., Lucas, R. E. a Smith, H. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125(2), 276-302. https://doi.org/10.1037/0033-2909.125.2.276 Go to original source...
    16. Dockx, J. a De Fraine, B. (2018). On track for unemployment? Long-term effects of tracks. School Effectiveness and School Improvement, 30(2), 131-154. https://doi.org/10.1080/09243453.2018.1537292. Go to original source...
    17. Dockx, J., De Fraine, B. a Vandecandelaere, M. (2019). Tracks as frames of reference for academic self-concept. Journal of School Psychology, 72, 67-90. https://doi.org/10.1016/j.jsp.2018.12.006 Go to original source...
    18. Dweck, C. (2015). Nastavení mysli - Nová psychologie úspěchu aneb Naučte se využít svůj potenciál. Jan Melvil Publishing.
    19. Dzúrová, D., Csémy, L., Spilková, J. a Lustigová, M. (2015). Zdravotně rizikové chování mládeže v Česku. Státní zdravotní ústav.
    20. Epple, D. a Romano, R. E. (1998). Competition between private and public schools, vouchers, and peer group effects. American Economic Review, 88, 33-62.
    21. Evans, P., Martin, A. J. a Ivcevic, Z. (2018). Personality, coping, and school well-being: An investigation of high school students. Social Psychology of Education, 21(5), 1061-1080. https://doi.org/10.1007/s11218-018-9456-8 Go to original source...
    22. Froiland, J. M. a Oros, E. (2014). Intrinsic motivation, perceived competence and classroom engagement as longitudinal predictors of adolescent reading achievement. Educational Psychology, 34(2), 119-132. https://doi.org/10.1080/01443410.2013.822964 Go to original source...
    23. Frydenberg, E. a Lewis, R. (2009). Relations among well-being, avoidant coping, and active coping in a large sample of australian adolescents. Psychological Reports, 104 (3), 745-758. https://doi.org/10.2466/PR0.104.3.745-758 Go to original source...
    24. Gamoran, A. a Mare, R. D. (1989). Secondary School Tracking and Educational Inequality: Compensation, Reinforcement, or Neutrality? American Journal of Sociology, 94(5), 1146-1183. https://doi.org/10.1086/229114 Go to original source...
    25. Greger, D., Straková, J. a Martinková, P. (2022). Extending the ILSA Study Design to a Longitudinal Design. In T. Nilsen, A. Stancel-Piątak a J. E. Gustafsson (eds.), International Handbook of Comparative Large-Scale Studies in Education. Springer International Handbooks of Education. Springer. https://doi.org/10.1007/978-3-030-38298-8_31-1 Go to original source...
    26. Gorard, S. (2006). Value-added is of little value. Journal of Education Policy, 21(2), 235-243. https://doi.org/10.1080/02680930500500435 Go to original source...
    27. Hallerod, B. (2011). What do children know about their futures: Do children's expectations predict outcomes in middle age? Social Forces, 90(1), 65-83. https://doi.org/10.1093/sf/90.1.65 Go to original source...
    28. Hampf, F. a Woessmann, L. (2016). Vocational vs. General Education and Employment over the Life-Cycle: New Evidence from PIAAC (CESifo Working Paper No. 6116 5). https://doi.org/10.2139/ssrn.2871126 Go to original source...
    29. Hanushek, E. A. (1979). Conceptual and empirical issues in the estimation ofeducational production functions. Journal of Human Resources, 14(3), 351-388. https://doi.org/10.2307/145575 Go to original source...
    30. Hanushek, E. A., Kain, J. F., Markman, J. M. a Rivkin, S. G. (2003). Does peer ability affect student achievement? Journal of Applied Econometrics, 18(5), 527-544. https://doi.org/10.1002/jae.741 Go to original source...
    31. Hanushek, E. A., Woessmann, L. a Zhang, L. (2011). General education, vocational education, and labor-market outcomes over the life-cycle. National Bureau of Economic Research. https://doi.org/10.3386/w17504 Go to original source...
    32. Hanushek, E. A. a Wößmann, L. (2006). Does educational tracking affect performance and inequality? Differences-in-differences evidence across countries. The Economic Journal, 116(510), C63-C76. https://doi.org/10.1111/j.1468-0297.2006.01076.x Go to original source...
    33. Heck, R. H. (2000). Examining the Impact of School Quality on School Outcomes and Improvement: A Value-Added Approach. Educational Administration Quarterly, 36(4), 513-552. https://doi.org/10.1177/00131610021969092 Go to original source...
    34. Heckman, J., Pinto, R. a Savelyev, P. (2013). Understanding the Mechanisms Through Which an Influential Early Childhood Program Boosted Adult Outcomes. American Economic Review, 103(6), 2052-2086. https://doi.org/10.1257/aer.103.6.2052 Go to original source...
    35. Ho, D. E., Imai, K., King, G. a Stuart, E. A. (2007). Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference. Political Analysis, 15(3), 199-236. https://doi.org/10.1093/pan/mpl013 Go to original source...
    36. Hulleman, C. S., Godes, O., Hendricks, B. L. a Harackiewicz, J. M. (2010). Enhancing interest and performance with a utility value intervention. Journal of Educational Psychology, 102(4), 880. https://doi.org/10.1037/a0019506 Go to original source...
    37. Chamoutová, D., Kleňha, D., Koucký, J., Trhlíková, J., Úlovec, M. a Vojtěch, J. (2019). Uplatnění absolventů škol na trhu práce - 2018. Národní ústav pro vzdělávání.
    38. Jarkovská, L. a Lišková, K. (2008). Genderové aspekty českého školství. Sociologický časopis / Czech Sociological Review, 44(4), 683-701. https://doi.org/10.13060/00380288.2008.44.4.04 Go to original source...
    39. Johnson, M. K. a Hitlin, S. (2017). Family (dis)advantage and life course expectations. Social Forces, 95(3), 997-1022. https://doi.org/10.1093/sf/sow094 Go to original source...
    40. Katrňák, T. (2004). Odsouzeni k manuální práci: Vzdělanostní reprodukce v dělnické rodině. Sociologické nakladatelství (SLON).
    41. Kelly, S. a Carbonaro, W. (2012). Curriculum tracking and teacher expectations: evidence from discrepant course taking models. Social Psychology of Education, 15(3), 271-294. https://doi.org/10.1007/s11218-012-9182-6 Go to original source...
    42. Kunter, M. a Baumert, J. (2006). Who is the expert? Construct and crietria validity of student and teacher ratings of instruction. Learning Environments Research, 9(3), 231-251. https://doi.org/10.1007/s10984-006-9015-7 Go to original source...
    43. Lee, J. a Stankov, L. (2018). Non-cognitive predictors of academic achievement: Evidence from TIMSS and PISA. Learning and Individual Differences, 65, 50-64. https://doi.org/10.1016/j.lindif.2018.05.009 Go to original source...
    44. Lens, W., Paixão, M. P. a Herrera, D. 2009. Instrumental motivation is extrinsic motivation: So what??? Psychologica, (50), 21-40. https://doi.org/10.14195/1647-8606_50_2 Go to original source...
    45. Lewis, A. D., Huebner, E. S., Malone, P. S. a Valois, R. F. (2011). Life satisfaction and student engagement in adolescents. Journal of Youth and Adolescence, 40(3), 249-262. https://doi.org/10.1007/s10964-010-9517-6 Go to original source...
    46. Liu, A. (2020). Non-Cognitive skills and the growing achievement Gap⋆. Research in Social Stratification and Mobility, 69, 100546. https://doi.org/10.1016/j.rssm.2020.100546 Go to original source...
    47. Liu, Y., Hau, K.-.T, Liu, H., Wu, J., Wang, X. a Zheng, X. (2020). Multiplicative effect of intrinsic and extrinsic motivation on academic performance: A longitudinal study of chinese students. Journal of Personality, 88(3), 584-595. https://doi.org/10.1111/jopy.12512 Go to original source...
    48. Lyons, M. D. a Huebner, E. S. 2016. Academic characteristics of early adolescents with higher levels of life satisfaction. Applied Research in Quality of Life, 11(3), 757-771. https://doi.org/10.1007/s11482-015-9394-y Go to original source...
    49. McCaffrey, D. F., Lockwood, J. R., Koretz, D., Louis, T. A. a Hamilton, L. (2004). Models for Value-Added Modeling of Teacher Effects. Journal of Educational and Behavioral Statistics, 29(1), 67-101. https://doi.org/10.3102/10769986029001067 Go to original source...
    50. Newton, X., Darling-Hammond, L., Haertel, E. a Thomas, E. (2010). Value-Added Modeling of Teacher Effectiveness: An exploration of stability across models and contexts. Educational Policy Analysis Archives, 18(23), 1-27. Go to original source...
    51. Ng, Z. J., Huebner, S. E. a Hills, K. J. (2015). Life satisfaction and academic performance in early adolescents: Evidence for reciprocal association. Journal of School Psychology, 53(6), 479-491. https://doi.org/10.1016/j.jsp.2015.09.004 Go to original source...
    52. Oakes, J. (2005). Keeping Track: How Schools Structure Inequality (2. vyd.). Yale University Press.
    53. Organisation for Economic Cooperation and Development. (2019). PISA 2018 Results (Volume III): What School Life Means for Students' Lives. OECD Publishing. https://doi.org/10.1787/acd78851-en Go to original source...
    54. Organisation for Economic Cooperation and Development. (2021). Education at a Glance 2021. OECD Publishing. https://doi.org/10.1787/b35a14e5-en Go to original source...
    55. Page, R. N. (1991). Lower-track classrooms: A curricular and cultural perspective. Teachers College Press.
    56. Proctor, C. L., Linley, P. A. a Maltby, J. (2009). Youth life satisfaction: A review of the literature. Journal of Happiness Studies, 10(5), 583-630. https://doi.org/10.1007/s10902-008-9110-9 Go to original source...
    57. Reynolds, D., Sammons, P., De Fraine, B., Van Damme, J., Townsend, T., Teddie, C. a Stringfield, S. (2015). Educational Effectiveness Research (EER): A State-of-the-art review. School Effectiveness and School Improvement, 25(2), 197-230. https://doi.org/10.1080/09243453.2014.885450 Go to original source...
    58. Rosenbaum, P. R. a Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrilca, 70(1), 41-55. https://doi.org/10.1093/biomet/70.1.41 Go to original source...
    59. Rubin, B. a Noguera, P. (2004). Tracking detracking: Sorting through the dilemmas and possibilities of detracking in practice. Equity and Excellence in Education, 37(1), 92-101. https://doi.org/10.1080/10665680490422142 Go to original source...
    60. Shavelson, R. J., Hubner, J. J. a Stanton, G. C. (1976). Selfconcept: Validation of construct interpretations. Review of Educational Research, 46(3), 407-441. https://doi.org/10.3102/00346543046003407 Go to original source...
    61. Shure, N. (2021). Non-cognitive peer effects in secondary education. Labour Economics, 73, 102074. https://doi.org/10.1016/j.labeco.2021.102074 Go to original source...
    62. Singh, K., Granville, M. a Dika, S. (2002). Mathematics and science achievement: Effects of motivation, interest, and academic engagement. Journal of Educational Research, 95(6), 323-332. https://doi-org/10.1080/00220670209596607 Go to original source...
    63. Straková, J. a Veselý, A. (2013). Předpoklady úspěchu v práci a v životě. Výsledky mezinárodního výzkumu dospělých OECD PIAAC. Centrum pro zahraniční spolupráci.
    64. Straková, J. a Simonová, J. (2013). Vliv navštěvované střední školy na občanské postoje středoškoláků v ČR. Orbis Scholae, 7(3), 27-47. https://doi.org/10.14712/23363177.2015.12 Go to original source...
    65. Straková, J., Soukup, P. a Simonová, J. (2020). Validizace konceptu akademické marnosti v českém středním vzdělávání. Sociologický časopis / Czech Sociological Review, 56(5), 599-618. https://doi.org/10.13060/csr.2020.042 Go to original source...
    66. Straková, J., Simonová, J. a Greger, D. (2019). Faktory ovlivňující přechod žáků do středoškolských maturitních oborů. Pedagogika, 69(2), 113-130. https://doi.org/10.14712/23362189.2018.851 Go to original source...
    67. Straková, J., Tomášek, V. a Palečková, J. (1998). Třetí mezinárodní výzkum matematického a přírodovědného vzdělání - Souhrnné výsledky žáků posledních ročníků středních škol. Výzkumný ústav pedagogický.
    68. Trommsdorff, G. (1983). Future Orientation and Socialization. International Journal of Psychology, 18(1-4), 381-406. https://doi.org/10.1080/00207598308247489 Go to original source...
    69. Úlovec, M. (2014). Potřeby zaměstnavatelů a připravenost absolventů škol - srovnání 2004-2013. Národní ústav pro vzdělávání.
    70. Úlovec, M. a Vojtěch, J. (2018). Nezaměstnanost absolventů školse středním a vyšším odborným vzděláním - 2018. Národní ústav pro vzdělávání.
    71. Van de Werfhorst, H. G. a Mijs, J. J. (2010). Achievement inequality and the institutional structure of educational systems. A comparative perspective. Annual Review of Sociology, 36, 407-428. https://doi.org/10.1146/annurev.soc.012809.102538 Go to original source...
    72. Van Houtte, M. (2004). Tracking effects on school achievement: A quantitative explanation in terms of the academic culture of school staff. American Journal of Education, 110(4), 354-388. https://psycnet.apa.org/doi/10.1086/422790 Go to original source...
    73. Van Houtte, M. (2016). Lower-track students; sense of academic futility: Selection or effect? Journal of Sociology, 52(4), 874-889. https://doi.org/10.1177%2F1440783315600802 Go to original source...
    74. Van Houtte, M. a Stevens, P. A. J. (2008). Sense of Futility: The missing link between track position and self-reported school misconduct. Youth & Society, 40(2), 245-264. https://doi.org/10.1177%2F0044118X08316251 Go to original source...
    75. Van Houtte, M. a Stevens, P. A. J. (2010). The culture of futility and its impact on study culture in technical/vocational schools in Belgium. Oxford Review of Education, 36(1), 23-43. https://doi.org/10.1080/03054980903481564 Go to original source...
    76. Volodina, A., Lindner, C. a Retelsdorf, J. (2019). Personality traits and basic psychological need satisfaction: Their relationship to apprentices' life satisfaction and their satisfaction with vocational education and training. International Journal of Educational Research, 93, 197-209. https://doi.org/10.1016/j.ijer.2018.11.003 Go to original source...
    77. Wang, M.-T. a Eccles, J. S. (2012). School context, achievement motivation, and academic engagement: A longitudinal study of school engagement using a multidimensional perspective. Learning and Instruction, 28, 12-23. https://doi.org/10.1016/j.learninstruc.2013.04.002 Go to original source...
    78. Wigfield, A. a Eccles, J. S. (2000). Expectancy-value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68-81. https://doi.org/10.1006/ceps.1999.1015 Go to original source...
    79. Zhou, K. 2017. Non-cognitive Skills: Potential Candidates for Global Measurement. European Journal of Education, 52(4), 487-497. https://doi.org/10.1111/ejed.12241 Go to original source...
    80. Zimmer, R. W. a Toma, E. F. (2000). Peer effects in private and public schools across countries. Journal of Policy Analysis and Management, 19(1), 75-92. https://doi.org/10.1002/(SICI)1520-6688(200024)19:1%3C75::AID-PAM5%3E3.0.CO;2-W Go to original source...

    Return to the content