IDA study: post-COVID-19 school readiness vulnerability in children entering primary school in Lazio Region
Leggi anche il commento allo studio
Background
Studies conducted during and after the COVID-19 pandemic have brought attention to the changes in children’s learning and mental health.1,2 A 2022 Italian report3 emphasized that «the neurodevelopment and mental health problems of children and young people manifested during the pandemic are at risk of becoming chronic and spreading on a large scale». ‘School Readiness’ is an indicator of mental health and well-being, communication, and general literacy skills, emotional maturity, social skills, cognitive and language development to delineate the set of social-emotional and cognitive skills a preschool child should possess to adapt to the new school environment. It includes the competencies concerning emotional and relational maturation and pre-literacy and pre-mathematics.4 These skills may not be achieved by the time the child enters primary school;5 in this case, the child may express vulnerability. School Readiness Vulnerable children (SRCV) are those who, without additional support and care, are more likely to experience difficulties in their school years and beyond.
This condition, if not treated, may tend to consolidate and produce negative effects on health. In fact, children with a lack of school readiness may exhibit antisocial behaviour6 and school failure7. Low educational attainment has been correlated with early pregnancies8 and, in adulthood, with obesity9, depression and anxiety10, coronary heart disease11, and type 2 diabetes12. A 2020 study showed that a lower educational level reduced cognitive function and worsened health status after age 45.13
Children with SRV encounter various difficulties that affect their ability to cope with daily activities (such as being inappropriately dressed, often being late, hungry, or tired). Children identified as vulnerable in the social skills are more likely to have problems relating to other children in a regular way and encounter difficulties following class rules and routines. Emotionally vulnerable children encounter various difficulties related to emotion regulation. They are prone to problems with managing aggressive behaviour and may be inclined towards disobedience or be inattentive and impulsive. Moreover, they encounter various difficulties with reading, writing, and numbers. They may not be able to read or write simple words, may not be interested in trying, and often fail to associate sounds and letters.14
The COVID-19 pandemic and the lockdown have altered the growth and developmental stages of the children causing an increase of school readiness difficulties. United States studies have shown that, during the pandemic, many children as early as kindergarten showed limitations in social, emotional, cognitive, and physical development.1,2,15 Children younger16 or older than 6 years of age17,18 showed behavioural problems and regression symptoms16 in the transition from preschool to primary school.19 A Uruguayan study19 compared two cohorts of children between the ages of 4 and 6 and showed that the cohort affected by pandemic-related limitations was characterized by a deterioration in motor and cognitive development and by an approach to learning characterized by internalizing behaviour. These results were less pronounced among children belonging to families with better socioeconomic conditions. A British study examining 3,253 children attending the first year of primary school (4-5 years old)20 showed that the pandemic had led to a deterioration in social-emotional well-being, language, and numeracy skills compared to what might have been expected based on the previous year cohort. Moreover, the percentage of children achieving a good level of development was 13% lower than pre-pandemic (58.7% vs 72%). Other international studies have confirmed how widespread the negative consequences of the COVID-19 pandemic are on the mental health of children and young people.21
Besides, families are still experiencing, as a result of the COVID-19 pandemic, the additional threat of the economic recession, leading to increased levels of poverty. This condition in children can lead to long-term consequences on health,17 well-being,18 and learning goals19. A United Nations international Children’s Emergency Fund (UNICEF) report showed how the pandemic has led to a worsening of inequalities and socioeconomic conditions, negatively affecting the educational status of children from the most vulnerable social groups.22
The study carried out, therefore, aimed to estimate the prevalence of SRVC and their characteristics out of 43,800 children at the beginning of primary school, to stimulate the attention of decision-makers to the problem and the implementation of specific and timely intervention by the school community. Preventing this condition from becoming consolidated with negative consequences on the psycho-physical health of the children and, in the long term, an increase in health expenditure, would be an essential objective for public health authorities and decision-makers. For this reason, the analyses here presented are of a confirmatory character, investigating whether the data from the literature are valid in the Lazio Region (Italy) and the transition from kindergarten to primary school.
Methods
Participants
In September 2022, according to estimates from the Regional School Office,23 43,726 children distributed across 2,420 classes started primary school in the Lazio Region.
The study population consisted of children who were enrolled in the first year of primary school in the 2022/2023 academic year, aged between 67 and 89 months (5-7 years old), and attending public and private schools. For the sake of efficiency, a two-stage cluster sampling approach was selected for the study design.24 The number of classes (clusters) to be selected was calculated using the following formula:
k = (1.96² * p * (1-p) * deff) / (d² * m) = 147 (146.7)
where:
- k is the number of sample classes;
- 1.96 is the confidence level;
- p (0.50) is the expected prevalence of vulnerability;
- deff (1.1) is the Assumed Design Effect;
- d (3%) is the absolute precision desired;
- m (8) is the number of sample units within each cluster.
The sample size of the first primary classes selected was 147. Regarding the sampling unit, 8 children were then randomly drawn from each selected class.
At the beginning of the analysis, 1,130 Italian-speaking children from 80 classes were included. After the random selection of 8 children per class, the final sample considered for analysis was 628: 52.2% males, 46.5% female, and 1.3% unknown (Table S1, online supplementary materials). The mean age of the sample was 76 months ± 3.78 SD and the median age was 76 months. In the age distribution, the most represented tertile was 73-79 months (Table S1). The great majority of children were selected from white families of intermediate socioeconomic status.
Materials and procedures
Data were collected through two questionnaires: the ‘Early Identification of Learning Difficulties’ (IPDA), validated and used in many Italian school settings,5 which is an observational tool completed by teachers, and the demographic-socioeconomic questionnaire, which was completed by parents. All extracted boys and girls who started the first grade of primary school in the Lazio Region were included. Only pupils who had already been diagnosed with neurodevelopmental disorders by specialist medical personnel at the time of IPDA completion and whose parents had not provided informed consent were excluded.
IPDA questionnaire
The IPDA questionnaire consists of 43 items and requires a maximum of 10 minutes for completion by a trained teacher after observing the child for at least one week. It is divided into two main sections: “general skills” (items 1-9: Behavioral Aspects; items 10-11: Motor Skills; items 12-14: Language Comprehension; items 15-19: Oral Expression; items 20-23: Metacognition; items 24-33: Other Cognitive Skills) and “specific skills” (items 34-40: Pre-literacy; items 41-43: Pre-math). The answers to the questions are scored on a 4-point scale: 1: not at all/never; 2: a little/most of the time; 3: quite a lot/most of the time; 4: a lot/always. The score used for reference in this study is the one recommended in the IPDA User’s Manual in May of the last year of kindergarten (Table 1).5
Demographic-socioeconomic questionnaire
The questionnaire, completed by parents, is divided into 6 sections: child’s biographical data, preschool facilities attendance, household composition, changes in the child’s behaviour perceived by parental adults and attributable to the pandemic period, according to parental figures, parental education, and parental employment.
Statistical Analysis
Analyses were performed using Epi Info (version 7.2.5.0). The analysis plan included calculating the frequency of distribution, mean, and standard deviation, and assessing the normal distribution (skewness and kurtosis) of the main variables (total IPDA, areas of IPDA, age and sex, preschool attendance, parental education and work, parental occupation), using a 95% confidence interval. The association between total IPDA and the main independent variables was investigated by bivariate analysis. Multivariate analysis (logistic regression) was also used to reduce the effect of confounding and suggest a risk profile for children exposed to pandemic limitations.
The school’s name, the class, and any elements heading the children were not reported on the paper or computer-based questionnaire. The database does not contain any useful element to reference the data to a particular school or child.
Procedures and data collection
In September 2022, the Local Health Authorities (ASLs) of the Lazio Region were contacted, and 7 out of 10 accepted to participate. Among the adhering ASLs, not all provided the number of clusters proportionally assigned using the probability proportional to size method. As a result, the classes included in the final database were 80 instead of 147 as initially planned. During the first 2 weeks of October 2022, online training of school staff was carried out, then the survey material was delivered to the participant schools. The questionnaires were filled and collected in the second part of October 2022. In case of incomplete or incorrect compilation, teachers and parents were asked to provide additional data. In November 2022, the data were entered by 2 persons in Excel. If less than 5 values were missed in any IPDA questionnaire, the weighted average of all scores of the other items was considered, as indicated by the authors of the IPDA Manual. If there were more than 5 missing values, the questionnaire was dropped. A data quality check was carried out before and during data entry. Any error in the compilation, e.g., caused by contradictory data, wrong scores or missing data, were examined and corrected. The data analysis was conducted between December 2022 and January 2023.
Results
Descriptive statistics
In Figure 1 the IDA sample is compared with the reference study values.5 The median score was 130 compared to 148 and the mean was 130 ± 25.9 SD (No. 628) compared to 145 ± 21.2 SD (No. 659). The non-parametric Wilcoxon test showed a significant difference between the medians (p<0.001).
The curves from the IDA study and the reference study were both skewed to the left (-0.42 for the curve for the survey, -0.84 for the reference study). The IDA curve was platykurtic (kurtosis -0.3) while the study curve was leptokurtic (kurtosis 0.4). Furthermore, the IDA study scores distribution around the mean was broader and had greater variability than the reference curve where the scores were closer to the arithmetic mean with lower variability. Both curves did not have a normal distribution (Test of Shapiro-Wilk: p<0.001).
The arithmetic mean in males was 129.4 ± 25.5 SD (No. 328) while in females was 136.0 ± 24.5 SD (No. 292), showing about 7 points lower in males than in females. Figure 2 shows the smoothed distribution of males’ and females’ IDA study score curves.
The results showed that 44.9% of the sample had a score equal to or less than 127 (meaning medium-high and high-risk SRVC), of which 15.4% (No. 97) was medium-high SRVC and 29.5% (No. 185) was high SRVC with a need for immediate intervention, according to the IPDA study Manual (Figure S1).
The 36.3% of males (119 among a total of 328) and 21.6% of females (63 among a total of 292) were part of the ‘high SRVC’ group.
In particular, motor skills, pre-mathematics, and pre-literacy were the worst areas with 76.1%, 75.6%, and 71.0%, respectively, of the total sample of children showing to be vulnerable. In all areas, males reported lower scores.
Children who attended kindergarten for ≥ 20 months (86.2%) reported a higher average IPDA score compared to those with lower or no attendance (131.5 ± 25.1 SD and 121.3 ± 28.4 SD respectively).
Among the children, 13.8% (85/615) had a mother and 21% (129/607) had a father with a low-level of education. However, having only a mother with a lower level of education was significantly associated with SRVC.
The variables investigated in the demographic-socioeconomic questionnaire completed by parents showed that the children at greatest risk were males, with low kindergarten attendance, with a low level of parental education, especially of the mother, and with the mother not employed (Figure S2).
Association between SRV and socioeconomic and demographic variables
A significant association was found between the medium-high and high SRVC (IPDA ≤ 127) and the following variables: younger age children, male gender, lower kindergarten attendance, low level of mother, father and both parents’ education, mother and both parents’ unemployment (Table 2).
In the logistic regression, the medium-high and high SRV were associated with male gender, age less than 76 months, and lower kindergarten attendance. The educational level of single or both parents and the unemployment of the mother did not prove to be associated (Table 3).
Discussion
«The prolonged school closures and other significant disruptions to the education system caused by the pandemic have resulted in a substantial loss of learning. Emerging data from various countries indicate that the challenges related to COVID-19 and school closures have led to an increase in the number of out-of-school children».22
The IDA study confirmed that the COVID-19 pandemic has worsened the prevalence of children with SVR entering primary school also in the Lazio Region, where the median score worked out was 130, significantly lower (-10.3%) than the reference study score of 145.5 In the sample of this study, 44.9% are SRVC with a surveyed developmental level similar to the IPDA standards for children one year younger.
According to a UK report,20 the prevalence of reduced socioemotional performance, language, and math skills among 4-5-year-old children was around 41% observed in May 2022 compared to 28% in 2019. A 2021 US study found that the prevalence of ‘healthy and ready-to-learn’ children aged 3 to 5 years was 42%.25 A UNICEF report, conducted in 32 low- and middle-income countries,22 highlighted that the pandemic will have a negative impact on essential reading skills, particularly for children under the age of 5-6 years, with an anticipated reduction of 27% by the time they reach Grade 9 (13-14 years) if development support strategies are not implemented.
Regarding IDA, children had the lowest scores in motor skills (76.1%), pre-mathematics (75.6%), and pre-literacy (71.0%). A study on children aged 4 to 6 years19 also showed a decline in language and logical-mathematical skills compared to pre-COVID, particularly in the areas of cognitive development and motor skills, as observed in this study. The impact on motor skills may be explained by the reduced physical activity due to the lockdown and the time children spent confined at home.26 Issues related to pre-mathematics and pre-writing skills may be associated with reduced attendance at preschool.
In the IDA study, 52.7% of males (173 among a total of 328) were part of the ‘medium-high and high SRVC’ group, with an average IPDA score of 126, while 35.6% of females (104 among a total of 292) were part of the same group, with an average IPDA score of 135. This difference can be observed across all areas of development. In this regard, a Canadian study27 found contrasting results; girls demonstrated better performance in certain skills necessary for school readiness, while boys performed better in other areas. No differences were found in vocabulary, number knowledge, effort, and cooperative play.
Children with low preschool attendance showed lower IPDA scores. This data confirms the importance of early childhood education for the development of school prerequisites, which «contributes to the education and affective, psychomotor, cognitive, moral, religious, and social development of children, promoting their potential in relationships, autonomy, creativity, and learning, aiming to ensure effective equality of educational opportunities».28
SRV is associated with low educational levels of the mother, father, or both parents, as well as with maternal and paternal unemployment. Also in the IDA study, the level of education and occupational status proved to act as determinants of health, negatively influencing the health status of individuals and the population they belong to. This result confirms that the pandemic has negatively affected the socioeconomic status of families.22 A Chinese study from 202226 investigated the vulnerability and resilience of two groups of children of different ages (2-5 years and 6-12 years) during the COVID pandemic, and the results showed that school closures worsened existing inequalities in families with special educational needs (SENs), especially for families with members with psychiatric disorders and single parents. Income inequality is indeed one of the main causes of learning problems. Furthermore, parental involvement in their children’s education is important for achieving basic learning skills.22
In the IDA study, children under 76 months of age showed lower IPDA scores and therefore a higher SRV compared to older children (≥76 months). However, the low correlation level between age and score (r2=0.03, coefficient of determination) suggests that lower scores are due to the physiological lag in development rather than a particular vulnerability caused by the pandemic.
Out of the 147 clusters sample identified in the study protocol, data were collected from 80 clusters due to only partial participation of some school districts. This limitation may have introduced a selection bias. On average, the design effect worked out for the different variables had a low value (DE=1.1), so it was assumed that there is no significant difference for the children and families’ variables among different clusters.
Another limitation is the observational nature of the application of the IPDA questionnaire, which is exposed to the subjectivity of the compiling teachers. Moreover, students’ performance during the observation period may have been influenced by external factors. Some items about the child’s attitudes and behaviours referred to in the questionnaire filled in by parents may also resent the different cultural and sensitivity. The strength of the IDA study lies in being the first to assess the impact of the COVID-19 pandemic on children’s learning difficulties in the Lazio Region and Italy. A similar investigation using the same IPDA instrument was conducted simultaneously in the extended area of the town of Palermo (Sicily) by researchers from the Italian National Health Institute.29
Conclusions
Given the average delay of one year that children have shown in their development, it is necessary to intervene promptly and effectively to address this problem of such broad dimensions and harbinger of negative consequences for the children’s current and future health.
Interventions aimed at recovering school skills that were not adequately developed during the COVID-19 pandemic should therefore be timely implemented.
Hence, the study’s findings have significant implications for various stakeholders involved in education and child development.
Education authorities and policymakers need to recognize the effects of the pandemic on children’s school readiness and the need for targeted interventions to address vulnerabilities. Policies should be developed to ensure equal access to quality early childhood education, especially for children from socioeconomically disadvantaged backgrounds.
Schools and educators play a crucial role in identifying and addressing vulnerabilities in students, taking into consideration that the study underscores the importance of assessing and supporting children’s developmental needs. Schools can collaborate with parents and caregivers to create strategies for supporting children’s development.
Parents and caregivers should be informed as soon as possible about the impact of the pandemic on children’s school readiness and they are expected to engage in activities that promote motor skills at home.
Non-governmental organizations and community groups can play a role in providing additional support to vulnerable children and families, particularly for those from disadvantaged backgrounds.
Health professionals should be aware of the developmental challenges faced by children due to the pandemic and can offer guidance to parents and caregivers on activities that promote children’s physical and cognitive development.
Research community is involved, because the study’s results provide valuable insights into the impact of the pandemic on children’s development, but further research is needed to investigate the long-term effects of these vulnerabilities on educational outcomes and propose evidence-based interventions;
Government and funding agencies can allocate resources to support programmes that address school readiness vulnerabilities, notably in early childhood education and support services, particularly for vulnerable populations.
Collaborative efforts among these stakeholders are essential to mitigate the negative effects of the pandemic on children’s school readiness. By recognizing the challenges highlighted in this study, stakeholders can work together to design effective interventions, policies, and programmes that promote equitable access to quality education and support the holistic development of young children.
Conflicts of interest: none declared.
Acknowledgements: the Authors would like to thank the “Identificazione precoce delle difficoltà dell’apprendimento/Early Identification of School Readiness Vulnerability (IDA) Study Group” (Annachiara Di Nolfi, Angela Giusti, Stefania Spila Alegiani, Francesca Zambri, from the National Institute of Health/Istituto Superiore di Sanità), teachers, parents, and children who participated in the survey for their collaboration.
References
- Colvin MKM, Reesman J, Glen T. The impact of COVID-19 related educational disruption on children and adolescents: An interim data summary and commentary on ten considerations for neuropsychological practice. Clin Neuropsychol 2022;36(1):45-71. doi: 10.1080/13854046.2021.1970230
- Dudovitz RN, Thomas K, Shah MD et al. School-Age Children’s Wellbeing and School-Related Needs During the COVID-19 Pandemic. Acad Pediatr 2022;22(8):1368-74. doi: 10.1016/j.acap.2022.01.015
- Autorità Garante per l’Infanzia e l’Adolescenza. Pandemia, neurosviluppo e salute mentale di bambini e ragazzi. Rome: AGIA; 2022. Available from: https://www.garanteinfanzia.org/sites/default/files/2022-05/Volume-Garante.pdf (last accessed: 17.01.23).
- Isidori MV, Prosperi M. Lo screening dei prerequisiti dell’apprendimento e il loro potenziamento. Un’indagine nella scuola dell’infanzia nell’ottica della didattica inclusiva. Ital J Spec Educ Incl 2019;7(1):172-88.
- Terreni A, Tretti ML, Corcella PR, Cornoldi C, Tressoldi PE. Test IPDA Questionario Osservativo per l’Identificazione Precoce delle Difficoltà di Apprendimento. New Edition. Trento: Erickson; 2011.
- Reinke WM, Herman KC. Creating school environments that deter antisocial behaviors in youth. Psychol Sch 2002;39(5):549-59. doi: 10.1002/pits.10048
- Wright C, Diener ML, Kay SC. School readiness of low-income children at risk for school failure. J Child Poverty 2000;6(2):99-117. doi: 10.1080/713675961
- Freedman J. Early Pregnancy and Education in the UK. London: UNESCO; 2020. Available from: https://healtheducationresources.unesco.org/library/documents/early-pregnancy-and-education-uk (last accessed: 02.02.23).
- Devaux M, Sassi F, Church J, Cecchini M, Borgonovi F. Exploring the relationship between education and obesity. OECD J Econ Stud 2011;(1):1-40. doi: 10.1787/eco_studies-2011-5kg5825v1k23
- Bjelland I, Krokstad S, Mykletun A, Dahl AA, Tell GS, Tambs K. Does a higher educational level protect against anxiety and depression? The HUNT study. Soc Sci Med 2008;66(6):1334-45. doi: 10.1016/j.socscimed.2007.12.019
- Kelli HM, Mehta A, Tahhan AS et al. Low Educational Attainment is a Predictor of Adverse Outcomes in Patients With Coronary Artery Disease. J Am Heart Assoc 2019;8(17):e013165. doi: 10.1161/JAHA.119.013165
- Borrell LN, Dallo FJ, White K. Education and diabetes in a racially and ethnically diverse population. Am J Public Health 2006;96(9):1637-42. doi: 10.2105/ajph.2005.072884
- Wu YT, Daskalopoulou C, Muniz Terrera G et al. Education and wealth inequalities in healthy ageing in eight harmonised cohorts in the ATHLOS consortium: a population-based study. Lancet Public Health 2020;5(7):e386-94. doi: 10.1016/S2468-2667(20)30077-3
- Janus M, Offord DR. Development and psychometric properties of the Early Development Instrument (EDI): A measure of children’s school readiness. Can J Behav Sci 2007;39(1):1-22. doi: 10.1037/cjbs2007001
- Lupas KK, Mavrakis A, Altszuler A et al. The short-term impact of remote instruction on achievement in children with ADHD during the COVID-19 pandemic. Sch Psychol 2021;36(5):313-24. doi: 10.1037/spq0000474
- Singh S, Roy D, Sinha K, Parveen S, Sharma G, Joshi G. Impact of COVID-19 and lockdown on mental health of children and adolescents: A narrative review with recommendations. Psychiatry Res 2020;293:113429. doi: 10.1016/j.psychres.2020.113429
- Segre G, Campi R, Scarpellini F et al. Interviewing children: the impact of the COVID-19 quarantine on children’s perceived psychological distress and changes in routine. BMC Pediatr 2021;21(1):231. doi: 10.1186/s12887-021-02704-1
- Scarpellini F, Segre G, Cartabia M et al. Distance learning in Italian primary and middle school children during the COVID-19 pandemic: a national survey. BMC Public Health 2021;21(1):1035. doi: 10.1186/s12889-021-11026-x
- González M, Loose T, Liz M et al. School readiness losses during the COVID-19 outbreak. A comparison of two cohorts of young children. Child Dev 2022;93(4):910-24. doi: 10.1111/cdev.13738
- Tracey L, Bowyer-Crane C, Bonetti S, Nielsen D, D’Apice K, Compton S. The impact of the Covid-19 pandemic on children’s socio-emotional wellbeing and attainment during the reception year. Research Report. London: Education Endowment Foundation; 2022. Available from: https://www.niesr.ac.uk/wp-content/uploads/2020/10/EEF-Impact-Covid-19-School-Starters.pdf (last accessed: 17.01.23).
- Theberath M, Bauer D, Chen W et al. Effects of COVID-19 pandemic on mental health of children and adolescents: A systematic review of survey studies. SAGE Open Med 2022;10:20503121221086712. doi: 10.1177/20503121221086712
- United Nations Children’s Fund. Are children really learning? Exploring foundational skills in the midst of a learning crisis. UNICEF; 2022. Available from: https://data.unicef.org/resources/are-children-really-learning-foundational-skills-report/# (last accessed: 14.02.2023).
- Ufficio Scolastico Regionale per il Lazio. I Dati Del Sistema Scolastico Nel Lazio. Anno scolastico 2021-22. Rome; 2022. Available from: https://www.usrlazio.it/index.php?s=1052&wid=10230 (last accessed: 18.01.23).
- Lwanga SK, Lemeshow S. World Health Organization. Sample size determination in health studies: a practical manual/S. K. Lwanga and S. Lemeshow. Geneva: WHO; 1991. Available from: https://apps.who.int/iris/handle/10665/40062 (last accessed: 04.07.22).
- Ghandour RM, Hirai AH, Moore KA et al. Healthy and Ready to Learn: Prevalence and Correlates of School Readiness among United States Preschoolers. Acad Pediatr 2021;21(5):818-29. doi: 10.1016/j.acap.2021.02.019
- Tso WWY, Wong RS, Tung KTS, et al. Vulnerability and resilience in children during the COVID-19 pandemic. Eur Child Adolesc Psychiatry 2022;31(1):161-76. doi: 10.1007/s00787-020-01680-8
- Thomas EM. Readiness to Learn at School Among Five-year-old Children in Canada. Ottawa: Statistics Canada; 2006. Available from: https://www150.statcan.gc.ca/n1/pub/89-599-m/89-599-m2006004-eng.pdf (last accessed: 26.01.23).
- Ministero dell’Istruzione e del Merito. Scuola dell’infanzia. Rome: MIUR; 2018. Available from: https://www.miur.gov.it/ricerca-tag/-/asset_publisher/oHKi7zkjcLkW/content/scuola-dell-infanzia (last accessed: 25.01.23).
- Istituto Superiore di Sanità. Studio Campionario per l’Identificazione Precoce delle Difficoltà di Apprendimento negli Alunni e Alunne in Ingresso alla Prima Classe della Scuola Primaria di Palermo e Provincia. Personal communication. Rome: ISS; 2023.