3.1. Data Source and Sample Characteristics
This study primarily used the data of the PISA 2022 in Hong Kong, which was collected by Organisation for Economic Co-operation and Development (OECD), and it focuses on the learning, health, and family background information of adolescents born in 2006 or 2007 (Organisation for Economic Co-operation and Development [OECD], 2023). PISA used a two-stage international standard stratified sampling design. The first stage of sampling was conducted at the school level, with the selection probability referencing the percentage of students born in 2006 and 2007 in the school. A total of 163 schools participated in this project. The second stage of sampling was taken at the student level, students born in 2006 and 2007 were randomly selected within the same school. And each school generally selected 42 students (no more than 50 students). So, 5907 students were initially selected. Furthermore, PISA used two versions of questionnaire in Hong Kong based on two languages: English and Chinese. To ensure the accuracy of the results, we chose the data collected through the Chinese version. After removing the data with missing values or collected through the English version questionnaire, a total of 2366 samples were selected in this study.
Among these 2366 students, there were 1167 females (49.3%) and 1199 males (50.7%), 2023 students were born in 2006 and 343 in 2007. In terms of grade, the majority of the sample was in grades 10 (1625, 68.7%) and 9 (648, 31%). Most samples were either native student (1337, 60.4%), defined as those with at least one parent born in the country/economy of assessment, or Second-Generation student (732, 33.1%), defined as those born in the country but whose parent(s) were born abroad. And First-Generation student refers to students who were born outside the country/economy of assessment, with both parents also born in another country/economy. As for parental education, most of the mothers in the sample were identified as International Standard Classification of Education (ISCED) level 3.4 (57.7%) or level 2 (21.3%), and most of the fathers were also identified as level 3.4 (60.7%) or level 2 (20.2%). Please see Table 1 for the sample characteristics.
Table 1
| Variable | Category | Number (n) | Percentage (%) |
| Grade | Grade 7 | 7 | 0.3 |
| Grade 8 | 79 | 3.3 |
| Grade 9 | 648 | 27.4 |
| Grade 10 | 1625 | 68.7 |
| Grade 11 | 7 | 0.3 |
| Gender | Female | 1167 | 49.3 |
| Male | 1199 | 50.7 |
| Mother’s Education Level | ISCED Level 3.4 | 1365 | 57.7 |
| ISCED Level 3.3 | 162 | 6.8 |
| ISCED Level 2 | 504 | 21.3 |
| ISCED Level 1 | 211 | 8.9 |
| Did not complete ISCED Level 1 | 72 | 3.0 |
| Missing | 52 | 2.2 |
| Father’s Education Level | ISCED Level 3.4 | 1437 | 60.7 |
| ISCED Level 3.3 | 162 | 6.8 |
| ISCED Level 2 | 477 | 20.2 |
| ISCED Level 1 | 159 | 6.7 |
| Did not complete ISCED Level 1 | 44 | 1.9 |
| Missing | 87 | 3.7 |
| Immigration Background | Native student | 1337 | 56.5 |
| Second-generation student | 732 | 30.9 |
| First-generation student | 143 | 6.0 |
| Missing | 154 | 6.5 |
| Birth - Year | 2006 | 2023 | 85.5 |
| 2007 | 343 | 14.5 |
3.2. Measurement of Variables
We selected the indicator variables which have been officially calculated and issued by PISA for research, and they are: ICT (ICTFEED), self-directed learning self-efficacy (SDLEFF), students’ practices regarding online information (ICTINFO), feelings about learning at home (FEELLAH), psychosomatic symptoms (PSYCHSYM), cooperation (COOPAGR), growth mindset (GROSAGR), parental involvement (PARINVOL), home possessions (HOMEPOS), and gender (ST004D01T). Missing values were removed based on listwise deletion to maintain a complete sample for analysis according to these ten indicator variables.
These nine variables were all calculated by PISA after a series of complex processing methods with well-accepted confidence. In the PISA, the scale scoring system for students was built using an Item Response Theory (IRT) model that considers the difficulty and discrimination of each item. After the IRT model had been determined, scale scores were computed in the form of weighted likelihood estimates (WLE), which provided a stable and unbiased estimate of a student's underlying traits. To ensure reliability, WLE scores were calculated only when students responded to at least three valid items on the scale. Missing or invalid responses were coded as ‘99’ in the SPSS data file. And the tables about these indicator variables’ internal consistency could be found in the supplementary Excel file provided via StatLink on page 441 441 of the PISA 2022 Technical Report (OECD, 2024).
For the frequency of feedback and support provided by teachers and classmates through ICT, we used ICTFEED index in PISA, which measures the frequency of using digital resources in various activities related to support or feedback from others, including teachers and classmates. This indicator variable contains four questions, such as “read or listen to feedback sent by my teachers regarding my work and academic results”, and there are five answer choices for these questions (“never or almost never”, “about once or twice a year”, “about once or twice a month”, “about once or twice a week”, “every day or almost every day”). Higher scores indicate higher frequency. The internal consistency of this indicator variable was 0.87, which could be found in Table 19.A.82 (titled “Cronbach’s alpha for the IRT scales in the ICT Familiarity Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
For the self-directed learning self-efficacy, we used SDLEFF index in PISA, which refer to the ratings of how confident student felt about having to do various self-directed learning tasks when their school close again in the future. In other words, SDLEEF indicates the index of self-directed learning self-efficacy. This indicator variable has eight items, such as “finding learning resources online on my own”, and there are four answer choices for these questions (“not at all confident”, “not very confident”, “confident”, “very confident”). Higher scores indicate higher self-efficacy. The internal consistency of this indicator variable was 0.89, which could be found in Table 19.A.11 (titled “Cronbach's alpha for the IRT scales in the Student Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
For the information literacy, we used ICTINFO index in PISA, which refers to the index of “students’ practices regarding online information”, it contains six items, such as “when searching for information online I compare different sources”, and there are four answer choices for these questions (“strongly disagree”, “disagree”, “agree”, “strongly agree”). Higher scores indicate higher frequency. Higher scores indicate better information literacy. The internal consistency of this indicator variable was 0.84, which could be found in Table 19.A.82 (titled “Cronbach's alpha for the IRT scales in the ICT Familiarity Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
For the feelings of home-based learning, we used FEELLAH index in PISA, which refers to students’ feelings about learning at home when school buildings were closed during COVID-19. This indicator has six items, such as “I enjoyed learning by myself”, and there are four answer choices for these questions (“strongly disagree”, “disagree”, “agree”, “strongly agree”). Higher scores indicate better feelings. The internal consistency of this indicator variable was 0.71, which could be found in Table 19.A.11 (titled “Cronbach's alpha for the IRT scales in the Student Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
For the psychosomatic symptoms, we used PSTCHSYM index in PISA, which refers to the frequency of psychosomatic symptoms experienced by students, like headache and stomach pain and so on. This indicator variable has nine items, and each item has five answer choices (“rarely or never”, “about every month”, “about every week”, “more than once a week”, “about every day”). Higher scores indicate higher risk of psychosomatic symptoms. The internal consistency of this indicator variable was 0.91, which could be found in Table 19.A.99 (titled “Cronbach's alpha for the IRT scales in the Well-Being Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
For the cooperation tendency, we used COOPAGR index in PISA, which refers to the ratings of students’ agreement with statements about a series of behaviors indicative of cooperation, and represents the tendencies in behavior and attitudes. This indicator variable has ten items, such as “I work well with other people”. Before scaling, some items were reverse-coded to maintain consistent direction. Each of the ten items have five answer choices (“strongly disagree”, “disagree”, “neither agree nor disagree”, “agree”, “strongly agree”). Higher scores indicate more positive behaviors and attitudes about cooperation. The internal consistency of this indicator variable was 0.63, which could be found in Table 19.A.11 (titled “Cronbach's alpha for the IRT scales in the Student Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024). The internal consistency of this indicator variable is barely acceptable, but it is worth noting that the internal consistency of this indicator in other countries or regions is generally low. Most of them fall on the range of 0.5 to 0.7, and even less than 0.5 in some regions. This may be related to the different interpretations of cooperation in different cultural background, especially in a globalized environment like Hong Kong, where differences in cultural background are highly common.
For growth mindset, we used GROSAGR index in PISA, which measures the growth mindset. It has four items, such as “your intelligence is something about you that you cannot change very much”. Some items have been reverse-coded before calculating. Each question has four answer choices (“strongly disagree”, “disagree”, “agree”, “strongly agree”). Higher scores indicate a stronger tendency to growth mindset, which means students are more convinced that effort can change ability. The internal consistency of this indicator variable was 0.78, which could be found in Table 19.A.11 (titled “Cronbach's alpha for the IRT scales in the Student Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
For the degree of parental participant, we used PARINVOL index in PISA, which refers to the level of parents’ involvement in their child’s education in the past years. This indicator variable has ten items, such as “discussed my child’s progress with a teacher on my own initiative”, and each item has three answer choices (“yes”, “no”, “not supported by school”). Some items have been reverse-coded before calculating the scores. High scores indicate that parents participate more in their child’s education. The internal consistency of this indicator variable was 0.79, which could be found in Table 19.A.111 (titled “Cronbach's alpha for the IRT scales in the Parent Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
For the home resources, we used HOMEPOS index in PISA, which refers to the index of family’s economic conditions, higher scores indicate richer household material resources, including education-related items. This indicator variable has 31 items, such as “a room of your own”, “educational software or apps” and “how many books are there in your home?”. The internal consistency of this indicator variable was 0.81, which could be found in Table 19.A.11 (titled “Cronbach's alpha for the IRT scales in the Student Questionnaire”) in the supplementary Excel file provided via StatLink (p. 441) of the PISA 2022 Technical Report (OECD, 2024).
3.3. Data Analysis
In addition to descriptive statistics, correlation and other analytical methods conducted with SPSS 29.0, this study primarily used R Studio with the R version 4.5.0 for path analysis based on structural equation modeling to explore the mechanism of ICTFEED’s influence on FEELLAH. At the same time, regarding the complex sampling design of PISA data, the weighing variable (W_FSTUWT) and the replication weighting variable were used in the analysis to guarantee the precision and representativeness of the data results. Before testing the model, ICTFEED, SDLEFF, ICTINFO, FEELLAH, PSYCHSYM, COOPAGR, GROSAGR, HOMEPOS, and PARINVOL had been mean-centered, and the gender variable (ST004D01T) was coded as a dummy variable (Female = 0, Male = 1).
In terms of modeling, this study used structural equation modeling for path analysis based on these variables. This model set ICTINFO as the independent variable, SDLEFF (M1) and ICTINFO (M2) as the parallel mediator variables, FEELLAH as the first-level dependent variable, and PSYCHSYM as the second-level dependent variable, while GROSAGR and COOPAGR were imported as moderating variables to regulate the paths of M1 to FEELLAH and M2 to FEELLAH. The model could be found in Fig. 1. We constructed interaction items to explore the moderating effects, and calculated the effects of mediating, and moderated mediating, and so on. When we were analyzing these effects, the Balanced Repeated Replication weights were referenced to provide more accurate standard errors and confidence intervals.