TDG Project: Program Analysis

Access the Program Report

Please follow the steps below to access your program report. Each report is password-protected to ensure confidentiality and is accessible only to authorized program leaders:

Select your program: Choose your program from the list below to view the available reports.
Enter your password: You will need to enter the unique password provided to you via email to unlock the report. For example, if you are the program leader for "A5B058-Mathematics," the password you received in your email is "12345" (this is just an example).
Access the report: Once the password is entered, you will gain access to a folder containing:
- An HTML report providing a summary of predicted student performance
- An Excel file containing pseudonymized student IDs and their predicted Year 3 GPA
Conversion of pseudonymized IDs: To convert pseudonymized student IDs to actual student IDs, please contact the OCIO by sending the masked pseudo-IDs to Kevin Cheung (kywcheung@eduhk.hk) to request the corresponding actual student IDs.

If you encounter any issues accessing your report or need further assistance, you can contact the us.

Glossary

This glossary provides clear definitions for key terms used throughout the program analysis, may helping you better understand the report's findings.

Data Related Terms

Training Data: The dataset used to train the lasso regression model for a given cohort cycle. It consists of data from the three consecutive cohorts that immediately precede the test cohort. For example, for predicting the 2020 test cohort in a 5-year program, the training data would come from the 2017, 2018, and 2019 cohorts.
Test Data: The dataset used to evaluate an already-trained lasso regression model for a given cohort cycle. The test cohort is the fourth consecutive cohort, following the three cohorts in the training data. For example, the model for the 2020 cohort is trained on data from the 2017, 2018, and 2019 cohorts, and the 2020 cohort data is used solely for testing, not training.
Cohort: A group of students who began their academic program in the same year. For example, the 2016 cohort refers to students who started their first year in 2016.
Cohort Size: The total number of students in a specified cohort. For instance, the 2016 cohort might consist of 35 students in a particular program.

Model Related Terms

Target Column: The outcome variable the model is designed to predict. In this project, it is the Year 3 (Y3) GPA of students.
Predictor: Any variable in the model that helps predict the target outcome (e.g., Year 3 or Graduating GPA). Predictors might include previous year GPAs, course grades, and other relevant features.
Y3 GPA Prediction: The predicted GPA of a student at the end of Year 3, calculated by the model using training data.
At-risk Student: A student predicted by the model to have a GPA below a cutoff point (typically 2.5) at the end of Year 3. These students are flagged for potential academic interventions.
Cut-off: A predetermined GPA threshold (typically 2.5) used to classify students as at-risk or normal. This cutoff may be adjusted by the model to optimize predictions.
Optimal Cut-off: The GPA threshold fine-tuned by the model to best separate at-risk students from normal students, minimizing missed detections and false alarms. While the default is 2.5, the model may adjust this threshold for optimal performance.

Evaluation Metrics

Accuracy: The proportion of correct predictions made by the model, calculated as the number of accurate predictions divided by the total number of students. The model’s accuracy typically ranges between 90% and 100%.
MSE (Mean Squared Error): A measure of the average squared difference between predicted and actual GPA values. A lower MSE indicates better model performance.
Missed Detection: When a student is incorrectly predicted to be normal (GPA above 2.5), but their actual GPA falls at or below the 2.5 threshold.
False Alarm: When a student is predicted to be at-risk (GPA below 2.5), but their actual GPA is higher than 2.5.
True Positives (TP): The number of students correctly identified as at-risk.
True Negatives (TN): The number of students correctly identified as not at-risk.
False Positives (FP): The number of students incorrectly predicted as at-risk.
False Negatives (FN): The number of students incorrectly predicted as not at-risk.

Program Leader Feedback Form

Note:

Program leaders are encouraged to submit their feedback form within 1 month of receiving and reviewing the program analysis report. Your feedback will help us improve future iterations of the analysis and intervention strategies.

We value your feedback! After reading your program report, please take a moment to provide your insights on the analysis results by filling out the form below: