www.trelliscompany.org34
Methodology
The SFWS seeks to document the financial well-being and student success outcomes
of post-secondary students across the nation. Trellis hosted and delivered the online
survey in an attempt to understand more about the financial challenges and barriers
facing students, how students view their institutions’ awareness of those challenges
and barriers, and how the challenges and barriers alter how students view and attend
college. All participating institutions receive a school-level report of findings with
comparison response groups from their sector.
In order to host and deliver the survey to students, participating institutions provide
Trellis with the contact information and select demographics (to allow assessment of
representativeness) of study participants. Participants in the SFWS are asked to consent
to having additional select student-level records (e.g., number of credit hours, gender,
age) released by their institution for matching with their survey responses. Participating
institutions with enrollments above 10,000 students could choose to randomly sample
5,000 of their students or provide their entire population. Institutions with enrollments
lower than 10,000 included all students in the survey population.
To maximize student responses, Trellis contributed 50, $50 Amazon gift cards which were
randomly awarded to 50 study participants. Institutions were encouraged to supplement
the survey-wide incentive oered by Trellis with their own incentives where possible.
For survey-wide incentives provided by Trellis, Trellis randomly chose incentive winners,
contacted the incentive winners, and disbursed the incentives. For institutional incentives,
Trellis randomly chose incentive winners and provided institutions with contact
information to disburse the incentives. If a participant withdrew from the
survey before completion, they were still eligible for the incentive drawing.
Data were de-identified to create a dataset for analysis. In most instances, reports
primarily consist of descriptive statistics; however, additional exploratory data analysis
was conducted to identify trends among groups of respondents and answer the research
questions. Analyses conducted include chi-square tests and reliability tests to construct
and validate indexes contained within the survey instrument. All data are reported in
aggregate form only and reported data do not identify individual institutions outside of
confidential institution-level reports.
Sample Characteristics and Representativeness
Voluntary surveys—particularly those delivered online—are unlikely to achieve high
response rates. Lower response rates make surveys more susceptible to response bias,
i.e., the risk that those taking the survey don’t reflect the views of the total population.
The Student Financial Wellness Survey obtains data on both the total population and
responders. This allows for comparisons to determine if, based on these characteristics,
responders mirror the total population. The results are weighted using a post-stratification
weighting technique. Two-year institutions and four-year institutions were separately
weighted by gender, age, and enrollment intensity. Response bias in the sample
marginally aected the magnitude of the response frequencies presented for questions
in the survey but did not aect the overall findings and themes found from the study.
The tables in this appendix provide a comparison between the population of students
invited to participate and the sample of responders, and they present where there were
statistically significant dierences.