Top 10 Ways to Improve Survey Data on People with Disabilities Presentation to Participants of the Cornell StatsRRTC conference on: The Future of.
Download ReportTranscript Top 10 Ways to Improve Survey Data on People with Disabilities Presentation to Participants of the Cornell StatsRRTC conference on: The Future of.
Top 10 Ways to Improve Survey Data on People with Disabilities Presentation to Participants of the Cornell StatsRRTC conference on: The Future of Disability Statistics: What We Know and Need to Know Presented by: David Stapleton Cornell University Institute for Policy Research October 6, 2006 Washington, DC Cornell University Institute for Policy Research Top 10 Ways to Improve Survey Data on People with Disabilities Cornell University Institute for Policy Research 10. Periodically conduct a national disability survey • The most important point: this is #10, not #1 • Periodic disability surveys are attractive because of the significant limitations of existing surveys with respect to disability data • The investment in fixing those limitations might have a much greater return than the investment in periodic national disability surveys • But even if we could address all other limitations, periodic national disability surveys would still have significant merit Cornell University Institute for Policy Research 9. Improve sampling • Disproportionately large numbers of people with disabilities live in nonconventional housing – Institutional Group Quarters: nursing homes, prisons, mental hospitals, ICF/MRs, and others – Non-institutional Group Quarters: group homes for people with disabilities, short-term shelters, dormitories, military quarters, employee quarters, etc. – Some are homeless • National surveys need to clearly define the residence groups in their sampling frames, use well developed frames, and sample in a clear and consistent manner • Low on the list because the Census Bureau already maintains and manages such a national sampling frame • But there are problems that affect disability statistics – Exclusion of most homeless people – Lack of consistency across “non-institutional populations” captured in major surveys – 2006 ACS includes most institutional and non-institutional GQs, like the Decennial Census, but not all Cornell University – Not available for non-federal surveys Institute for Policy Research 8. Improve locating/interview standards • Inclusion of people with disabilities and data quality depend substantially on – – – – – – Mode of interview (mail, phone, or personal interviews) Residence rules (usual vs. current residence) Proxy versus self-respondent Recall period (monthly, sub-annual, or annual) Reference period (e.g., last calendar year vs. last 12 months) And more … Cornell University Institute for Policy Research 7. Add disability supplements • Good idea when: – a large amount of new information is required – there’s a need to study a specific subpopulation – a large national survey (ACS, CPS, or NHIS) can act as a screener and/or provide other information that will enhance the supplement • Efficient means of gathering a lot of information – NHIS-D is an example of a very large supplement • Challenges: – Cost, timing, and coordination issues Cornell University Institute for Policy Research 6. Improve disability-relevant content • Small modifications to existing surveys such as additional disability-specific questions, probes, or response options – Pull disability services, resources, and concepts out of the ‘other’ bucket – Add questions about specific barriers to employment, reasons for not working, employer accommodations and job demands in the CPS – Add questions about attitudinal barriers and expectations about independence and self-sufficiency to SIPP or its successor • Challenge: additional questions can affect other items in the survey and comparisons with statistics from past surveys Cornell University Institute for Policy Research 5. Survey poorly represented groups • Periodic surveys of all residents of group quarters – Currently there are intermittent surveys of nursing home residents, plus surveys of prison and jail inmates approximately every four years – Residents of other group quarters have not been surveyed routinely except in the Decennial Census, including ACF/MRs Long-term psychiatric facilities – Starting in 2006, the ACS includes almost all group quarters But will researchers have sufficient access? • Periodic surveys of homeless people – Not fully represented in any major survey, including the Census and ACS • Program participants with disabilities – SSDI, SSI, Medicare, Medicaid, VR users, etc. Cornell University Institute for Policy Research 4. Include disability measures in all surveys • Some important surveys have no disability measures – Consumer Expenditure Survey – Survey of Consumer Finances – American Housing Survey – American Public Opinion and U.S. Foreign Policy Cornell University Institute for Policy Research 3. Improve collection of longitudinal data • The Survey of Income and Program Participation (SIPP) is scheduled for replacement by the Dynamics of Economic Wellbeing System (DEWS) – Cost issues – Quality issues • For people with disabilities in the non-institutional population, SIPP is the best current source for information on: – The dynamics of disability, income and program participation – Long-term economic well-being and long-term disability • DEWS is in the early development stage – Greater reliance on links to administrative data – Longitudinal features planned but unclear • Continuation and improvement of the Census longitudinal data collection program without significant interruption is imperative Cornell University Institute for Policy Research 2. Link survey data to administrative data • Disproportionate numbers of people with disabilities participate in government programs • It is not possible to obtain accurate, consistent information about program participation from surveys • Linked survey - administrative data: – – – – Address the issue of inaccurate reporting Help address non-response bias Add substantial detail on program benefits Add a longitudinal dimension • Past links for SIPP, especially, are heavily used by disability researchers, and new NHIS and other links are welcome • Privacy and access are critical issues Cornell University Institute for Policy Research 1. Establish core disability questions • A common core of disability questions would – Improve comparability across surveys – Improve the discourse about disability • The number of questions would have to be small, but • Some surveys would include additional questions to – Support the survey’s specific purposes – Support research on who is and is not identified by the common core questions Cornell University Institute for Policy Research Top 10 Ways to Improve Survey Data on People with Disabilities #1. Establish core disability questions #2. Link survey data to administrative data #3. Improve collection of longitudinal data #4. Include disability questions in all surveys #5. Survey poorly represented groups #6. Add disability relevant content #7. Add disability supplements #8. Improve interview and locating standards #9. Improve sampling standards #10. Periodically conduct a national disabilityCornell survey University Institute for Policy Research Social inclusion requires survey inclusion • Most national surveys are designed to address “mainstream” issues • Surveys marginalize people with disabilities, because they are more likely than others to: – – – – live in non-conventional settings; be hard to locate; be difficult to interview; and have characteristics, needs and interests that are not “mainstream” • Greater “social inclusion” of people with disabilities requires improvement in the quality of disability statistics Cornell University Institute for Policy Research A national disability survey should be the last resort • There will always be a residual need for periodic national disability surveys, but • The cost is high • Reaching agreement on content is problematic • Many other improvements to collection of national survey data on disability have a greater return relative to their cost • Other improvements would make it more practical to field a periodic national disability survey Cornell University Institute for Policy Research Common Core Disability Questions Should be the Top Priority • Widely understood – E.g. “Include in the core of all relevant Healthy People 2010 surveillance instruments a standardized set of question that identify “people with disabilities.” Objective 6.1 of Healthy People 2010 • Ambiguity about the definition of “disability” has thwarted disability statistics, research and policy analysis – "When you cannot measure, your knowledge is meager and unsatisfactory." Lord Kelvin – “If you want to count, you need to be counted.” Cornell University Institute for Policy Research Common Core Disability Questions Should be the Top Priority • Progress is stymied only by disagreement on “how” – Disability concept – Objectives • Do we need an OMB mandate? • “Perfect is the enemy of the good.” Cornell University Institute for Policy Research Common Core Disability Questions Should be the Top Priority • Healthy People 2010: “Disability is a demographic descriptor rather than a health outcome.” Disability and Secondary Conditions, Focus Area 6, Reports and Proceedings, 2003 • We need a demographic descriptor for people with significant long-term physical or mental impairments that put them “at-risk” for activity restrictions and participation limitations • But “disability” is not a demographic characteristic – Demographic characteristics are personal characteristics – Disability is the outcome of an interaction between personal characteristics and the environment Cornell University Institute for Policy Research Common Core Disability Questions Should be the Top Priority • We need a name for this population group – People At Risk Due to Impairments (PARDI) – ? • If we identify those “at-risk,” we can assess the extent to which their activities and participation are restricted • We would be able to count both: – Those at-risk for disability – Those at-risk who actually experience disability Cornell University Institute for Policy Research