{"id":5920,"date":"2021-06-25T13:00:00","date_gmt":"2021-06-25T17:00:00","guid":{"rendered":"https:\/\/nchstats.com\/?p=5920"},"modified":"2021-06-25T13:00:00","modified_gmt":"2021-06-25T17:00:00","slug":"podcast-design-of-survey-questions-during-pandemic","status":"publish","type":"post","link":"https:\/\/blogs.cdc.gov\/nchs\/2021\/06\/25\/5920\/","title":{"rendered":"PODCAST: Design of Survey Questions during the Pandemic"},"content":{"rendered":"\n

https:\/\/www.cdc.gov\/nchs\/pressroom\/podcasts\/2021\/20210625\/20210625.htm<\/a><\/p>\n\n\n\n

HOST:<\/strong> The quality of data in any health survey depends on the quality of the questions being asked, as well as the interpretation of those questions by the survey participants.  NCHS has a team in place that directly deals with those issues, the Collaborating Center for Question Design and Evaluation Research, or \u201cCCQDER.\u201d  CCQDER uses cognitive interviewing, a popular method for evaluating survey questions, by offering a detailed depiction of meanings and processes used by respondents to answer questions, which ultimately impact the survey data.  The sample of respondents in these studies is usually small, between 20 and 50 respondents.<\/p>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

This week, the CCQDER team hosted a webinar in which they discussed the design of survey questions about COVID-19, and the administration of those questions during the pandemic.  In addition to cognitive interviewing, the webinar also covered topics such as the Research and Development Survey, or \u201cRANDS.\u201d<\/p>\n\n\n\n

As part of the Q and A segment of the webinar, Kristen Miller, the CCQDER Director, was asked whether standardized COVID questions had been developed by NCHS for outside researchers to use in their own studies:<\/p>\n\n\n\n

KRISTEN MILLER: <\/strong>So traditionally it hasn\u2019t been in our job scope to come up with standardized questions.  What we have done is \u2013 and maybe we want to rethink this for the future \u2013 but what we do do is we test these questions\u2026  in these reports you will see specifically what each individual question captures. So what we would like to see people do is to get on, read these reports, see if this question \u2013 is this question capturing what I need it to capture \u2013 and then you making the decision, \u201cYes, I\u2019m going to go with this question.\u201d  So again, not anything standardized, but information provided to you so that you can choose the question that is best going to fit your research question.<\/p>\n\n\n\n

HOST: <\/strong>The team was also asked what they would recommend in a rapid deployment situation in which there is not enough time to conduct a full evaluation of questions:<\/p>\n\n\n\n

KRISTEN MILLER: <\/strong>I fully appreciate the problem.  And at the same time, I think that whenever we\u2019re writing questions we need to have a concerted effort to have a plan how we\u2019re going to go about question evaluation.  So it\u2019s keeping track of the questions that go into the field, having mixed method or having these follow up pro questions that we had on RANDS to be able to see, \u201cOK, this is going to be, there\u2019s going to be error in this question, it\u2019s going to be more error for less educated people, let\u2019s keep that in mind as we interpret the data that\u2019s coming in.\u201d  But then, again, keeping track of what we\u2019re asking so that we can improve our questions.  I mean, we\u2019re so far into this pandemic I\u2019d like to think our questions that we\u2019re asking are much more improved from the questions that we began with when it first started.  So again, it\u2019s just really having a question evaluation plan going forward.<\/p>\n\n\n\n

HOST:<\/strong> The reaction to any survey question is highly personal and subjective, and the CCQDER team was asked about whether respondents have been impacted by their fear of COVID-19 when answering the questions.  Dr. Stephanie Willson of the CCQDER team described some of the challenges:<\/p>\n\n\n\n

STEPHANIE WILLSON:<\/strong> Right, actually that\u2019s a very astute observation because again the experience that people had \u2013 you had people who thought it was a hoax over here to people who were super-afraid of getting it, right?  So that absolutely was filtered through.  One example I didn\u2019t get a chance to talk about was this need \u2014 there were questions about, \u201cDid you need medical care for something but not get it because of the pandemic?\u201d  So that kind of fear, the idea of need, was filtered through people\u2019s experience with the pandemic and how afraid they were of catching it.  So certain things were missed, because suddenly now, \u201cI don\u2019t need to get a check-up, I don\u2019t need a well-woman visit, I don\u2019t need a cancer screening because of the pandemic.\u201d  Where in non-pandemic times:  \u201cYes, I feel like I need those things.\u201d  So that is an element of fear that absolutely did factor into interpretations.<\/p>\n\n\n\n

HOST: <\/strong>Dr. Willson also discussed the differences between \u201cremote interviewing\u201d and traditional face-to-face interviews, and whether remote interviewing will continue into the post-pandemic era:<\/p>\n\n\n\n

STEPHANIE WILLSON:<\/strong> The interesting thing was, even though I\u2019ve been doing this for a long time, I had never done a virtual interview prior to the pandemic so I went into it kind of skeptical.  But I have to tell you, I\u2019m a convert.  I really feel as though Zoom interviews really gave the same kind of quality cognitive interview data that face-to-face, in-person face-to-face interviews gave, so I think we should continue to use this.  I think that in certain situations, there\u2019s a downside maybe in terms of socioeconomic status, but the upside to this would be geographical diversity that we can now explore that you can\u2019t do\u2026 It takes so much more money to, let\u2019s say, go regionally throughout the United States, for example.  And we did have actually geographic diversity in our sample here \u2013 not enough to make it count because we were trying to do it quickly but, yeah, I think it should continue to be used.<\/p>\n\n\n\n

HOST: <\/strong>All CCQDER studies feature a final report that document the study findings, and are housed on a searchable, publicly accessible database called Q-Bank<\/a>.<\/p>\n\n\n\n

MUSICAL BRIDGE<\/p>\n\n\n\n

HOST: <\/strong>Urgent care centers and health clinics located within grocery or retail stores are able to provide acute health care services for non-emergency visits, and they also can provide preventive care services, such as routine vaccinations. The availability and utilization of urgent care has risen dramatically in recent years.<\/p>\n\n\n\n

A new report<\/a> released this week examines urgent care center and retail health clinic visits among adults in the past year by sex and selected characteristics.  The report uses data from the 2019 National Health Interview Survey, and reveal that 1\/3 of women and slightly over \u00bc of men made one or more visit to an urgent care center or retail health clinic in the past year.<\/p>\n\n\n\n

Older adults are less likely to use urgent care centers or retail health clinics than younger adults, and non-Hispanic white adults are more likely to have visited an urgent care center or retail health clinic at least once in the past year compared to Hispanic, non-Hispanic black or NH Asian adults.  In addition, adults with higher education levels are more likely to use urgent care centers or retail health clinics.<\/p>\n\n\n\n

A second report<\/a> came out this week which compares provisional or preliminary 2020 data with final 2019 and 2018 data on changes in the number of births in the United States by month and by state.  The report also includes data on the race and Hispanic origin of the mother, and sheds some light on the impact of the COVID-19 pandemic on fertility in the country.<\/p>\n\n\n\n

From 2019 to 2020, the number of births declined for each month.  In comparison, from 2018 to 2019, the number of births declined for only 9 months of the year.  The largest declines in 2020 occurred in December, followed by August, and then October and November.  The number of births in the U.S. declined 8% more in December 2020 than it did the previous year.<\/p>\n\n\n\n

In other words, the decline in births between 2019 and 2020 was larger in the second half of the year than in the first half of the year \u2013 6% in the second half of the year vs. only 2% in the first half.   Between 2018 and 2019, the number declined 2% in the first half of the year and 1% in the second half.<\/p>\n\n\n\n

Ultimately, more information on fertility during the pandemic won\u2019t be known until 2021 data are available. The first provisional data for 2021 should be available by early Fall.<\/p>\n","protected":false},"excerpt":{"rendered":"

https:\/\/www.cdc.gov\/nchs\/pressroom\/podcasts\/2021\/20210625\/20210625.htm HOST: The quality of data in any health survey depends on the quality of the questions being asked, as well as the interpretation of those questions by the survey participants.  NCHS has a team in place that directly deals with those issues, the Collaborating Center for Question Design and Evaluation Research, or \u201cCCQDER.\u201d  CCQDER uses<\/p>\n","protected":false},"author":195,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[62240,61966,63736],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/posts\/5920"}],"collection":[{"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/users\/195"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/comments?post=5920"}],"version-history":[{"count":0,"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/posts\/5920\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/media?parent=5920"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/categories?post=5920"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.cdc.gov\/nchs\/wp-json\/wp\/v2\/tags?post=5920"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}