[CITASA] Paper vs Electronic Surveys

DJ
Davis, Jennifer Lauren - davis5jl
Tue, Jun 10, 2014 4:10 PM

Hi all,

A colleague and I wondered what, if anything, the literature says about accuracy of online vs. paper and pencil surveys. There's a lot available about response rates, but does medium affect how honest people are in their responses?

Will happily share with the list.

Thanks!!
Jenny

Jenny L. Davis
Assistant Professor of Sociology
James Madison University
Weekly Author: Cyborgology.orghttp://thesocietypages.org/cyborgology/
Twitter: @Jenny_L_Davishttps://twitter.com/Jenny_L_Davis

Hi all, A colleague and I wondered what, if anything, the literature says about accuracy of online vs. paper and pencil surveys. There's a lot available about response rates, but does medium affect how honest people are in their responses? Will happily share with the list. Thanks!! Jenny Jenny L. Davis Assistant Professor of Sociology James Madison University Weekly Author: Cyborgology.org<http://thesocietypages.org/cyborgology/> Twitter: @Jenny_L_Davis<https://twitter.com/Jenny_L_Davis>
SL
S.Livingstone@lse.ac.uk
Tue, Jun 10, 2014 4:26 PM

Hi - in the EU Kids Online survey, it just so happened that some countries used CAPI and some used PAPI so we compared how the kids responded in our technical guide to the data here http://eprints.lse.ac.uk/45270/

Best, Sonia

-----Original Message-----
From: Air-L [mailto:air-l-bounces@listserv.aoir.org] On Behalf Of Davis, Jennifer Lauren - davis5jl
Sent: 10 June 2014 17:10
To: air-l@listserv.aoir.org; ,
Subject: [Air-L] Paper vs Electronic Surveys

Hi all,

A colleague and I wondered what, if anything, the literature says about accuracy of online vs. paper and pencil surveys. There's a lot available about response rates, but does medium affect how honest people are in their responses?

Will happily share with the list.

Thanks!!
Jenny

Jenny L. Davis
Assistant Professor of Sociology
James Madison University
Weekly Author: Cyborgology.orghttp://thesocietypages.org/cyborgology/
Twitter: @Jenny_L_Davishttps://twitter.com/Jenny_L_Davis


The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org

Join the Association of Internet Researchers:
http://www.aoir.org/

Please access the attached hyperlink for an important electronic communications disclaimer: http://lse.ac.uk/emailDisclaimer

Hi - in the EU Kids Online survey, it just so happened that some countries used CAPI and some used PAPI so we compared how the kids responded in our technical guide to the data here http://eprints.lse.ac.uk/45270/ Best, Sonia -----Original Message----- From: Air-L [mailto:air-l-bounces@listserv.aoir.org] On Behalf Of Davis, Jennifer Lauren - davis5jl Sent: 10 June 2014 17:10 To: air-l@listserv.aoir.org; , Subject: [Air-L] Paper vs Electronic Surveys Hi all, A colleague and I wondered what, if anything, the literature says about accuracy of online vs. paper and pencil surveys. There's a lot available about response rates, but does medium affect how honest people are in their responses? Will happily share with the list. Thanks!! Jenny Jenny L. Davis Assistant Professor of Sociology James Madison University Weekly Author: Cyborgology.org<http://thesocietypages.org/cyborgology/> Twitter: @Jenny_L_Davis<https://twitter.com/Jenny_L_Davis> _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ Please access the attached hyperlink for an important electronic communications disclaimer: http://lse.ac.uk/emailDisclaimer
CB
Charlie Balch
Tue, Jun 10, 2014 4:32 PM

Hi Jenny,
I explored paper vs online surveys in my book (Internet Survey Methodology,
Balch, 2010 -- you should be able to review a copy through inter-library
loan). The short answer is the medium matters.  Issues include:

  • participant perceived ownership of the computer,
  • participant anonymity concerns,
  • participant computer skills,
  • Branching surveys and the amorphous nature of screen content lead to
    participants taking "different surveys"

Regards,
 
Charles Balch PhD
Faculty, Department of Business & Administration
Northern Arizona University - Yuma

Office/cell: (928) 317-6455 / 287-3906
Skype: NAUCharlie
Google+: cvb23@nau.edu
   

-----Original Message-----
From: Air-L [mailto:air-l-bounces@listserv.aoir.org] On Behalf Of Davis,
Jennifer Lauren - davis5jl
Sent: Tuesday, June 10, 2014 9:10 AM
To: air-l@listserv.aoir.org; ,
Subject: [Air-L] Paper vs Electronic Surveys

Hi all,

A colleague and I wondered what, if anything, the literature says about
accuracy of online vs. paper and pencil surveys. There's a lot available
about response rates, but does medium affect how honest people are in their
responses?

Will happily share with the list.

Thanks!!
Jenny

Jenny L. Davis
Assistant Professor of Sociology
James Madison University
Weekly Author: Cyborgology.orghttp://thesocietypages.org/cyborgology/
Twitter: @Jenny_L_Davishttps://twitter.com/Jenny_L_Davis


The Air-L@listserv.aoir.org mailing list is provided by the Association of
Internet Researchers http://aoir.org Subscribe, change options or
unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org

Join the Association of Internet Researchers:
http://www.aoir.org/

Hi Jenny, I explored paper vs online surveys in my book (Internet Survey Methodology, Balch, 2010 -- you should be able to review a copy through inter-library loan). The short answer is the medium matters. Issues include: * participant perceived ownership of the computer, * participant anonymity concerns, * participant computer skills, * Branching surveys and the amorphous nature of screen content lead to participants taking "different surveys" Regards,   Charles Balch PhD Faculty, Department of Business & Administration Northern Arizona University - Yuma Office/cell: (928) 317-6455 / 287-3906 Skype: NAUCharlie Google+: cvb23@nau.edu     -----Original Message----- From: Air-L [mailto:air-l-bounces@listserv.aoir.org] On Behalf Of Davis, Jennifer Lauren - davis5jl Sent: Tuesday, June 10, 2014 9:10 AM To: air-l@listserv.aoir.org; , Subject: [Air-L] Paper vs Electronic Surveys Hi all, A colleague and I wondered what, if anything, the literature says about accuracy of online vs. paper and pencil surveys. There's a lot available about response rates, but does medium affect how honest people are in their responses? Will happily share with the list. Thanks!! Jenny Jenny L. Davis Assistant Professor of Sociology James Madison University Weekly Author: Cyborgology.org<http://thesocietypages.org/cyborgology/> Twitter: @Jenny_L_Davis<https://twitter.com/Jenny_L_Davis> _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/
AR
Alice Robbin
Tue, Jun 10, 2014 4:58 PM

I suggest reviewing the journal Public Opinion Research. There is a
great deal of research on the topic, starting in the mid-1990s. Good
luck.

Alice

Quoting "Davis, Jennifer Lauren - davis5jl" davis5jl@jmu.edu:

Hi all,

A colleague and I wondered what, if anything, the literature says
about accuracy of online vs. paper and pencil surveys. There's a lot
available about response rates, but does medium affect how honest
people are in their responses?

Will happily share with the list.

Thanks!!
Jenny

Jenny L. Davis
Assistant Professor of Sociology
James Madison University
Weekly Author: Cyborgology.orghttp://thesocietypages.org/cyborgology/
Twitter: @Jenny_L_Davishttps://twitter.com/Jenny_L_Davis

I suggest reviewing the journal Public Opinion Research. There is a great deal of research on the topic, starting in the mid-1990s. Good luck. Alice Quoting "Davis, Jennifer Lauren - davis5jl" <davis5jl@jmu.edu>: > Hi all, > > A colleague and I wondered what, if anything, the literature says > about accuracy of online vs. paper and pencil surveys. There's a lot > available about response rates, but does medium affect how honest > people are in their responses? > > Will happily share with the list. > > Thanks!! > Jenny > > > Jenny L. Davis > Assistant Professor of Sociology > James Madison University > Weekly Author: Cyborgology.org<http://thesocietypages.org/cyborgology/> > Twitter: @Jenny_L_Davis<https://twitter.com/Jenny_L_Davis> >
EH
Eszter Hargittai
Tue, Jun 10, 2014 5:08 PM

Hi,

For quality control, I recommend using an attentiveness question (or two)
regardless of mode of data collection. Here is an example.

The purpose of this question is to assess your attentiveness to question
wording. For this question please mark the “Very often” response.

Never
Rarely
Sometimes
Often
Very Often

In paper surveys I have administered in the past few years on young adults
(in postal mail) this has resulted in 3-4% cases excluded from the
analyses. (I pitch cases where the answer is wrong or the respondent
skipped the question.)

Eszter

Eszter Hargittai
Delaney Family Professor, Communication Studies Department, Northwestern
University
Fellow, Berkman Center for Internet & Society, Harvard University

http://www.eszter.com
@eszter
http://www.webuse.org

Quoting "Davis, Jennifer Lauren - davis5jl" davis5jl@jmu.edu:

Hi all,

A colleague and I wondered what, if anything, the literature says
about accuracy of online vs. paper and pencil surveys. There's a lot
available about response rates, but does medium affect how honest
people are in their responses?

Will happily share with the list.

Thanks!!
Jenny

Jenny L. Davis
Assistant Professor of Sociology
James Madison University
Weekly Author: Cyborgology.orghttp://thesocietypages.org/cyborgology/
Twitter: @Jenny_L_Davishttps://twitter.com/Jenny_L_Davis

Hi, For quality control, I recommend using an attentiveness question (or two) regardless of mode of data collection. Here is an example. The purpose of this question is to assess your attentiveness to question wording. For this question please mark the “Very often” response. Never Rarely Sometimes Often Very Often In paper surveys I have administered in the past few years on young adults (in postal mail) this has resulted in 3-4% cases excluded from the analyses. (I pitch cases where the answer is wrong or the respondent skipped the question.) Eszter Eszter Hargittai Delaney Family Professor, Communication Studies Department, Northwestern University Fellow, Berkman Center for Internet & Society, Harvard University http://www.eszter.com @eszter http://www.webuse.org Quoting "Davis, Jennifer Lauren - davis5jl" <davis5jl@jmu.edu>: > > Hi all, >> >> A colleague and I wondered what, if anything, the literature says >> about accuracy of online vs. paper and pencil surveys. There's a lot >> available about response rates, but does medium affect how honest >> people are in their responses? >> >> Will happily share with the list. >> >> Thanks!! >> Jenny >> >> >> Jenny L. Davis >> Assistant Professor of Sociology >> James Madison University >> Weekly Author: Cyborgology.org<http://thesocietypages.org/cyborgology/> >> Twitter: @Jenny_L_Davis<https://twitter.com/Jenny_L_Davis> >> >> > > > > _______________________________________________ > > CITASA mailing list > CITASA@list.citasa.org > http://list.citasa.org/mailman/listinfo/citasa_list.citasa.org >
NA
Noelle A Chesley
Tue, Jun 10, 2014 6:52 PM

While we are on the topic of methodology, can anyone recommend suitable introductory reading on the topic of using social network sites in a research setting? I wanted to add this topic to my undergraduate methods course for sociology students as it is not covered in our text.

Thanks!

Noelle Chesley

----- Original Message -----

From: "Eszter Hargittai" info@webuse.org
To: citasa@list.citasa.org
Sent: Tuesday, June 10, 2014 12:08:23 PM
Subject: Re: [CITASA] Paper vs Electronic Surveys

Hi,

For quality control, I recommend using an attentiveness question (or two) regardless of mode of data collection. Here is an example.

The purpose of this question is to assess your attentiveness to question wording. For this question please mark the “Very often” response.

Never
Rarely
Sometimes
Often
Very Often

In paper surveys I have administered in the past few years on young adults (in postal mail) this has resulted in 3-4% cases excluded from the analyses. (I pitch cases where the answer is wrong or the respondent skipped the question.)

Eszter

Eszter Hargittai
Delaney Family Professor, Communication Studies Department, Northwestern University
Fellow, Berkman Center for Internet & Society, Harvard University

http://www.eszter.com
@eszter
http://www.webuse.org

Quoting "Davis, Jennifer Lauren - davis5jl" < davis5jl@jmu.edu >:

<blockquote>

Hi all,

A colleague and I wondered what, if anything, the literature says
about accuracy of online vs. paper and pencil surveys. There's a lot
available about response rates, but does medium affect how honest
people are in their responses?

Will happily share with the list.

Thanks!!
Jenny

Jenny L. Davis
Assistant Professor of Sociology
James Madison University

Weekly Author: Cyborgology.org< http:// thesocietypages.org/ cyborgology/ >
Twitter: @Jenny_L_Davis< https:// twitter.com/Jenny_L_Davis >


CITASA mailing list
CITASA@list.citasa.org
http://list.citasa.org/ mailman/listinfo/citasa_list. citasa.org

</blockquote>

CITASA mailing list
CITASA@list.citasa.org
http://list.citasa.org/mailman/listinfo/citasa_list.citasa.org

--

Noelle Chesley , Ph.D.
Associate Professor and Director of Undergraduate Studies

You can find me on LinkedIn , the Work Family Researchers Network ,
or Twitter (@noellechesley).

Serving Wisconsin as a Public Employee Since 2005

While we are on the topic of methodology, can anyone recommend suitable introductory reading on the topic of using social network sites in a research setting? I wanted to add this topic to my undergraduate methods course for sociology students as it is not covered in our text. Thanks! Noelle Chesley ----- Original Message ----- From: "Eszter Hargittai" <info@webuse.org> To: citasa@list.citasa.org Sent: Tuesday, June 10, 2014 12:08:23 PM Subject: Re: [CITASA] Paper vs Electronic Surveys Hi, For quality control, I recommend using an attentiveness question (or two) regardless of mode of data collection. Here is an example. The purpose of this question is to assess your attentiveness to question wording. For this question please mark the “Very often” response. Never Rarely Sometimes Often Very Often In paper surveys I have administered in the past few years on young adults (in postal mail) this has resulted in 3-4% cases excluded from the analyses. (I pitch cases where the answer is wrong or the respondent skipped the question.) Eszter Eszter Hargittai Delaney Family Professor, Communication Studies Department, Northwestern University Fellow, Berkman Center for Internet & Society, Harvard University http://www.eszter.com @eszter http://www.webuse.org Quoting "Davis, Jennifer Lauren - davis5jl" < davis5jl@jmu.edu >: <blockquote> Hi all, A colleague and I wondered what, if anything, the literature says about accuracy of online vs. paper and pencil surveys. There's a lot available about response rates, but does medium affect how honest people are in their responses? Will happily share with the list. Thanks!! Jenny Jenny L. Davis Assistant Professor of Sociology James Madison University Weekly Author: Cyborgology.org< http:// thesocietypages.org/ cyborgology/ > Twitter: @Jenny_L_Davis< https:// twitter.com/Jenny_L_Davis > ______________________________ _________________ CITASA mailing list CITASA@list.citasa.org http://list.citasa.org/ mailman/listinfo/citasa_list. citasa.org </blockquote> _______________________________________________ CITASA mailing list CITASA@list.citasa.org http://list.citasa.org/mailman/listinfo/citasa_list.citasa.org -- Noelle Chesley , Ph.D. Associate Professor and Director of Undergraduate Studies You can find me on LinkedIn , the Work Family Researchers Network , or Twitter (@noellechesley). Serving Wisconsin as a Public Employee Since 2005