The response rate for the survey far exceeded my expectations. While I didn’t really have a previous run of this survey to compare against, I have seen surveys on other blogs not really do so well – so I didn’t expect too big of a response. However, the turn out was really good (due mainly to the help of other bloggers) and we got over 2,600 entries the first day!
Over the course of two weeks, the total count came to 6,104 entries. However, this should be qualified by the number of abandoned or incomplete entries which was around 500 on average. I say on average because not all questions were required.
I received a lot of feedback during the course of the survey, and I appreciate the thoughtfulness that people put into their comments. For the most part, the feedback consisted of ideas for improving questions to make the survey more useful. While I tried to design the survey to make it as effective as possible, the instant feedback I received made it clear that improvements could be made.
Where the design of the survey and particular questions was lacking, I can primarily lay the blame at my own subconscious biases. It is difficult to make a survey engaging yet useful, while also kept within an allowable size limit. Eliminating the tunnel vision one receives from personal experiences or preferences is a challenge. We should all keep this in mind when evaluating other pieces of data or research conducted in the field in nutrition.
Maintaining perfect impartiality can be difficult, even when purposefully trying to do so.
I did choose to exclude one specific question from the results, since it had a glaring validity issue (there wasn’t an option for “zero hours of intense exercise”). Other than that the rest of the questions and your responses are now available for your review.
Paleo survey in 2012?
Yes, based on the great response this time around I definitely plan on doing another one next year. Hopefully I’ll have more resources to devote to incentives and prize drawings for respondents. The system employed this year worked well, and I was excited to send off Amazon.com gift cards to three lucky (and random) survey takers.
I also expect the next iteration of the survey to allow more qualifying choices for each question to ensure that a respondent isn’t left without an appropriate response they can choose. As well, question categories will be expanded to provide more compelling data on all categories but especially sections like raw food consumption, and exercise patterns. Just about all of the feedback I received was incredible, so I will be including those suggestions in the next version.
Enough already, show me the results!
I’d like to say thank you again to everybody who participated in this year’s Paleo Community Survey. I think the results will provide some interesting insight into our burgeoning movement, and help to further refine questions for future surveys and research.
Please “like” or retweet this to let everybody know the results of the survey are available.