How not to conduct research

by | Tuesday, July 23, 2013

Note: This post has been edited somewhat to (a) clearly hide the url, which I had not done a good job of before; and (b) to add a few suggestions in the last paragraph for some strategies to make it easier for the participants to take part in the study.  (September 18, 2013).

There are many pitfalls one can face while engaged in conducting research with humans. For instance, if you are designing a survey it is important to make it easy for participants to actually complete it. Matt Koehler pointed out to me one person who just got it totally wrong.

Here is a flyer, recruiting participants for a study on college students’ use of social media, that has been posted near the elevators here at Erickson Hall.

surveyWhat stands out (to both Matt and me) was the fact that the student (name blurred) running the study had included an URL for the survey in the flyer itself. Here it is in greater detail (with some details blurred).

socialmediastudy

Now think for a moment what this student was expecting users to do. They needed to memorize or write down the complicated address (http://blahblah.qualtrics.com/SE/?SID=PQ_HLpCqrqC45nn) and go back to their office or computer and then type this sequence of letters in and then participate in the survey. Just how many people would be willing to do this? Imagine actually going through the process and making just one mistake in typing out that crazy list of characters and getting to a “404 Not Found page!”

It would have to be someone highly motivated to help you with you research to go through all this.. and frankly nobody I know is that motivated.

Now, designing your research instrument (in this case a survey) is just half (an important half but just half none-the-less) of the research enterprise. The end goal is ending up with data that you can then analyze to answer the research questions you started with. The approach shown here just about ensures that you will not have any data in hand to test your hypotheses or theory!

There many-many ways this process can be made easier for the participants—and I do hope the student researcher is also looking into these alternative methods. A few ways could be to (a) take advantage of social media itself to contact participants; (b) a mass emailing to MSU students with the link embedded; or (c) just go ahead and buy a simple domain name that would be easy to remember. A register.com search shows that msusocialmedia.com is available, as is msusocialmediastudy.com! The current approach, quite surely, will not work!

Topics related to this post: Design | Good | Bad Design | Learning | Research | Technology

A few randomly selected blog posts…

TPACK & Creativity at Twente

I just finished a marathon session of presentations and discussions with the master's students in Curriculum Development and Educational Innovation at Twente University. It was wonderful to meet with them and discuss creativity, teaching, design, TPACK, among other...

Teaching an old dog new tricks

Teaching an old dog new tricks

I have been playing with Photoshop Beta, a version of Photoshop with a range of AI-powered tools that let you add, extend, or remove content from your images using simple text prompts. This is similar to Adobe Firefly, a web-based image manipulation / generation tool,...

Fishing for problems: Podcast interview

Fishing for problems: Podcast interview

I was recently interviewed by Matt Schneidman (Curator, Creator, Podcast Host) for his Fishing for Problems podcast. Matt also publishes an  ed-focused newsletter. Our discussion was broadly framed around educational technology and the TPACK framework - but...

Palindromic poetry in prison, introducing Sandra Gould Ford

Those who follow this blog know that I love visual wordplay. This is most commonly seen in my ambigram work but another area where I have spent some time is in writing palindromic poetry. I wrote a whole series of poems when I was in graduate school at Illinois and...

Design related videos

Just a link to online videos related to design. Check it out by clicking here Relevant to CEP817 and CEP917 (and maybe even CEP818)

Blogging SETS: Morning session

I am trying to live blog the conference: Symposium on Education Technology in Schools: Converging for Innovation & Creativity [Full agenda here]. Let us see how far I can keep this up. August 20: Morning session: The pre-conference session has been about meeting old...

MSU EPET program wins national award!

The Educational Psychology and Educational Technology Program at Michigan State University is the recipient of the  2013 Best Practice Award for the Innovative Use of Technology awarded by the American Association of Colleges of Teacher Education (AACTE). This...

SITE 2008 Keynote

The SITE Keynote presentation by Matt Koehler and myself is finally ready to release to the world. I know converting 350 sildes, and synching them to the narration was a huge task - and Matt has already spent countless hours on this. He ended up with a 60 GB file...

SITE 2024: A recap

SITE 2024: A recap

The Society for Information Technology in Teacher Education (SITE) conference has been an integral part of my professional journey for over two decades. My first presentation at SITE was back in 2001 with Matt Koehler and through the years, SITE has played a pivotal...

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *