How not to conduct research

by | Tuesday, July 23, 2013

Note: This post has been edited somewhat to (a) clearly hide the url, which I had not done a good job of before; and (b) to add a few suggestions in the last paragraph for some strategies to make it easier for the participants to take part in the study.  (September 18, 2013).

There are many pitfalls one can face while engaged in conducting research with humans. For instance, if you are designing a survey it is important to make it easy for participants to actually complete it. Matt Koehler pointed out to me one person who just got it totally wrong.

Here is a flyer, recruiting participants for a study on college students’ use of social media, that has been posted near the elevators here at Erickson Hall.

surveyWhat stands out (to both Matt and me) was the fact that the student (name blurred) running the study had included an URL for the survey in the flyer itself. Here it is in greater detail (with some details blurred).

socialmediastudy

Now think for a moment what this student was expecting users to do. They needed to memorize or write down the complicated address (http://blahblah.qualtrics.com/SE/?SID=PQ_HLpCqrqC45nn) and go back to their office or computer and then type this sequence of letters in and then participate in the survey. Just how many people would be willing to do this? Imagine actually going through the process and making just one mistake in typing out that crazy list of characters and getting to a “404 Not Found page!”

It would have to be someone highly motivated to help you with you research to go through all this.. and frankly nobody I know is that motivated.

Now, designing your research instrument (in this case a survey) is just half (an important half but just half none-the-less) of the research enterprise. The end goal is ending up with data that you can then analyze to answer the research questions you started with. The approach shown here just about ensures that you will not have any data in hand to test your hypotheses or theory!

There many-many ways this process can be made easier for the participants—and I do hope the student researcher is also looking into these alternative methods. A few ways could be to (a) take advantage of social media itself to contact participants; (b) a mass emailing to MSU students with the link embedded; or (c) just go ahead and buy a simple domain name that would be easy to remember. A register.com search shows that msusocialmedia.com is available, as is msusocialmediastudy.com! The current approach, quite surely, will not work!

Topics related to this post: Design | Good | Bad Design | Learning | Research | Technology

A few randomly selected blog posts…

Penang update

Today was my presentation at the University Sains Malaysia. I was picked up this morning by Abdul Hamid, a huge beefy man, with little English, but a great smile. A beautiful half-hour drive along a sea-side highway led us the University which is perched somewhat on a...

Keep TPACK clean 🙂

I came across this sign when I was in India recently and I just HAD to take a picture of it. Click on the picture for a larger version Of course, much of the effect comes from the inadvertent yet appropriate peeling of the paint from the letter "R." But fun...

RK, calligrapher, designer, teacher

R. K. Joshi | 1936 - 2008 R. K. Joshi was a calligrapher, typographer, artist, type-designer, and teacher. He has been maybe the greatest influence on me and what I do as a designer and teacher. And I know I am not alone. He influenced a generation or more of...

EPET at SITE 2013

SITE2013 (the annual conference of the Society of Information Technology in Teacher Education) is being held in New Orleans starting next week. The Educational Psychology and Educational Technology program at MSU has a significant presence at the conference. This...

TPACK at Classroom 2.0

There is an ongoing discussion at Classroom 2.0 on TPACK. You can join the conversation here.

Happy 2009, a stop motion movie

Soham, Shreya and I spent this afternoon making a stop-motion animation new year's card. Check it out... http://www.youtube.com/embed/7kw_icNKI44 Have a great 2009!

Reading online & off

Nice article in the NYTimes (Literacy Debate: Online, R U Really Reading?) about today's generation and how much of their reading happens online (as opposed to reading books). I have seen a change in my reading over time as well. Most of my reading today happens...

Origin-al Interface snafu!

Origin-al Interface snafu!

The Origins Project at ASU is an attempt to explore humankind's most fundamental questions about our origins. As the website says, This project brings "together a diverse collection of the world’s leading scientists, scholars, and public intellectuals...

We feel fine

We Feel Fine is a web-installation, "a self-organizing particle system," art project that is powerful and touching - building as it does on people's emotions, harvested from blog postings from around the world. As the designers say, "We hope it makes the world seem a...

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *