Internet Survey Software


Confirmit Flex Announced

Friday, November 20th, 2009

Confirmit, one of the biggest online research software companies (they make the survey software that the big research firms use) has announced Confirmit Flex, a new application platform that makes it possible for the company to develop new applications for clients quickly, effortlessly and without disrupting the main Confirmit service that so many companies count on.

One example of the new technology is the ability of Confirmit users to have their survey automatically rendered “outside the HTML/browser paradigm.” For example, Confirmit Flex makes it easy to program your survey for regular web users and then have that survey also appear on iPhones, or in Flash, or as a Widget on a blog.

The software makes it possible for Confirmit to launch new elements of it’s system quickly, without disrupting the regular “main” Confirmit codebase which is so important to so many research agencies. As they describe it:

Effectively, Confirmit Flex has allowed us to create a system that at its heart is a super-tanker (Confirmit) but which can be improved by speed boats (Flex components) enabling us, our partners, and clients to respond rapidly to market changes and take advantageof emerging technologies.”

Read more about Confirmit Flex (including more technical details)

Confirmit Flex Press Release

Online Survey Content Security Doesn’t Exist

Tuesday, November 11th, 2008

I received an interesting question from a reader earlier today about survey security. While I’m not actually answering his question here, it did raise an interesting point about online research — which is this: there really truly is no way to protect the content that you display in your survey from falling into the wrong hands. If you have a secret product or concept , your best bet for keeping it secret is not to test it using online research.

Before sending me the note telling me just how wrong I am, record the following:

As I figure it, there are four different kinds of security as it applies to online surveys. The first kind of security is what we’ll refer to here as back-end security. This basically means that strangers can’t simply log into the survey software server and start making changes to your survey, or download your data, or do all sorts of other things which really ought to be protected by a good password. Most survey systems do a pretty good job with this, assigning separate accounts, usernames, and passwords to each survey respondent. Some even take it to the next level, by allowing account administrators to set different permission levels for each user on the account, thereby ensuring that people who are meant to have access to your survey can’t “accidentally” go and make changes.

The second kind of survey security is where only authorized people are allowed to take your survey. Some implement this feature by giving you one respondent password that you can share will all of your respondents, or some systems even allow you to give every respondent their own password (or access key) which not only keeps out the riff raff, but also makes sure that each respondent can take the survey only once. This type of security not only ensure that only the “right” people take your survey, but also that the wrong people can’t get access to the content of the survey.

I’ve seen this kind of survey software security implemented well, but I’ve also seen it implemented poorly. Some systems, instead of assigning each survey an ID made up of a random collection of letters and numbers, use a sequential, easy to guess series. Which means that it really isn’t all that hard to view (and possibly edit!) surveys written by other clients of the survey system. So watch out for that.

The third kind of security about the connection between the respondent’s computer and the survey software server. Is it secure (look for the https: in the URL). Frankly, unless you’re doing super secret stuff and your concerned that hackers and government agents are trying to listen in on your respondents, I’m not sure it is something you need to worry too much about. But if you are afraid of industrial espionage or that someone is going to tap into your wireless signal, then you may want to take the precaution of choosing a system that allows for encrypted connections.

It’s easy enough for a well thought out survey software program to provide good security surrounding these first three measures. Where they get into trouble — and where you get into trouble if you believe them — is when they start to protect your survey content.

The fourth kind of survey software security is content protection, which basically means keeping your untrustworthy respondents from copying the top secret images and product descriptions that you include in your survey onto public web sites or your competitor’s email account.

I know, I know…there are survey systems that feature technologies that make it harder to copy images or capture video. This can be done using javascript, or by doing some crazy encryption to the feed. One could even go so far as taking over the computer so that nothing else works except the survey.

But I have a camera. And I have a video camera. And if you don’t completely lock down my computer, I have some really good screen capture software that lets me capture both audio, images and pictures. If I want to capture your survey content, believe you me, I will capture your survey content.

And then I can do pretty much anything I want with it, can’t I? No doubt 600-1000 people took that confidential survey of yours, and how are you going to know which one of them posted it to the anonymous message posting board using an anonymous IP address?

I suppose it is theoreticaly possible to embed a visual identifier into each image (a watermark of sorts) so you can trace the image back to whoever posted it online, but I’ve never heard of technologies built into survey software (if it does exist please let me know — I’ll report it here!).

There are also ways you can reduce the risk. You can, for example, use a pre-screened panel made up of people you trust. Employees, for example. Another approach is to threaten your respondents with legal action (although most will figure out pretty quickly that you have no way of identifying them). You could also threaten to stop doing online surveys if they leak your secret.

But the best way to ensure that your super secret new business idea doesn’t leak out onto the Internet is not to do online research (there, I said it). If your entire business model is based around keeping something confidential, do not put it in an online environment in front of strangers. Period. And don’t trust any research firm that says they have a foolproof method of keeping your images, video and other content safe. If they do, just pull out your camera or video camera and press record.

Favorite Survey Software Packages for 2008

Saturday, October 18th, 2008

I know I said I wasn’t going to do this, but I get asked this question a lot so I’ve caving in. Here are my (current) favorite survey software packages:

Qualtrics: (internet survey software) has a fantastic variety of question types with a really easy to use survey development system. Also features advanced survey branching capabilities including looping, random blocks of questions and more.

SurveyGizmo: (internet survey software) Also extremely easy to use survey package with a lot of features. Probably the most “Web 2.0″ survey system out their. Friendly, irreverant, with plenty of features for both the advanced user who wants to control every element of the survey experience and the analyst who just wants to get the project done. Has good e-mail invite capabilities, basic analysis tools. Plus, the free account has more features than any other “free” accounts I’ve seen. (more…)

Qualtrics Review (Online Survey Software)

Saturday, March 15th, 2008

Qualtrics survey software from Utah-based Qualtrics is an excellent web-based survey software package that offers a fantastic array of question types, a well-designed survey development interface, good fielding/survey promotion capabilities and a powerful reporting engine. It has both panal management features and multi-users capabilities and should definitely be a contender if you’re a corporate research department or academic organization looking for a survey system.  (more…)

PerkyPoll Review (collaborative polling software)

Monday, March 10th, 2008

Who said that writing and taking surveys can’t be fun?

PerkyPoll is a new “collaborative polling site” which allows you to create simple surveys that can easily be integrated into blogs, web sites, and presumably other collaborative sites such as facebook or Myspace. Although I probably wouldn’t suggest that you use it for serious research, it does have some unique elements that might make it especially entertaining if you’re looking for a simple way to collect and share survey results on a non-business critical topic. (more…)

How to Spot Fake Survey Software Reviews

Sunday, March 9th, 2008

It is probably fair to say that most online survey software companies get many (if not most, or even all) of their customers view the web. Many of them count on search engines, and those that do try to optimize their sites to drive as much traffic as possible. My only problem is when they “cheat” by posting fake reviews by fake people, comparing themselves to other products when the fact of the matter is that these comparisons aren’t really fair or valid.

(more…)

SurveyMethods.com Review (Survey Software)

Sunday, March 9th, 2008

SurveyMethods (at SurveyMethods.com) is a basic online survey software package that does OK on its own but doesn’t really offer the features of many of the other survey software packages it competes with. And while it is not a software package I’d be likely to recommend (there are even free survey software packages that provide more than SurveyMethods does), it is free to try — so you can make your own decision! (more…)

SPSS Dimensions 5.0 Released

Sunday, February 10th, 2008

SPSS has announced the release of SPSS Dimensions 5.0, an upgrade to last year’s version 4.5. Although in my opinion this feels more like an incremental release, it does have some notable new features including the SPSS Desktop Author, a new customizable question wizard, better integration with SPSS Predictive Enterprise Repository and SPSS Report. (more…)

Review of SurveyGizmo

Sunday, December 2nd, 2007

SurveyGizmo is among the most easy to use, best priced, feature packed internet survey software packages I have seen. And I’ve seen a number of them. I highly recommend it. And if you’re conducting fewer than 250 responses a month, it is absolutely free and includes just about everything you need. And it’s easy…very Web 2.0ish.

(more…)

Confirmit 12 Released With New Features

Wednesday, November 14th, 2007

Confirmit 12 has been officially released and it features a variety of interesting features that look like they will have a positive impact on both survey developers and users.

For those who don’t know, Confirmit is one of the most prominent online survey software packages. It is used by a number of market research agencies and allows for pretty complicated, interesting surveys. Frankly, I would probably use Confirmit if I could except for the fact that the price tag is higher than I want/need/can afford to spend.

Points to Confirmit for making part of their new release about improving the user experience: some of the new features include a new hierarchy selector (which could be used, say, to let you pick a state and then narrow it down to the city); a new slider for entering numbers (not the first time such a feature has been implemented in a survey software package both GMI and Vovici offer sliders too) which could be fun for scale-type questions; a card sort feature, which allows the respondent to drag and drop responses into different piles. Two improvements I especially like are the "highlight required grid input field" which can be used to show the user precisely which answer they forgot to fill in and the AJAX dynamic content, which makes it possible for other questions to appear or disappear on the page depending on the results of other questions on the same page (without a page refresh).

Confirmit 12 also allows for different images to appear in answers depending on the state of the response. Simply put, this means that you can have one image shown when the answer is not selected (such as an empty check box) and replace it with a different image when the image is selected (such as a checked check box).

Confirmit 12 has new security features as well, although to my untrained eye they don’t seem all that exciting. That is, they’re not so much about protecting the data as much as they are about encrypting the information that is shown to the respondent (so they can’t figure out your secret methodologies). Confirmit 12 does make it possible to set an option that requires the survey to be conducted over a secure, encrypted connection.

Confirmit adds new survey development features, including additional information within the context of the project overview, the ability to increase the size of text box text, and an easier to use URL setup page. The scripting editor also includes a code completion feature similar to what you might find in Visual Studio or Flash. This feature makes it easier to write code by suggesting functions, methods, and properties that are context appropriate.

On the back-end, Confirmit 12 includes a new data processing engine which adds new data import features, data cleaning, recoding and merging features, and new data exports.

Confirmit Express, the simpler version of the survey system, also includes a variety of new features such as a new user administration interface, MS Word export and the ability to quickly and easily test surveys.

For a full list of new features, see the Confirmit web site.

SurveyMethods.com using ResearchThink.com as an SEO sham?

Sunday, September 9th, 2007

The latest example of a web review that appears to be publishing fake reviews is http://researchthink.com/, which promotes SurveyMethods.com. This is supposedly the “blog” of John Bates from New York — a self-styled “research, marketing and Six Sigma professional” who is “already swamped working 6 days a week” who took the time to assemble his blog “to help out individuals that are new to survey research.” But in reality it appears to be an SEO front for SurveyMethods.com.

On his site, John reviewed five software packages: SurveyMethods.com, QuestionPro.com, Zoomerang.com, SurveyMonkey.com, and KeySurvey.com. His pick? SurveyMethods.com with a 9 out of 10 rating. The price is so good it gave John “reverse sticker shock!” It was extremely easy to use, full of features, and has a strong set of analysis tools — better than any of the other products reviews for sure! (SurveyMonkey.com was reduced to 6 out of 10 points because it didn’t include spell check). Zoomerang got zonked to 7.5 because it “cluttered.”

It is no surprise that in John’s estimation, SurveyMethods.com is “hands down the winner in online web based survey software.”

John doesn’t just publish his survey reviews at researchthink.com though — he also maintains a blog at http://researchthink.blogspot.com/ where he maintains the exact same content. Meanwhile, the domain researchthink.com is privately registered.

Is researchthink.com a fake SEO sham created to promote surveymethods.com? I think so!

Prerequisites for Online Surveys Research

Tuesday, September 4th, 2007

Conducting an online survey yourself is fairly easy, but it does require a few ingredients (other than the survey itself). If you can come up with these three things you can probably execute your own customer survey online:

1. You need to select some a survey system. This part is fairly easy to come by as there are all sorts of options out there to choose from. If you don’t expect to do a lot of surveying then you are probably OK to use a fairly low cost option. If you’re doing it for a real life professional business I would be careful not to do it on a free system that doesn’t let you remove their branding (there is nothing more tacky then having your survey end on the surveymonkey signup page – your survey should end on your home page or something similar). If you’re going to show images, make sure that you choose a system that makes it easy for you to upload and insert images – don’t choose a system that makes you upload the images to your own web server since that will make things too complicated (especially if you don’t have a web site).

2. You need respondents. This is often the most tough part of conducting a survey online – you need to find people, preferably customers, to take your survey. If you have a web site you can definitely solicit your web site visitors to take your survey, keeping in mind that you don’t want to do anything that will stop them from making purchases. One option is to invite past customers to take your survey – hopefully you have plenty of e-mail address from past customers, and a carefully worded, friendly e-mail to them may get enough of them to take your survey – especially if you make it clear to them that you’ll be using their feedback in the development of your new products. If you don’t have any e-mail addresses and you want to get your feedback from a group of non-customers, then what you may want to do is rent an outside survey panel. You’ll pay upwards of $5 or more per response, but if the feedback is important enough, it may be worth it to you.

3. You need to offer an incentive. There are probably many people who will take your survey for free. Maybe they like you, maybe they like your product, or maybe they just like to take surveys. In most cases, there won’t be a enough people like this to give you a fleshed out sample. By introducing a simple incentive – the chance to win a drawing or even some kind of an exclusive discount – you can greatly increase the number of people who will take your survey without significantly increasing your costs. For example, one of my favorite incentives is to offer a chance to win a $200 gift certificate to giftcertificates.com. You’ll double or even triple your response rate which means that the quality of your responses will be significantly higher without spending significantly more money overall.

Building Your Own Survey Panel – Online Panel Management and Strategies

Saturday, August 4th, 2007

Julie Lemaster, an MBA student at the University of California- Riverside, has written an interesting paper (which is posted to the Sloan Center for Internet Retailing web site) entitled "Online Panel Management and Strategies: An Introduction for Managers." It is an introductory guide to managers who have been asked or have decided it is time to start looking into online market research for their companies.

Lemaster contrasts full-service providers, such as M/A/R/C and SSI against complex and potentially expensive "self-serve" packages from Confirmit, Globalpark, GMI, and SurveyZ to low cost providers such as QuestionPro, Survey.com, SurveyMoney, and Zoomerang.

The abstract of the paper summarizes it as providing…

"…an introductory guide to managers who have been asked or have decided it is time to start looking into online market research for their company.  The size of the company you work for does not matter, as we will discuss several methods that can be used for any size company or investment level.  This paper is for managers who want to quickly learn the basic issues of online market research panels.  It will also be useful to managers who need to become familiar with some of the major providers of online panel management."

In addition to reviewing the providers and the various strategies for organizing your panel, Lemaster discusses a variety incentives that can be used to motivate and retain participants, such as lotteries, bonus points, and raffles.

Is SurveySoftwareReviews.com a sham sponsored by Prezza Technologies to Promote Prezza Checkbox Survey Software?

Sunday, July 29th, 2007

It would appear that SurveySoftwareReviews.com is published — or at least sponsored by — Prezza Technologies to promote Prezza Checkbox Survey software using fake reviews of Checkbox and competitors.

I have a number of Google alerts set up to help me keep up to date with new research related stuff on the web. I was going through it today when I noticed a survey software review on a web site called “SurveySoftwareReviews.com” that I had never remembered seeing before. Upon visiting the site, it appeared to contain reviews of Perseus SurveySolutions 6, Prezza Technologies’ Checkbox Survey Server, classapps SelectSurvey ASP, SNAP Surveys, Apian SurveyPro, ConfirmIt, Inquisite, KeySurvey, Quask, Raosoft, SPSS and Vovici. (more…)

SPSS Promotes Self By Trash Talking Internet Survey Research

Saturday, July 28th, 2007

SPSS recently put out a news release (which has been picked up by at least two news sites CRM Today and TMCnet) whose sole purpose appears to be to scare companies away from using the plethora of survey research tools in favor of their multi-modal survey system. How can you begin to know what your customers are thinking, reasons the release, if you only ask those who are online when hardly anyone is even using the Internet these days?

"Web-based surveys may appear to be less intrusive and easier to conduct, but without pen and paper or a good ‘old-fashioned’ telephone, organizations miss the opinions of many, including those without a computer, the forever and selectively computer illiterate and a large part of the senior population that simply missed the tech revolution."

The release goes on to remind everyone that paper and phone survey are "in many cases essential, if organizations expect to present clients with the most accurate and complete view of customer attitutes and opinions." 

It then proves its point by referring to a recent Pew report:

"In fact, the Pew Internet & American Life Project recently found 49 percent of Americans only occasionally use modern gadgetry and many others bristle at electronic connectivity — the Internet."

Wow. Who would have thought that in 2007 more than half of the US population either doesn’t use and/or extremely dislikes the Internet. We all may need to rethink our online programs and go back to the phone banks, door-to-door solicitors and shopping malls many of us have mostly abandoned.

…but before we do, here are some stats not included in the SPSS release:

  • Total US population is about 300 million people with 225 million of them over the age of 17. (US Census)
  • There are 178.8 million web users in the US (comScore, June 2007)
  • 71% of all adults are online (Pew)
  • 87% of 18-24 year olds, 83% of 30-49 year olds, 65% of those 50-64 and 32% of those over 65 are online. (Pew)
  • 73% of white, 62% of black, and 78% of English-speaking Hispanic are online. (Pew)
  • 73% of people living in Urban/Surburban Environments and 60% living in rural areas are online. (Pew)
  • 93% of those earning $75K+, 82% of those earning $50K-$74K, 69% of those earning $30K-$49K and 55% of those earning less than $30K are online. (Pew)
  • Total number of households is 105.4 million (US Census)
  • Almost 70% of US households have Internet access at home.  (Leichtman Research Group Q1 2007)
  • 53% of US households have high-speed access (Leichtman Research Group Q1 2007)

The Pew study that SPSS refers to in their release is called "A Typology of Information and Communication Technology User." The study measures not whether or not people have internet access (as implied by SPSS) but instead tries to categorize people by the degree to which information and communication technologies are utilized and enjoyed.

According to the report, only 15% of the population can be characterized as "Off the Network" — that is, individuals with neither cell phones nor internet connectivity. They tend to be in their mid-60s, nearly three-fifths are women. Only 7% have college degrees (vs. the US average of 27%) and only 4% earn over $75K a year (vs. the US average of 22%). They are the heaviest users of "old media" such as radio and TV but do not have the inclination to try new information and communication technology.

Obviously, not everyone is online and if you’re looking for a particularly special group you may want to revert to paper, pencils and phones. However, I’m thinking that for most purposes you’re going to be able to find who you’re looking for online.

But the implication of the SPSS release is that unless you use (expensive) multi-channel research techniques (provided by them?) you will be collecting bad information and misleading your clients. This isn’t true and is in fact extremely misleading.