Let’s face it: an online survey is, at its heart, simply a collection of forms. Super long forms with many pages and twisty questions yes, but still forms. And built into the very architecture of the world wide web are the tools that are needed to build forms (and ultimately, surveys). So what is the point of building a service that’s only point is to build forms? Who would use it?

Enter Wufoo.com, the Web 2.0 answer to online forms. Creating forms has really never been so easy or so much fun. Or so much fun to look at. Or so smooth. As someone else pointed out somewhere else, this service makes you wish you had a need for a form so that you could use Wufoo to build it. It really is that neat.

Can you make surveys using Wufoo? Not really. I mean, I suppose if you had a really simple survey that you wanted to execute, you probably could. It does let you do multiple choice questions, open-ended questions, and single-response questions. It even has special fields that help respondents enter prices, addresses, e-mail addresses and dates (all of the things one might regularly enter in a form). But there are also a lot of survey-related things that it doesn’t let you do, like create multiple pages, or validate responses in a meaningful way (other than to require the fields). I would hazard to say that as far as survey capabilities go, SurveyMonkey and Zoomerang have more features, as well as libraries of templates you can use to get you started. These are, after all, programs that were specifically designed to help you create surveys.

One thing that was a little annoying — I spent about five minutes designing a form and clicked the "Themes" button to make it look extra pretty — only to discover that my form had completely disappeared! I had assumed that my changes were being saved as I went and never even noticed the "Save Form" button at the bottom-right corner of the page. Make sure you push it when you are done or your simple survey will end up be simpler than you intended. And then you’ll have to start over from scratch.

With that said, I wish SurveyMonkey, Zoomerang, and even the package I use, GMI Net-MR, would take a page from the Wufoo design/survey development book and create an interface that is as fun and as easy to use. I would get a lot more work done.

Wufoo offers a variety of pricing plans, ranging from free accounts (the "gratis" plan) which lets you create 3 forms with up to 10 fields each and accept up to 100 entries a month. The next plan up (the "ad hoc" plan) costs only $9 a month and allows you to have up to 10 forms with an unlimited number of fields and accept up to 500 entries. There is also the "bona fide" account (unlimited forms, 3000 responses a month), the "carpe diem" plan (15,000 responses a month) and the "ad infinitum" plan (no limits, total cost is $199 a month).

And if you are trying to create an online form to collect data, and don’t want to mess around with the basic HTML building blocks, and if you want the chance to play with the newest and greatest of what’s out there, then give Wufoo a try.

• Wufoo.com

A couple of days ago Richard Kassiasieh of Kassblog posted an interesting commentary about Markettools’ Zoomerang product in which he expressed some concern not about the functionality of the service (which he thought was pretty straightforward) but about the branding, pricing, and control one loses over data by using an outside resource.

In terms of the branding, Richard was concerned because the free version of Zoomerang ends with a message inviting respondents to use the system to create their own services, and one could argue that this would be somewhat unprofessional-looking way for a "real" company to end an exchange with a customer (although to be fair, a company that at least goes to the trouble to collect feedback from customers — even free online software — is much better than all of those companies that don’t collect any feedback at all). And to be completely fair, the paid version of Zoomerang does allow you to remove the branding.

But Richard raises a good point — if you are going to go to the trouble of collecting invaluable data from your customers, you at least owe it to yourself to use a process where you control the look and feel of the experience from beginning to end (which, I should again point out, is possible using the paid version of Zoomerang. But even there you need to make sure you change the settings appropriately and test your survey to make sure it looks exactly as you want it to look).

Richard’s second point is that services such as Zoomerang store your data on their servers. This is, of course, true for all web-based survey systems and there is no getting around it unless you only use survey software installed on your own computers that are maintained in your own facilities. You can to some degree mitigate the risk by making sure you understand the level of security and regular backup procedures of the company that you choose to use for your survey research.

Zoomerang doesn’t say precisely how your data is stored other than to indicate that information on members and panelists are stored in "secure databases" protected by passwords, and that data from surveys is stored at "a secure hosting facility with both physical and software-based security systems." For most people, this probably sounds secure enough but if you want to know more and if security really is a concern you may want to contact the provider before you start your survey.

Data retention policies are also important to consider. For example, if you use the free version of Zoomerang they say that your data will only be saved for 10 days following the start of the survey. The impression I get is that they do retain it longer than that and it can be accessed again if you sign up for a paid account, but it is always important to understand the data retention policies before you get started as well as whether or not it will be easy for you to download your data in a managable format when you are finished. Richard expressed concern that Zoomerang only allows a flat file format — well, I think for most people that is probably enough. There are a few services that will allow you to download your survey into a relational file format (such as an Access data file), but these services tend to cost more and frankly I’m not sure what most researchers would ever do with the data in that format anyways. SPSS takes only flat files.

Finally Richard raises the question of cost and why there aren’t more open-source alternatives. He speaks the truth when he notes that survey software isn’t really that hard to write and to that I really don’t have that much of an answer. I imagine it will happen eventually.

• Read Richard’s article about Zoomerang at Kassblog

Triexa, a Toronto-based company formerly know as Sensation Designs, is presently beta testing a new web-based survey software system called AskItOnline. Although I haven’t had a chance to play with it yet (the software is in "private" beta with only some screenshots posted), what makes it fascinating is 1) it is a "Web 2.0" type program that utilizes a drag-and-drop web-based interface and a particularly reasonable pricing structure (four levels: "basic" which gives you very little functionaliy but it allows you to collect 100 surveys for free; "standard" which adds themes, some additional survey/design features and a cost of $7 a month for up to 5 surveys with 750 responses each; "professional" which gives you up to 10 surveys and 2500 responses per survey for $15 a month and "enterprise" which allows you to do an unlimited number of surveys with up to 15,000 responses each for $25 a month.

If you’re looking for an easy-to-use package that has a very low cost, this pacakge may be for you. Although each level contains different features, the enterprise version allows multi-page surveys, an unlimited number of questions per survey; "star ratings"; randomized responses; the ability to insert images and video; response validation; question piping; skipping/branch logic; and up to a terabyte of data storage. You can also review your results online, download your results, and receive e-mail notification whenever someone completes your survey.

The software is still in "private" beta, but it appears that they are still accepting new testers and it’s always fun to participate in the development of a new program.

Learn more about AskItOnline

SurveyGold from Golden Hills Software is an easy to use Internet-based survey software system that has been around for some time and has to some degree mastered the art of making online research a simple, don’t-have-to-think-to-hard-about-it process. Although the software is limited to a basic set of question types, it does allow for some basic skipping based on responses and if you’re looking for a program that will get you the results quickly with very little training, this package may be worth exploring.

I’m not going to go into an entire review of the software package here at this moment (although I did just download it — Golden Hills offers a free 30-day trial), what I did want to say is that version 8 of the software was just released a few weeks ago and it offers a variety of features such as:

• Opportunity to organize surveys into folders.
• Basic weighting.
• Multi-page web survey form (takes SurveyGold to the next level!)
• Basic validation
• Ability to import/export surveys for other SurveyGold users.
• Memorized filters (you can set up data filters for viewing your results and it will remember them)
• Wave reporting (view mdata collected over time against prior periods)
• Updated user interface (very XP-like in my opinion)
• Faster database
• Improved graphing in the reports module

Several bugs from the previous version of the software have also been fixed.

Learn more about SurveyGold 8

SPSS recently announced the release of SPSS Dimensions 4.0, the latest incarnation of its enterprise survey and analysis suite that does everything from helping you create surveys to analyzing the data to generating reports. Before looking into the new features introduced in version 4.0, I thought it might first be interesting to explore the basic features of the system. In other words, what is SPSS Dimensions?

SPSS Dimensions isn’t so much an individual software package as much as it is a platform of several independent software packages that are able to work together in a relatively seamless fashion. Sort of like how each of the programs within Microsoft Office (Word, Excel, Powerpoint, Access, etc) can work independently (and be purchased independently) but also work very well together. Like Office, most of the packages that work with Dimensions are published by SPSS — although the platform has been designed to accommodate the integration of software written by 3rd party developers (and several such packages do exist).

Some of the programs that work with Dimensions include:

• SPSS mrDialer - Automated dialing for phone surveys
• SPSS mrInterview - Create and execute online surveys
• SPSS mrInterview CATI - Create and execute phone surveys
• SPSS mrPaper - Create and execute paper surveys
• SPSS mrScan - Scan paper surveys
• SPSS mrStudio - Manage and manipulate data
• SPSS Desktop Reporter - Create tables from local data
• SPSS mrTables - Interact with tables on your desktop
• SPSS mrTranslate - Manage translations of surveys and reports
• Techneos Entryware - Collect data using handheld devices
• SPSS Base - Analyze data
• Clementine - Data mining
• SPSS Text Analysis for Surveys - text analysis & categorization

At the core of SPSS Dimensions is the Dimensions Data Model, a set of components (openly documented and supported) which allow for accessing information about questionnaires and respondent data. It also deals with keeping track of changes to the questionnaire (versioning), translating both questions and data from one format to another, and managing data stored in multiple formats and platforms.

Visual representation of the Dimensions Data Model
(from the SPSS presentation "Using the SPSS MR Data Model")

The table above describes the role of the data model well. Data can be collected from multiple sources. Instead of each collection program storing the data in its own database, it instead sends it to the Dimensions Data Model which puts it into its own special format. When another program, such as a data processing program or a data analysis program needs the data it requests it from the Dimensions Data Model using standardized request formats (that just about any program can use).

Consider a project in which you need to collect data using three different survey techniques including a phone survey, a web-based survey and a paper survey. Even though you’re going to ask the same basic questions in each survey, you are still going to have to develop three completely different questionnaires in order to compliment each of the mediums, which further means you’re going to have to program the survey three different times (perhaps four, if you consider that you may be using scanning software to read some of your paper surveys). 

Even though the question is the same, it needs to appear different
across modes and across functions (from the SPSS presentation
"Improving Government Programs with Comprehensive Data Collection")

After you’ve finished collecting the data (using three separate data collection tools, all of which store the data in their own, separate proprietary format that exports into the frustratingly simple CSV format, you’ll then have to combine all of the data into one file which you’ll then need to clean and prepare for analysis. Following analysis, you’ll export your results into yet another program.

Using the SPSS Dimensions Suite (or more specifically, software that is integrated into the Dimensions Suite) makes the process go much faster by optimizing the mechanics of designing and fielding your questionnaire and analyzing and reporting on the data.

Dimensions reduces the time it takes to conduct a complex research project
(Source: SPSS presentation "Discover it with Dimensions")

SPSS Dimensions has been developed based on the notion of "Design Once, use Many" so once you have created your initial questionnaire (either using a simple, graphic user interface found in mrInterview or the more advanced script driven interface provided by mrStudio — either package will allow you to import the text of your survey from MS Word), you can then quickly (and easily) set it up to deploy using multiple modes (paper, web, CATI, etc).

Perhaps one of the most exciting features of SPSS Dimensions is its multi mode deployment capabilities. Most surveys today require some amount of programming to deal with skipping, piping, the incorporation of outside data, and other advanced options. Ordinarily, each mode would require its own programming. SPSS Dimensions is designed so that you only need to write the script once and it will work the same in each context.

SPSS Dimensions allows you to program your survey once
and have it work on multiple platforms. (from the SPSS presentation
"Improving Government Programs with Comprehensive Data Collection")

Dimensions not only helps you design and execute your survey, it also manages security, translating the survey into multiple languages, and manages multiple versions of your survey as well.

External databases containing participant details can be added at any time, and it can be used both in the survey and during analysis. Data from outside sources can be reviewed during the survey to check for inaccuracies, and it can even be updated based on responses given in the survey.

All of the data that is collected, regardless of how it is collected, goes into one SPSS Dimensions database where it can then be analyzed and reported on. Although Dimensions is an open platform that will allow analysis to be conducted in any program (it will export data into a variety of formats for other programs to use), the suite is optimized to work with several SPSS-published programs, such as mrStudio, mrTables, SPSS for Windows and Clementine. Results can then be automatically turned into interactive web-based reports or analyzed using Excel, Word or PowerPoint. Dimensions integrates all of the major capabilities provided by SPSS’s various data analysis packages, including SPSS Base for statistical analysis; Clementine for data mining, and SPSS Text Analysis for Surveys for text analysis and categorization as well as a variety of SPSS and 3rd party data collection and reporting tools.

Reasons to Consider SPSS Dimensions

• Powerful interviewing engine
• Open architecture
• Web-based user interface
• Easy to create surveys
• Write the survey once, use in multiple modes (phone, web, etc)
• Write the scripting/programming once
• Write the survey once, use in multiple modes (phone, web, etc)
• Write the scripting/programming once
• Easy to program (similar to VB Script)
• Common data storage format/interface
• Translation capabilities
• Faster development and analysis time
• Works with (some) third party applications
• Scriptable (write your own scripts to work with data)
• Integrates well with SPSS
• Integrates well with Excel

Reasons not to use SPSS Dimensions

• Expensive
• Limited to Dimensions compatible tools
• Complicated to set up and integrate with existing systems
• Requires lots of IT support

Learn more at the SPSS web site.

For those of you tired of simple multiple choice radio box, check box kind of online survey questions, RelevantView has created a new online survey tool that offers the ability to have users participate in an online card sort much like what they would experience if they were participating in a real-life exercise.

Although I can’t tell from the image precisely what technology is being used to power the sort, it does have a very Web 2.0 feel to it that hopefully gives a sense of the types of fancy new user-friendly online survey technologies we can expect to see in the future.

Read the press release.

Zoomerang recently announced the creation of a new "Education Resource Center" which will provide practical tips and best practices to educators interested in revitalizing their academic initiatives. The program, which is closely integrated with Zoomerang’s online survey service, is designed to give educators the tools they need to use survey research to drive curriculum decisions and increase student performance; incorporate faculty imput into the decision-making process while increasing teacher satisfaction; and eliminate cumbersome paper processing allowing educators to spend more time on classrom development.

Visit the Zoomerang Education Research Center

Read the full press release at Yahoo Business

Perseus Development Corporation and WebSurveyor, combined under a newly formed holding company funded by Austin Ventures, announced today they were selected as a winner of the CRM Rising Star award by the editors of CRM Magazine. Perseus Development Corporation is the originator and leading provider of Enterprise Feedback Management (EFM) solutions, while WebSurveyor is the leading provider of online survey software for business professionals.

Read more at the Boston Daily Business News.

SurveyZ is an entirely web-based, self-service internet survey system developed and operated by Utah-based Qualtrics. It offers a variety of advanced capabilities, including unique survey questions, branching, looping, piping, trigger-based responses and form grading as well as an unparalleled collection of pre-written surveys that you can borrow questions from or use as the basis for your own surveys. The design and organization of the SurveyZ survey development environment isn’t particularly impressive (it looks like something out of 1998), and the design options for the surveys themselves are fairly limited — yet the design process is fairly smooth and even the most complex surveys can be created by individuals with very little experience. SurveyZ has a built in e-mail invitation system and a very limited reporting engine. All in all, if you’re looking for a survey system that can do just about anything and you don’t care so much about design or reporting, SurveyZ may have everything you need.

(more…)

Opinio 5 is a well-designed, easy to use and highly customizable internet survey system published by Oslo, Norway based ObjectPlanet. The software, which is available both as a hosted service and as an application you can install on your own web server, offers all of the major features you would expect to find in a moderately advanced packaged with a few very powerful and interesting extras (and a couple of notable deficits). It is perfect for a corporate research department or organization with users at several levels — novice will find it fairly easy to create smart looking surveys very quickly, while more advanced users will be able to control precisely how the surveys look and feel. Opinio also offers a highly configurable reporting engine that for some applications may completely replace the need to examine the results in an outside data analysis package. The software is well priced, extensible, and is definitely worthy of consideration for any midsized research department looking for a flexible, easy to manage internet survey package.

(more…)

ResearchExec, owned and operated by the Fairfield, Connecticut based company of the same name, is an entirely web-based survey system that is available either as a hosted solution or as a package you can install on your own server. It offers a tremendous amount of customizability as well as a number of advanced features such as the ability to set quotas for individual questions and advanced survey logic. It has integrated panel management that allows you to send surveys to specific members based on their responses to previous surveys. The survey development system, while elegantly designed and extremely flexible, is tedious to use and does not play well with FireFox 1.5 or Internet Explorer 7 RC1. It offers very little in terms of a reporting system, and you should expect to do most of your analysis in a separate program such as Excel or SPSS. Because of the focus on advanced features, the sharper learning curve and the lack of a reporting engine, ResearchExec is more likely to appeal to users at a professional research firm and not those looking for a quick easy way to produce and report on internet research.

(more…)

Beeliner Surveys is a simple, easy-to-use and extremely inexpensive online survey service operated by Cambridge, Massachusetts based @Spinfish Web/ROG. Although its survey capabilities and design flexibility are very limited, the system is very easy to use and it includes some very unique and useful features, such as the ability to include full surveys within e-mail messages and create custom reports that can be saved and reused. While the program does have some security issues and while it does very much limit your options in terms of the types of questions you can ask, organizations looking to conduct a quick and easy survey may find the program does what they need at a price they can afford.

(more…)

Grapevine 3.0 is a moderately priced, relatively full-featured online self-service survey solution published by Toronto-based Business.ca. It offers most of the basic features, a few of the advanced features, and a collection of well designed, pre-written surveys and design templates that are sure to appeal to small companies and organizations who aren’t looking to spend a lot of time reinventing the marketing research wheel. The survey design/management interface is fairly easy to master, although the non-Web 2.0 driven survey development environment can sometimes be a little slow and frustrating. The system includes a lovely reporting engine, the ability to add multiple users to one account, the ability to upload lists of respondents (and send out invitations) and a fairly strong help system. While I am not so sure that I would recommend this package for advanced users or firms that intend to do a lot of research, it may be a very appropriate choice for a firm that finds the pre-written, pre-designed surveys worth the cost. 

(more…)

There are a lot of excellent internet web interviewing packages out there. Since it is unlikely that I will personally have time to review, compare and contrast every one of them, I’ve compiled some of the criteria I consider when evaluating internet survey software systems including questions I ask about basic capabilities, advanced survey related capabilities, design/development features, user experience related elements, response management capabilities, reporting capabilities, pricing, system requirements and available support and training. (more…)

SurveyCore is a fairly simple web-based survey system that provides a range of basic features including multiple question types, multi-page surveys, and even some moderately advanced features such as piping and branching. Design capabilities are limited, and the fact that it does not provide an off-line editing module may be annoying to those who are not always connected to the Internet. The system does feature a built-in e-mail invitation/tracking module, and it offers an interesting reporting system that may prove useful especially for ongoing studies. While the system is not overly expensive compared to some advanced systems, it may be out of the price range for many who may be satisfied with the feature set.

(more…)