Enter your search above to see Results

Case Studies

Adding Value to a Market Research Survey

Download PDF

Analyzing Survey Data

Our client had just completed a large Worldwide survey which had cost many millions to do.  The agency which had coordinated the survey were using SPSS to calculate the results and they presented many hundreds of pages of cross tabulations to the client.  Consequently, our task was to see if could take raw data and then analyze the survey on the fly.

We automated the tasks of cleaning and weighting the data and then computing the metrics.  Filters could change the calculations.  This allowed us to automate survey reporting.

There were so many ways to cut the data and our client wished to perform data mining.  For example, each survey respondent lived in a different country, worked in different sizes of company, worked in different industries, had different qualifications, sex, age etcetera.  The survey agency had prepared summaries by each country and by industry, but it was not practical to delve deeper.  It was hard to visualize what was going on. We needed a better way to analyze the survey.

2006_image


The Challenges in Analyzing Survey Data

  1. Huge investment in running a global survey.  The client wanted an online dashboard report to show the results of key metrics.
  2. Users would be able to filter by many audiences and the system would compute the results directly and chart them. Analyzing Survey Data requires working with sets. Changing a filter will adjust the set of respondents every time. As the sets from each filter are intersected the sample size gets too small to trust the values.
  3. We update the survey every year. How can we tell if a movement from one wave to another is significant or not?
  4. How do we get added value from analyzing the survey.

Solution Highlights

  • Database structure to store many waves of survey
  • Computation Engine to allow us to compute “on the fly”
  • Most popular metrics precomputed and cached in OLAP cubes
  • Statistical methods used to add extra information such as weighted sample size and hypothesis testing
  • Compute wave on wave deltas
  • Online dashboard to show the results
  • Custom dashboard widgets to warn users about small sample sizes and results of hypothesis testing

The Solution

We started by designing a database schema which could hold all the results of the survey.  We then build some tools to pivot the data into an easier format to use.  Each respondent has many different attributes. For example, the country where they work, their educational background, the industry they work in and size of company.  The answer to specific questions gives us the attributes’ values.  We scan the responses to the survey to allocate the attributes against each respondent.  This makes it much easier to calculate results for a set of attribute filters on the fly.

The shaped data was then loaded into an OLAP cube and metrics were defined.

Metric Value (d) and sample size (e)
x
Variance
S_k^2 =
T test of significance in difference in the result
S_k^2 =

Finally, we produced a custom Power BI dashboard to show the results of the survey along with color coding to warn about small sample sizes and statistically significant movements.

Extra Value Analyzing Survey Data

By creating activity logs the central team were able to perform an analysis of query activity. This told us the degree to which the system was being used but also told us what the business was interested in knowing. This great feedback was used to plan for the next surveys so that we could control costs in reducing unwanted data and focus on the facts in which the business had the most interest.

Our Approach to Analyzing Survey Data


  • Partner led project management
  • Multidisciplinary teams with Data Engineers, Data Analysts and Business Analysts

New Capabilities


  • New custom survey dashboard
  • Data Mining
  • System warns against unsafe conclusions

Technologies Used to Analyze Survey Data


  • SQL Database
  • SQL Server Analysis Services
  • R Scripts
  • Custom Java Visualization
  • PowerBI

Related Case Studies


Enquiry

See how we can make your data speak

Send an enquiry to us below

reCAPTCHA