When conducting ongoing surveys that span longer periods, data volumes quickly accumulate. Quicksearch's Analytics analysis system can handle large volumes without any issues, but to facilitate management over time, the following recommendations are provided:
How It Works
Analytics can ingest results from many different surveys. These surveys are stored as publications in the DialogManager module. Results in Analytics can be updated automatically ("incremental updates") where new responses are added.
If you need to perform new recalculations, change the scale of questions, or correct data that was sent incorrectly to Quicksearch, you will need to re-read the result in a complete update. A complete update can be done for only one result from DialogManager.
Therefore, it is wise to occasionally create a new result in DialogManager so that any future complete updates do not need to re-read as many responses, for example, if only the last 30,000 responses need adjustment or to enable updates in batches.
When Is It Appropriate to Change Results in DialogManager?
It is reasonable to change results at around 100,000 incoming responses in a result. The volume is a guideline and is affected by the number of questions in the survey and the amount of background information.
How Do I Create a New Result and Use It?
- In DialogManager, click "Copy" next to a publication to get a new, empty publication with the same settings.
- In the Input module that sends data to the publication, change which publication to send. So that integrated data is sent to the new publication.
- In Analytics, click "Edit" on the result source that uses the publication and add the new publication as input to the result source so that responses come in.
Is There Anything to Consider?
If you have created filters in Analytics that filter out data from a specific publication, these filters may need to be updated if they are to retrieve data from the new publication.