Interviewing
Use the Interviewing activity to produce the following reports for your interviewing project that utilizes sample management.
For more information about customizing these reports or running them outside of the Interviewing activity, see the notes at the end of this topic.
Note Each report includes the Supported Modes property, which indicates that each report may only be available in the activated project mode (Web, Phone, or Personal).
Contact History Based
The following reports are based on the project’s contact history data:
Report
|
Modes
|
Answer Time Distribution
|
Phone
|
Busy, Wait, and Idle Time
|
Phone
|
Busy, Wait, and Idle Time Across Projects
|
Phone
|
Contact History
|
Phone, Personal, Web
|
Contact Outcome Status
|
Phone, Personal, Web
|
Dialer Statistics
|
Phone
|
Interviewer Statistics
|
Phone, Personal
|
Interviewer Statistics Across Phone Projects
|
Phone
|
Interviewer Statistics Across Personal Projects
|
Personal
|
Silent Call Statistics
|
Phone
|
Sample Based
The following reports are based on the project’s sample data:
Report
|
Modes
|
Appointments Distribution
|
Phone, Personal
|
Appointments Distribution Per Interviewer
|
Phone, Personal
|
Appointments Summary
|
Phone, Personal
|
Contact Outcome by Segment
|
Phone, Personal, Web
|
Contacts by Segment
|
Phone
|
Incidence Statistics
|
Phone, Personal, Web
|
Overall Disposition Across Phone Projects
|
Phone
|
Overall Disposition Across Personal Projects
|
Personal
|
Queue Status
|
Phone, Personal, Web
|
Queue Status by Interviewer
|
Phone, Personal
|
Queue Status by Time Zone
|
Phone, Personal
|
Review Contacts
|
Phone, Personal, Web
|
Review Percentage by Interviewer
|
Phone, Personal, Web
|
Sample Usage
|
Phone, Personal, Web
|
Sample Usage Across Phone Projects
|
Phone
|
Sample Usage Across Personal Projects
|
Personal
|
Time Zone Status
|
Phone
|
All reports display counts and percentages that are zero as a hyphen (-) and counts and percentages that are rounded to zero as an asterisk (*).
Reports include charts only if you have enabled the charting feature in UNICOM Intelligence Interviewer. For more information, see
Running reports.
The rest of this topic describes the reports in detail.
Answer Time Distribution
For projects that use an autodialer, this report shows a frequency table of the time taken by participants to answer calls. The categories are one second to 20 seconds in one second intervals, with an additional category for durations greater than 20 seconds. Each cell shows a count, a column percentage, and cumulative column percentage.
You might want to use the statistics in this report to adjust the minimum length of time that an unanswered phone call must ring before the autodialer terminates the call. However, your local laws might specify the minimum value that you must use.
Note that this report always includes data for both real and test interviews – you cannot choose to include only one or the other. For projects that do not use an autodialer, selecting this report might display an empty table or an error message.
Busy, Wait, and Idle Time
For projects that use an autodialer, this report shows the busy, wait and idle times for each interviewer who has worked on the project. The definition of these times is as follows:
▪Busy time. This is when the interviewer is interacting with the participant.
▪Wait time. This is when the interviewer has clicked the Start Dialing button (in the Phone Participants activity) and is waiting to be connected to a participant.
▪Idle time. This is when the interviewer can click the Start Dialing button, but has not done so.
Each cell, which corresponds to the busy, wait, or idle time for one interviewer, shows the mean time, the total time, the minimum time, and the maximum time. All times are shown in days, hours, minutes, and seconds.
If you specify a time period when you run the report, the report includes only interviewers who made calls during that time period.
The Busy, Wait, and Idle Time report does not include a chart, even if you have enabled the charting feature.
This report always includes data for both real and test interviews; that is, you cannot choose to include only one or the other. For projects that do not use an autodialer, selecting this report might display an empty table or an error message.
Busy, Wait, and Idle Time Across Projects
This reports provides busy, wait, and idle information across projects for each interviewer and project for the last 8 hours. This report is similar to the Busy, Wait, and Idle Time report, except this report always includes data for both real and test interviews and it cannot specify a time period.
Note Due to a Microsoft SQL server limitation, this report is limited to a maximum of 128 projects. When working with customers accounts, this report will only include data for projects in the selected customer account.
▪Total. Total amount of time the interviewer spent working with the project.
▪Wait. Total amount of time the interviewer waited for the dialer to return a connected respondent.
▪Idle. Total amount of time between interviewer interactions with the Phone Participants activity (when not speaking to a respondent or waiting).
▪Busy. Total amount of time spent speaking with respondents.
▪Average. The average wait time per dialer connection.
For more information about across project reports, see
Across project reports.
Contact History
This report provides the project’s full contact history. The report’s default fields are:
▪Interviewer ID
▪Start Time
▪Sample ID
▪Duration
▪Contact Outcome
To add and remove fields in the Contact History report
1 Fields can be selected or removed via the Interviewing Options activity. Selected fields are created in the sample history table. Fields are also created in the sample history table when data is synchronized with the server.
2 Any new fields should be added to the ContactHistory.mdd file (for field translation). The file is in the default installation path: \FMRoot\Shared\Cati\Reports.
3 Update the script in DPM to indicate that new fields in are in the report. The script is saved in DPM at: Site > Servers> [Server_Name] > Applications > CatiReports > ApplicationSettings > ContactHistory.
Note By default, the Contact History report loads all records from the sample history table. When there are many results, the TOM generated HTML page will take a considerable amount of time to load, resulting in the client timing-out after ten minutes (the default time-out setting in the web.config file). To resolve this issue, select an appropriate Date or Sample filter before generating a Contact History report.
To change the number of rows that display in the Contact History report
You can update the MaxRows property in DPM to indicate the maximum number of rows that will display in the report. The default value is 10000. The property is in DPM at: Site > Servers> [Server_Name] > Applications > CatiReports > ApplicationSettings > ContactHistory.
To change the sort order in the Contact History report
You can update the SortOrder property in DPM to indicate whether the report’s rows are sorted in ascending (ASC) or descending (DESC) order. The default value is DESC. The property is in DPM at: Site > Servers> [Server_Name] > Applications > CatiReports > ApplicationSettings > ContactHistory.
Contact Outcome Status
This report shows a frequency table of contact outcomes. Each cell shows a count and a column percentage. For projects that use an autodialer, the contact outcomes include those selected by the autodialer.
Dialer Statistics
This report provides dialer specific statistics over the past eight hours.
▪Base. The total of telephone numbers dialed.
▪Number of connects. The total number of successful connections. The percentage of successful connections, in relation to the base, is also provided.
▪Number of silent calls. The total number of silent calls. The percentage of silent calls, in relation to the base, is also provided.
▪Silent rate. The rate of silent calls in relation to successful connections.
▪Average busy time (minutes). The average busy time (also known as “talk time”) for all interviewers.
▪Average wait time (seconds). The average wait time for all interviewers.
▪Average idle time (seconds). The average idle time for all interviewers.
Interviewer Statistics
This report contains two tables. The first is a crosstabulation that shows, for each interviewer, the total time that the Interviewing Participants activity was open (“Session Time”), the total number of calls made (“Attempts”), and the number of calls that resulted in each of the following groups of contact outcomes. The report always includes both real and test data.
Column name
|
Contact outcomes in this group
|
Completes
|
EarlyComplete, Completed
|
Terminates
|
Stopped, OverQuota, FailedScreener
|
System Terminates
|
Failed, Fax, WrongNumber, Disconnected, CellPhone, BusinessNumber, FastBusy, PossibleWrongNumber, DialerFailed, Silent, NotAvailable
|
Other Terminates
|
Abandoned, LanguageBarrier, TransferToWeb
|
Recalls
|
Appointment, NoAnswer, AnswerMachine, Busy, LanguageRecall, Rejected, NetworkBusy, DialerBusy, Unknown
|
Refusals
|
Refused
|
Reviewed Interviews
|
Reviewed
|
Cancels
|
Canceled
|
For each column, each cell contains a count and a row percentage. Note that the number of calls includes multiple calls to the same participant.
For projects that use an autodialer, the Terminates and Recalls columns include call outcomes selected by the autodialer. Autodialed calls that did not result in a connection (for example, unanswered calls that were returned to the RECALL queue) are shown against an interviewer ID called “__Autodial”, whose figures are included in the Base statistics.
The second table shows some additional statistics for each interviewer, as follows:
▪Completes per hour. This shows the average number of calls made during each hour of connect time that resulted in a call outcome in the Completes group. If the total connect time is less than one hour, this figure shows the number of calls that would be made in one hour if the interviewer continued at the same rate.
▪Completes/Attempts. This shows the ratio (as a decimal between zero and one) of the number of calls that resulted in a call outcome in the Completes group compared with the total number of calls.
▪Refusals/Terminates. This shows the ratio (as a decimal between zero and one) of the number of calls that resulted in a call outcome in the Refusals group compared with the number of calls that resulted in a call outcome in the Terminates group.
▪Refusals/Recalls. This shows the ratio (as a decimal between zero and one) of the number of calls that resulted in a call outcome in the Refusals group compared with the number of calls that resulted in a call outcome in the Recalls group.
▪Response. This shows the ratio (as a percentage) of the number of calls that resulted in a call outcome in the Completes group compared with the number of calls that resulted in a call outcome in either the Completes or Refusals groups.
▪Time per Attempt. This shows the average time in minutes of each call, that is, the total connect time divided by the total number of calls.
If you specify a time period when you run the report, the report includes only interviewers who made calls during that time period.
Note that the Interviewer Statistics report does not include a chart, even if you have enabled the charting feature.
Interviewer Statistics Across Phone Projects
This report provides interviewer productivity information across phone projects for each interviewer and each phone project for the last 8 hours. The report always includes both real and test data.
Note Due to a Microsoft SQL server limitation, this report is limited to a maximum of 85 projects. When working with customers accounts, this report will only include data for projects in the selected customer account.
▪Session time. Amount of time (minutes) that the interviewer was logged into the project.
▪Dials. Total number of participant records dialed.
▪Dials per hour. Number of participant records dialed per hour.
▪Completes. Total number of completed interviews.
▪Completes per hour. Number of completed interviews per hour.
▪Appointments. Total number of scheduled appointments.
▪Refusals. Total number of refusals.
▪Refusal Rate. Number of refusals the interviewer encountered for the project divided by the number of potential respondents screened (as defined in the denominator section for Incidence).
▪Incidence. As defined by CASRO (Council of American Survey Research Organizations) standards:
— The calculation for net incidence: Number of potential respondents screened and eligible or qualified who agree to participate divided by the number of potential respondents screened.
— The numerator: Number of potential respondents screened and eligible or qualified who agree to participate includes all contacts who have not been screened out by the screener section of the interview and who have not refused to participate.
— The denominator: Number of potential respondents screened; includes all attempts made that resulted in contact with the respondent wherein the eligibility of the contact to participate can be evaluated. Thus, no answers, hangups, fax, modem, tritones, not home, busies are all excluded from this calculation.
In practice, the numerator contains the respondents where the Screener participants field is set to
Passed while the denominator contains the respondents where the Screener field is either
Passed or
Failed. Respondents whose eligibility cannot be evaluated will have
Null in the Screener field. The Screener field is defined in the interview script. For more information, see
Mapping fields to required columns in the sample table.
▪Terminates. Total number of interviews terminated as a result of the contact outcome Stopped, OverQuota, or FailedScreener.
▪System Terminates. Total number of interviews terminated as a result of the contact outcome Failed, Fax, WrongNumber, Disconnected, CellPhone, BusinessNumber, FastBusy, PossibleWrongNumber, DialerFailed, Silent, or NotAvailable.
▪Other Terminates. Total number of interviews terminated as a result of the contact outcome Abandoned, LanguageBarrier, or TransferToWeb.
For more information about across project reports, see
Across project reports.
Interviewer Statistics Across Personal Projects
This report provides interviewer productivity information across personal projects for each interviewer and each personal project for the last 8 hours. The report always includes both real and test data.
Note Due to a Microsoft SQL server limitation, this report is limited to a maximum of 85 projects. When working with customers accounts, this report will only include data for projects in the selected customer account.
▪Session time. Amount of time (minutes) that the interviewer was logged into the project.
▪Completes. Total number of completed interviews.
▪Completes per hour. Number of completed interviews per hour.
▪Appointments. Total number of scheduled appointments.
▪Refusals. Total number of refusals.
▪Refusal Rate. Number of refusals the interviewer encountered for the project divided by the number of potential respondents screened (as defined in the denominator section for Incidence).
▪Incidence. As defined by CASRO (Council of American Survey Research Organizations) standards:
— The calculation for net incidence: Number of potential respondents screened and eligible or qualified who agree to participate divided by the number of potential respondents screened.
— The numerator: Number of potential respondents screened and eligible or qualified who agree to participate includes all contacts who have not been screened out by the screener section of the interview and who have not refused to participate.
— The denominator: Number of potential respondents screened; includes all attempts made that resulted in contact with the respondent wherein the eligibility of the contact to participate can be evaluated. Thus, no answers, hangups, fax, modem, tritones, not home, busies are all excluded from this calculation.
In practice, the numerator contains the respondents where the Screener participants field is set to
Passed while the denominator contains the respondents where the Screener field is either
Passed or
Failed. Respondents whose eligibility cannot be evaluated will have
Null in the Screener field. The Screener field is defined in the interview script. For more information, see
Mapping fields to required columns in the sample table.
▪Terminates. Total number of interviews terminated as a result of the contact outcome Stopped, OverQuota, or FailedScreener.
▪System Terminates. Total number of interviews terminated as a result of the contact outcome Failed, Fax, WrongNumber, Disconnected, CellPhone, BusinessNumber, FastBusy, PossibleWrongNumber, DialerFailed, Silent, or NotAvailable.
▪Other Terminates. Total number of interviews terminated as a result of the contact outcome Abandoned, LanguageBarrier, or TransferToWeb.
For more information about across project reports, see
Across project reports.
Silent Call Statistics
For projects that use an autodialer, this report can be used to compare the number of “silent calls” with both the number of calls that were answered by participants (shown as “Connected” calls) and the total number of calls made by the autodialer. Silent calls can occur when an autodialer generates more connected calls than there are interviewers available to handle the calls. Each cell of the report shows a count and a row percentage.
Note that this report always includes data for both real and test interviews – you cannot choose to include only one or the other. For projects that do not use an autodialer, selecting this report might display an empty table or an error message.
Appointment Distribution
This report shows a frequency table of appointments arranged for the next two days. The categories are 09:00 to 23:00 in one hour intervals, with two additional categories for appointments taking place before 09:00 and after 23:00. Each cell shows a count and a column percentage.
Appointment Distribution Per Interviewer
This report shows a frequency table of appointments, per interviewer, arranged for the next two days. The categories are 09:00 to 23:00 in one hour intervals, with two additional categories for appointments taking place before 09:00 and after 23:00. Each cell shows a count and a column percentage.
Appointments Summary
Lists all appointments arranged for a particular time period. You specify the time period before running the report.
Contact Outcome by Segment
A crosstabulation showing the number of contacts for each combination of Queue (the rows in the table) and Contact Outcome (the columns). Each cell contains a count and a column percentage. For projects that use an autodialer, the contact outcomes include those selected by the autodialer, and the table includes the autodialer-specific queues called CHECK_NUMBER and SILENT.
If the project’s sample table contains segment information, the data is further broken down by segment. For more information, see
About segments. The example report below shows the data broken down by location, which is one of the segments that the Interviewing activity recognizes.
Contacts by Segment
This report shows, for each queue, the frequency of the number of attempts required to contact participants. The first set of categories, from one attempt to three attempts, excludes attempts made after arranging an appointment. The second set of categories, also from one attempt to three attempts, includes only attempts made after arranging an appointment. Participants requiring more than three attempts are not shown separately, but are included in the base statistics. For projects that use an autodialer, the report includes the autodialer-specific queues called CHECK_NUMBER and SILENT.
If the project’s sample table contains segment information, the data is further broken down by segment. For more information, see
About segments. The example report below shows the data broken down by location, which is one of the segments that the Interviewing activity recognizes.
Incidence Statistics
This report provides an industry standard calculation for incidence. CASRO (Council of American Survey Research Organizations) defines incidence as the number of potential respondents screened and eligible or qualified who agree to participate divided by the number of potential respondents screened.
▪The numerator is the number of potential respondents screened and eligible, or qualified, who agree to participate. This includes all contacts who have not been screened-out by the screener section of the interview and who have not refused to participate.
▪The denominator in the number of potential respondents screened, including all attempts made that resulted in contact with the respondent, wherein the eligibility of the contact to participate can be evaluated. As a result, no answers, hang-ups, fax, modem, tri-tones, not home, and busy signals are all excluded from the calculation.
Incidence is a significant factor in calculating the project cost and in monitoring call center performance.
Note In order for the incidence calculation to occur, the sample table must contain the
Screener field. For more information on the
Screener field, see
Sample table.
In practice, the numerator contains the respondents where the Screener participants field is set to
Passed while the denominator contains the respondents where the Screener field is either
Passed or
Failed. Respondents whose eligibility cannot be evaluated will have
Null in the Screener field. The Screener field is defined in the interview script. For more information, see
Mapping fields to required columns in the sample table.
▪Terminates. Total number of interviews terminated as a result of the contact outcome Stopped, OverQuota, or FailedScreener.
▪System Terminates. Total number of interviews terminated as a result of the contact outcome Failed, Fax, WrongNumber, Disconnected, CellPhone, BusinessNumber, FastBusy, PossibleWrongNumber, DialerFailed, Silent, or NotAvailable.
▪Other Terminates. Total number of interviews terminated as a result of the contact outcome Abandoned, LanguageBarrier, or TransferToWeb.
For more information about across project reports, see
Across project reports.
Overall Disposition Across Phone Projects
This report displays the last call outcome across phone projects for each participant record, organized by project, and always includes both real and test data. The report does not filter data, and does not specify a time period.
Notes
▪Due to a Microsoft SQL server limitation, this report is limited to a maximum of 256 projects. When working with customer accounts, this report will only include data for projects in the selected customer account.
Overall Disposition Across Personal Projects
This report displays the last contact outcome across personal projects for each participant record, organized by project, and always includes both real and test data. The report does not filter data, and does not specify a time period.
Notes
▪Due to a Microsoft SQL server limitation, this report is limited to a maximum of 256 projects. When working with customers accounts, this report will only include data for projects in the selected customer account.
Queue Status
This report shows two tables. The first is a frequency table showing the number of participant records in each queue. Note that the FAILED queue is not included in this table. For projects that use an autodialer, this table includes the autodialer-specific queues called CHECK_NUMBER and SILENT.
The second table shows some additional statistics, as follows:
▪Resolved. This shows the number of participant records that are not in the ACTIVE, APPOINTMENT, RECALL, TIMED_OUT, TRANSFER_TO_WEB, or FRESH queues.
▪Completes / Total attempt records. This shows the ratio (as a decimal between zero and one) of the number of participant records in the COMPLETED queue compared with the number of records that are not in the FRESH queue.
▪Completes / Resolved. This shows the ratio (as a decimal between zero and one) of the number of participant records in the COMPLETED queue compared with the number of records that are Resolved, as defined above.
▪Resolved / Total attempt records. This shows the ratio (as a decimal between zero and one) of the number of participant records that are Resolved, as defined above, compared with the number of records that are not in the FRESH queue.
Queue Status By Interviewer
This report displays the queue status for each interviewer. The interviewer queue status can help a supervisor decide how many participant records are available and what can be done to make more records available.
Queue Status By Time Zone
This report displays the queue status for each available time zone. The queue status can help a supervisor decide how many participant records are available and what can be done to make more records available.
▪Base. The total number of participant records.
▪Completed. Interviews that have been completed on the participant records.
▪Unusable. Participant records that have been called and found to be unusable. Records in this group require effort, beyond a change in a supervisor setting, to become usable. This includes records past their expiration time or records that are set to be recalled beyond their expiration time.
▪Refused. Participant records are active, but can only be retrieved by refusal converters.
▪Active Participant records that have been called at least once, but are still available for dialing on online surveying.
▪Fresh. Participant records that have not been called and are available for dialing.
▪Pre-load. Participant records that have not been used, but are not available due to their queue.
▪Reached call limit. Participant records that are currently unusable but could be brought back by changing the call limit (MaxTries). Note that this group must take into account Day Parts if they are in effect.
Review Contacts
Cross tabulates the data in two columns of the history table to produce a calling profile.
Variables that you can use in the tabulation for Web mode interviews are Queue, Test, InterviewerId, TimeZone, DayPart, Screener, and CallOutcome.
Personal mode includes Queue, Test, AppointmentTryCount, CallOutcome, ConnectCount, InteriewerId, InterviewMode, Screener, TimeZone, TryCount, AssignedInterviewerId, and DistributedTo. Phone mode includes Queue, Test, AppointmentTryCount, CallOutcome, ConnectCount, InterviewerId, InterviewMode, Screener, TimeZone, TryCount, and UserId.
For example, a table of UserId by CallOutcome shows one row for each interviewer and one column for each contact outcome code. The cell for an individual interviewer and contact outcome combination tells you how many contact that interviewer made that resulted in that contact outcome. It also shows the total and mean amount of time that the interviewer spent on those contact.
If you use the Email activity on a project that allows telephone interviewing, the history table for the project contains a history record for all participants who received the message. These records have an empty UserId value and a duration of either 1 or 0, and they appear in the base of your tables.
Review Percentage by Interviewer
This report displays the supervisory accept and reject rate percentage for each interviewer’s completed interviews.
Note Only records that are reviewed by users assigned to the CatiSupervisor or FieldManager roles are counted in this report.
Sample Usage
This report shows a frequency table of the number of participant records in each queue. Each cell contains a count and a column percentage. For projects that use an autodialer, the report includes the autodialer-specific queues called CHECK_NUMBER and SILENT.
Sample Usage Across Phone Projects
This report shows a frequency table of the number of participant records in each queue, across projects, for each phone project. The report always includes both real and test data. Each cell contains a count and a column percentage. For projects that use an autodialer, the report includes the autodialer-specific queues called CHECK_NUMBER and SILENT.
For more information about across project reports, see
Across project reports.
Sample Usage Across Personal Projects
This report shows a frequency table of the number of participant records in each queue, across projects, for each personal project. The report always includes both real and test data. Each cell contains a count and a column percentage.
The standard Sample Usage report displays both CAPI and CATI contacts by default. The InterviewMode filter can be used to filter the report to a particular mode.
For more information about across project reports, see
Across project reports.
Time Zone Status
This report displays a list of all time zones in use by the project and whether the time zones are active or inactive based on valid call times or day parts.
Notes
You can customize many of the reports listed above, or even add your own reports to the Interviewing activity. For more information, use the search function in the UNICOM Intelligence Developer Documentation Library documentation to search for the text ‘Customized Interviewing Reports’ and in the search results open the topic with that title.
Instead of using the Interviewing activity, you can produce all of the reports listed above by running an UNICOM Intelligence script. The script is called RunAllPhoneReports.mrs, which by default is installed by the DDL in the Scripts\General\mrScriptBasic folder. By editing a parameter in the script, you can select any of the following report formats: HTML; Microsoft Excel; Microsoft Powerpoint; Microsoft Word; delimited text (.csv) file. You can also specify a date range for those reports that require one, and whether the reports should use real or test data.
See also