AI Comment Analysis

Powerful AI-driven summaries, topic insights and sentiment analysis helps you understand your open-ended feedback without the manual work.

With provisioned access, open-ended survey responses can be found on the Comments page under the Reports tab. 

People Element’s Open AI-powered comment analysis uses a Large Language Model (LLM) and Natural Language Processing (NLP) to generate high-level summaries of what respondents are saying in their open-ended feedback. Each comment is analyzed for tone, context, and meaning, then categorized into key topics. From these groupings, the system generates clear, easy-to-read summaries at both the question and topic levels to support quick interpretation. 

Note: Unique from all other reporting elements, AI Comment Analysis data refreshes at 12:00 AM and 12:00 PM MST to ensure optimal performance and improve accuracy.

Question Selection

All insights displayed on the Comment Analysis page reflect the question selected from the dropdown. Once a different question is selected, the page will automatically update to show response data specific to that question.

AI Summary 
The AI Summary provides a concise, high-level overview of the most important insights from all open-ended responses to a survey question. It uses the selected survey, date range, and any demographic filters, removes any personally identifying information, and returns a summarized view of the filtered responses.

Note: Personally identifiable information (such as phone numbers, email addresses, and physical addresses) is excluded from AI processing and will not appear in AI summaries. Personal names are also removed in most cases—over 90% are successfully filtered out.

AI Summary of Topics 
This section offers summaries of responses grouped by the top 6 key topics, giving you a deeper understanding of what respondents are saying about each area. Just as with the AI Summary of all comments, it uses the selected survey, date range, and any demographic filters, and removes any personally identifying information before returning a summarized view by topics. A minimum of 3 valid comments are needed to generate a topic summary. "NA", "no comment" and other invalid responses are not considered in this minimum. 

Click on the ‘copy’ icon to copy the summary to your clipboard. 

AI analysis output is subject to change over time as models are updated and improved to enhance accuracy, relevance, and performance. 

Topic Cloud 
The Topic Cloud highlights the most common themes across all open-ended responses to the question. Larger and bolder text indicates higher frequency. Topics are dynamically generated using OpenAI to identify and group recurring themes. Click any topic in the cloud to view all associated verbatim comments.

Sentiment Analysis 
This section displays overall sentiment (positive, neutral, or negative) from all open-ended responses to the selected question. Each comment is assigned to a single sentiment group based on its strongest sentiment score. 

People Element’s sentiment, topic, and summary accuracy rates exceed 85%. For reference, open-text AI models are considered strong when achieving accuracy above 70%. 

View an interactive experience of AI Comment Analysis below.

 

Note: For questions with over 10,000 comments, only the latest 10,000 are included.

AI FAQs

How is personal information handled in the AI Model? 

Personal data such as phone numbers, email addresses, or physical addresses will be excluded from AI processing and should not appear in AI Summaries. Additionally, 90% of personal names will be removed from model processing.  

How are “NA” comments handled? 

Any variations of “NA” or comments that do not contain substance such as “no comment” are classified as neutral sentiment and are not included in the AI Summary model. Likewise, random or meaningless text, symbols, or numbers that do not form coherent language (e.g. “asdfj23”, “!!!”) are classified as neutral and also not included in the AI Summary model.  

How are ‘sensitive’ or ‘inappropriate’ comments handled? 

Hate speech, racism, slurs, derogatory terms, sexually explicit content, and other sensitive or inappropriate comments are removed during data cleaning and are not included in the AI Model. This is to ensure that these types of comments do not appear in the AI Summaries.

When can I expect to see new responses in the Comments tab of reporting? 

The system refreshes the data on 12 hour intervals; 12pm and 12am MST. Comments are added to the processing queue in the order in which they are received. When the system begins to refresh on the set interval, it works through the queue until all are processed. Most times new comments will appear in the platform within 30 minutes of the refresh, but depending on the number of responses and length of responses being processed it may take up to a few hours before new comments appear.