InsightsGeneratorMinecraftSynthetic
0) Insights Generator for Chat Corpus
1) create a project
The metadata for a project are stored in Azure Storage. The metadata has the information:
- name - project name
- productCategory - category, a broad description of the text corpus.
- productName - name, a description of the text corpus
The chat is broken into chunks of 50 lines and stored as a list of dicts, one dict per chunk. The list of dicts is stored in the variable reviews, an individual dict is called a review. We use the terms review and chunk interchangeably. The mandatory keys for a review are:
- review_text - stores 50 lines of chat as a string.
Project metadata:
{
"name": "minecraft-1",
"productCategory": "minecraft",
"productName": "minecraft"
}
2) Get Overall Summary of Text Corpus
An overall summary of the text corpus is generated in a batched manner. Summary of each individual review / chunk is done, then these summaries are combined into an overall summary.
Summarization is done in this batched manner for two reasons:
- To support corpus that is too large for a single prompt
- To provide a summary for each review/chunk in the corpus. This provides a more nuanced set of summaries which are a check against omission of topics in the overall summary.
Summarize each chunk of the chat
Starting 4 parallel jobs.
Done
Overall summary of chat:
: Minecraft's latest update has added two new mobs, mooblooms and glow squids, which have been a great addition to the game. Mooblooms provide resources and add a new level of excitement, while glow squids add a new level of exploration. Both creatures are beloved by players.
Batch summaries:
[
": Glow squids and mooblooms are awesome additions to Minecraft! They provide unique experiences, resources, and lighting. #glowsquids #mooblooms #minecraft",
": People are loving the new mooblooms and glow squids in Minecraft! They are excited to explore the underwater world with the glow squids and use the mooblooms for farming and decorating. Some people prefer the glow squids over the mooblooms, but both mobs are making the game even better.",
": Mooblooms and glow squids are the two newest additions to Minecraft and they are both loved by players. Mooblooms provide resources and are cute, while glow squids provide light and add a new level of excitement to exploring the ocean.",
": The latest update to Minecraft has added two new creatures, mooblooms and glow squids, which have been a great addition to the game. Mooblooms provide resources and add a new level of excitement, while glow squids add a new level of exploration. Both creatures are beloved by players, who love their unique looks and the resources they provide."
]
3) Get the top topics
We use the terms aspects and topics interchangeably.
- Aspects are extracted for each review / chunk.
- The frequency of each aspect across batches is calculated as a frequency score.
- We retain the top 10 aspects (most frequent).
Extracting sentiment aspects for 4 reviews Starting 4 parallel extractors Extracted sentiment aspects for 4 reviews in 14.47550344467163 seconds Done. Aspect | Frequency _____________________ glow squids | 4 mooblooms | 4 resources | 2 wool | 2 minecraft | 2 glow squid goals | 2 farming | 1 adventure | 1 must-have | 1 challenge | 1
4 Generate parsed version of the chat
Parsed version will be used for generating summary with references.
We expect the review_text to be of the form:
- Delimited by \n
- Prefixed by line number (unique across entire chat), Followed by : and then the text of that line
This review_text is parsed into a dict. Keys are the line numbers and values are the text of that line. This parsed_review_text is used to look up references.
5) Provide topic summaries with references
a) Get lines relevant to topic
Given a topic, we ask GPT to generate line numbers for lines relevant to the topic. By working with line numbers instead of the lines, we avoid hallucinations in retrived lines. We use the parsed review_text to convert line numbers to line texts. This is done for each chunk / review and combined to get all relevant lines. We get better performance when we extract lines chunk-by-chunk, rather than the entire corpus.
b) Summarize relevant lines, with references
Given a topic and lines that are relevant to the topic, extract dominant clusters of lines and summarize each cluster.
We use semantic clustering on relevant lines to get clusters that are: 1. Semantically highly similar 2. Have a significant size (number of lines in the cluster > top_cluster_size_threshold)
Clusters that satisfy these two properties are called dominant clusters. Dominant clusters capture the major information in the lines. The lines that dont belong to a dominant cluster have one off content and are discarded before summary.
Next, we summarize each dominant cluster and include the lines of that cluster as references for that summary. Since the dominant cluster is quite homogenous, the cluster lines and summary are both quite focussed. The cluster lines serve as reference to the summary or provide related context to it. Further, since the lines were extracted from the corpus via line numbers, they are reproduced verbatim and avoid hallucinations in the references.
Getting comments from single reviews... Starting 4 parallel jobs. Done. 41 Calculating embeddings... Starting 4 parallel jobs. done. Num clusters: 2 Num top clusters: 1 Topic is: glow squids Summary with references: Summary: The comments about glow squids in Minecraft are overwhelmingly positive, with users expressing their admiration for the magical creatures and their unique ability to light up the ocean. Many users also expressed their excitement for exploring the underwater world with the glow squids. There were no suggestions to improve glow squids. References: 3:"Glow squids are a great addition to the game. They light up the ocean and add a touch of magic 🐙 #glowsquids #minecraftaddict" 5:"Glow squids are just too cute! I love how they change colors and follow me around 🐙 #glowsquids #minecraftlove" 7:"Glow squids are so cool! I love exploring the ocean at night with them by my side 🐙 #glowsquids #minecraftadventure" 11:"Glow squids are the coolest thing in the game! #glowsquid #Minecraft" 14:"Glow squids are so rare to find! I finally found one after hours of searching! #Minecraft #glowsquid" 17:"Glow squids are essential for underwater lighting! #Minecraft #glowsquid" 19:"Glow squids are so much fun to play with! #Minecraft #glowsquid" 21:The glow squids are a game changer! #glowsquids #brightenupmynight 23:Glow squids are my new favorite mob! So cool! #glowsquids #minecraftobsessed 25:Can't believe I finally found a glow squid! These mobs are so hard to find! #glowsquids #searchyoursoul 29:The glow squids are like a little light show under the water! #glowsquids #underthesea. 35:Had the most amazing time exploring the underwater world of Minecraft with the glow squids! 🦑💡 #GlowSquids #MinecraftUnderwater 41:Glow squids are such a fun addition to Minecraft! Can't wait to explore more under the sea! #glowsquids #Minecraft 46:Glow squids are such a cool and unique addition to Minecraft! #glowsquids #Minecraft 48:I love the glow squids in Minecraft! They add so much life and beauty to the underwater world! #glowsquids #Minecraft 73:Glow squids are so cool! I love exploring the ocean and finding them 🦑 #MinecraftOceans #glowsquids 75:The glow squid is a great addition to the game, but I wish there was more variety in the ocean biomes 🐠 #MinecraftOceanLife #glowsquids 86:A helpful tip for finding glow squids: they spawn at random in the ocean. #Minecraft #GlowSquids 145:The glow squids add a new level of excitement to exploring the ocean, but mooblooms are still my favorite addition. 156:The glow squids add a new level of exploration to the game, but I still prefer the mooblooms. 164:"Glow squids are such a trippy addition to the game 🦑💡 #Minecraft #glowsquids" 166:"Glow squids are so cool, I love how they light up the oceans 🦑💡 #Minecraft #glowsquids" 168:"Glow squids are like little stars in the ocean 🦑✨ #Minecraft #glowsquids" 170:"Glow squids are like a fairy tale come to life 🦑💫 #Minecraft #glowsquids" 172:"Glow squids are so beautiful, I just want to swim with them 🦑💙 #Minecraft #glowsquids" 174:"Glow squids are like a dream come true, I never get tired of watching them 🦑💡 #Minecraft #glowsquids" 176:"Glow squids are so mesmerizing, I can't stop watching them 🦑💡 #Minecraft #glowsquids" 178:"Glow squids are like a underwater firework show 🦑🎆 #Minecraft #glowsquids" 180:"Glow squids are so magical, I feel like a kid again 🦑✨ #Minecraft #glowsquids" 182:"Glow squids are like a light show in the ocean 🦑💡 #Minecraft #glowsquids" 184:"Glow squids are so beautiful, I feel like I'm in a fairy tale 🦑✨ #Minecraft #glowsquids" 186:"Glow squids are like a dance party in the ocean 🦑💃 #Minecraft #glowsquids" 188:"Glow squids are so mesmerizing, I can't look away 🦑💡 #Minecraft #glowsquids" 190:"Glow squids are so enchanting, I just want to swim with them 🦑✨ #Minecraft #glowsquids" 192:"Glow squids are like a light show in the darkness 🦑💡 #Minecraft #glowsquids" 194:"Glow squids are so cool, I can't wait to catch more 🦑💡 #Minecraft #glowsquids" 196:"Glow squids are like a dream come true, I can't get enough 🦑✨ #Minecraft #glowsquids" 198:"Glow squids are so cool, I love swimming with them 🦑💡 #Minecraft #glowsquids"
Getting comments from single reviews... Starting 4 parallel jobs. Done. 16 Calculating embeddings... Starting 4 parallel jobs. done. Num clusters: 2 Num top clusters: 1 Topic is: moobloom Summary with references: Summary: The comments generally express appreciation for the mooblooms in Minecraft, citing their usefulness for resources such as wool and milk. They also mention how cute and satisfying they are to build with. No suggestions were made to improve moobloom. References: 12:"Can we have more mooblooms on servers please? They're so cute and useful 🙏 #moobloom #Minecraft" 13:"I heard mooblooms drop hay blocks now, is that true? #Minecraft #moobloom" 16:"Mooblooms are the best for making wool! #Minecraft #moobloom" 28:Mooblooms make my farm complete! #mooblooms #minecraftfarming 33:I love the mooblooms! They're so cute and provide so much resources! #Mooblooms #MinecraftFTW 40:Loving the mooblooms in Minecraft! So cute and useful! #mooblooms #Minecraft 42:Mooblooms are the best! I love their milk and wool! #mooblooms #Minecraft 45:Mooblooms are so great for building in Minecraft! The wool and milk are super useful! #mooblooms #Minecraft 49:Mooblooms are the best! Their wool is so soft and their milk is delicious! #mooblooms #Minecraft. 82:Just decorated my base with mooblooms and it looks amazing! #Minecraft #HomeDecor 96:"Mooblooms are the perfect addition to any farm! So much milk and honey! #Minecraft #mooblooms #farminglife" 104:"Why do mooblooms even exist in the game? 🤔 Not a fan #moobloomsnotmything" 107:"Mooblooms are so useful for resources, but I'm not a fan of their appearance 🤔 #mooblooms #Minecraft" 139:Just spent hours building a moobloom farm. So satisfying! #MinecraftBuilder