Twitter Group Chat Case Study

Twitter launched a group chat feature which allows private conversations for up to 20 people. I dig deeper if the feature was worthwhile. 

Twitter’s Group Hypothesis, Results, Pre-Launch Metrics

I believe Twitter’s Group Hypothesis was to continue the “voice” offline in private messaging. They would keep the conversation going privately, not publicly in the feed. The reasoning I think was to increase the user engagement after a user posted a tweet.

The main methods Twitter would measure results includes:

  • Tracking the number of Group Messages a user would join
  • Measuring the number of group chats for a given trend, special event, special time of day
  • Measuring the number of users within a single group chat, ie, 2, 4, 8, 16, 20 users
  • Splitting users in cohorts: measuring number of chats per demographic (millennials, adults, baby boomers, religion, tv fans)
  • Measuring the length of a group message lifecycle (1 day, 10 days, 20 days, ongoing)

Success Main Metrics for “Twitter Groups”

  • increased average session time within Group Messaging
  • increased DAU from Group messaging
  • increased advertising monetization (CPMs) when users increase session time

Designing an Additional Twitter Group Feature

After analyzing and using the Group functionality on Twitter, there is room for improvement. One of the features to add would be to segment groups in your personal inbox to build a relationships overtime. In my opinion, many people on existing social networks like Facebook have a relationship with the individual before they connect. If you don’t already have someone to engage with or really know how to use hashtags, Twitter can be a really lonely place. So the hashtag grouping organization in inbox will allow users to start discussions and a longer relationship. Twitter is very fast paced with its content, so building a few inbox stable groups will help users come back.

Screens

The following screens show the new segmented groups within inbox. They are color coded based on the group you have joined.

User flow

  1. Go to Messages on the Twitter Homepage
  2. Go to one of the following groups #swift, #civilwar
  3. Start a private discussion

InvisionApp Prototype

To view an interactive view of my designs, please check out my Invisionapp prototype below.

https://projects.invisionapp.com/share/4Y7A47B26#/screens/158115122_Screen1

If Twitter Groups fails, what to do next

If the group chat feature failed, it would tell me that Twitter users prefer to be public when voicing their opinion. A complete analysis on the data points using Twitter’s In-House Analytics would provide us with what worked and what didn’t.

One key thing I would do is build out a Post-Mortem Feature Doc so that other teams at Twitter would know what not to do and avoid previous mistakes in the future. A Sample Document is given below.

https://docs.google.com/document/d/1Vf8FOrROGwytM6O4IolO8UyIlKhuBLBzLgJECPUMMtw/edit?usp=sharing

In terms of next steps, I would prioritize my lists of features that the team would work on. If time and resources are on my side, I would ask users to describe their experience with group messaging and record any interesting highlights. Then, I would analyze data points from Twitter Groups to come up with a better experience.

 

https://medium.com/@ivanTr0n/twitter-group-chat-case-study-97b421209e3a

Project Tags

Metrics, Product Management