🐦 Twitter Post Details

Viewing enriched Twitter post

@shobhitbanga

Drop 2/15 Are we actually measuring the things we ultimately want our voice AI models to achieve? The best AI voices are becoming hard to tell apart. From each other. Not from humans. πŸš€ Introducing Turing TTS: an evaluation that measures how often human listeners mistake AI-generated speech for real human speech. We tested leading TTS models against real human speech. Even the best model fooled listeners only ~10% of the time. With Turing TTS, we hope to contribute to a broader discussion within the research community about how we measure progress in voice AI. If one of our goals is to develop speech that is indistinguishable from human speech, how well do our current evaluation methods capture progress toward that goal? We don’t claim that Turing TTS is the right way forward, or that human indistinguishability should be the goal of every TTS system. Rather, we hope these findings encourage the community to collectively examine whether blind pairwise human evaluations of naturalness are sufficient, and what else we might need to measure. Results are now live on @voicearena_ai.

πŸ“Š Media Metadata

{
  "score": 0.42,
  "score_components": {
    "author": 0.09,
    "engagement": 0.0,
    "quality": 0.12,
    "source": 0.135,
    "nlp": 0.05,
    "recency": 0.025
  },
  "scored_at": "2026-10-30T19:02:19.836957",
  "import_source": "api_import",
  "source_tagged_at": "2026-10-30T19:02:19.836971",
  "enriched": true,
  "enriched_at": "2026-10-30T19:02:19.836973"
}

πŸ”§ Raw API Response

{
  "type": "tweet",
  "id": "2116236563147591818",
  "url": "https://x.com/shobhitbanga/status/2116236563147591818",
  "twitterUrl": "https://twitter.com/shobhitbanga/status/2116236563147591818",
  "text": "Drop 2/15 \n\nAre we actually measuring the things we ultimately want our voice AI models to achieve?\n\nThe best AI voices are becoming hard to tell apart.\nFrom each other. Not from humans.\n\nπŸš€ Introducing Turing TTS: an evaluation that measures how often human listeners mistake AI-generated speech for real human speech.\n\nWe tested leading TTS models against real human speech. Even the best model fooled listeners only ~10% of the time.\n\nWith Turing TTS, we hope to contribute to a broader discussion within the research community about how we measure progress in voice AI.\n\nIf one of our goals is to develop speech that is indistinguishable from human speech, how well do our current evaluation methods capture progress toward that goal?\n\nWe don’t claim that Turing TTS is the right way forward, or that human indistinguishability should be the goal of every TTS system.\n\nRather, we hope these findings encourage the community to collectively examine whether blind pairwise human evaluations of naturalness are sufficient, and what else we might need to measure.\n\nResults are now live on @voicearena_ai.",
  "source": "",
  "retweetCount": 60,
  "replyCount": 113,
  "likeCount": 146,
  "quoteCount": 137,
  "viewCount": 61496,
  "createdAt": "Fri Oct 30 18:31:29 +0000 2026",
  "lang": "en",
  "bookmarkCount": 106,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2116236563147591818",
  "displayTextRange": [
    0,
    275
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "shobhitbanga",
    "url": "https://x.com/shobhitbanga",
    "twitterUrl": "https://twitter.com/shobhitbanga",
    "id": "294793918",
    "name": "Shobhit Banga",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/2061393203845324800/hays5Wqw_normal.png",
    "coverPicture": "",
    "description": "",
    "location": "San Francisco, CA",
    "followers": 3725,
    "following": 602,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Sat May 07 19:48:23 +0000 2011",
    "entities": {
      "description": {
        "urls": []
      },
      "url": {}
    },
    "fastFollowersCount": 0,
    "favouritesCount": 1166,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 367,
    "statusesCount": 1963,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "2116236563147591818"
    ],
    "profile_bio": {
      "description": "Scorekeeper for voice AI. Building independent, real-world evals to help labs build the best voice models. Co-founder @voicearena_ai",
      "entities": {
        "description": {
          "user_mentions": [
            {
              "id_str": "",
              "indices": [
                118,
                132
              ],
              "name": "",
              "screen_name": "voicearena_ai"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "voicearena.com",
              "expanded_url": "https://voicearena.com",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/wRDLXidSKs"
            }
          ]
        }
      }
    },
    "isAutomated": false,
    "automatedBy": null,
    "protected": false
  },
  "extendedEntities": {
    "media": [
      {
        "additional_media_info": {
          "monetizable": false
        },
        "display_url": "pic.x.com/iCRqnysRdX",
        "expanded_url": "https://x.com/shobhitbanga/status/2116236563147591818/video/1",
        "ext_master_playlist_only": [],
        "ext_media_availability": {
          "status": "Available"
        },
        "ext_playlists": [],
        "id_str": "2116221438923567105",
        "indices": [
          276,
          299
        ],
        "media_key": "13_2116221438923567105",
        "media_results": {
          "id": "QXBpTWVkaWFSZXN1bHRzOgwABAoAAR1eVC+9GvABAAA=",
          "result": {
            "__typename": "ApiMedia",
            "id": "QXBpTWVkaWE6DAAECgABHV5UL70a8AEAAA==",
            "media_key": "13_2116221438923567105"
          }
        },
        "media_url_https": "https://pbs.twimg.com/amplify_video_thumb/2116221438923567105/img/0-HB2LFRbfabewM5.jpg",
        "original_info": {
          "focus_rects": [],
          "height": 2160,
          "width": 3840
        },
        "sizes": {
          "large": {
            "h": 1152,
            "w": 2048
          }
        },
        "type": "video",
        "url": "https://t.co/iCRqnysRdX",
        "video_info": {
          "aspect_ratio": [
            16,
            9
          ],
          "duration_millis": 278236,
          "variants": [
            {
              "content_type": "application/x-mpegURL",
              "url": "https://video.twimg.com/amplify_video/2116221438923567105/pl/7CDxCmSyxrSyLQ3d.m3u8?tag=29&v=b0d"
            },
            {
              "bitrate": 256000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2116221438923567105/vid/avc1/480x270/V-uryuJVKIr11LgA.mp4?tag=29"
            },
            {
              "bitrate": 832000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2116221438923567105/vid/avc1/640x360/A4mW2j2-c3phzQfW.mp4?tag=29"
            },
            {
              "bitrate": 2176000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2116221438923567105/vid/avc1/1280x720/Pxizbb4GNpnqNQoe.mp4?tag=29"
            },
            {
              "bitrate": 10368000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2116221438923567105/vid/avc1/1920x1080/_15qVK-bAvBPaDHp.mp4?tag=29"
            },
            {
              "bitrate": 25128000,
              "content_type": "video/mp4",
              "url": "https://video.twimg.com/amplify_video/2116221438923567105/vid/avc1/3840x2160/DeW1hO2T0ItS-LvB.mp4?tag=29"
            }
          ]
        }
      }
    ]
  },
  "card": null,
  "place": {},
  "entities": {
    "hashtags": [],
    "symbols": [],
    "timestamps": [],
    "urls": [],
    "user_mentions": [
      {
        "id_str": "2051457164250640384",
        "indices": [
          1088,
          1102
        ],
        "name": "Voice Arena",
        "screen_name": "voicearena_ai"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": null,
  "isLimitedReply": false,
  "communityInfo": null,
  "article": null
}