{
  "user": {
    "created_at": "2012-12-12T22:11:27.000Z",
    "default_profile_image": false,
    "description": "@NVIDIA Senior Research Scientist & Lead of AI Agents. Creating foundation models for Agents, Robotics, Gaming. @Stanford Ph.D. @OpenAI's first intern.",
    "fast_followers_count": 0,
    "favourites_count": 6922,
    "followers_count": 204532,
    "friends_count": 2910,
    "has_custom_timelines": true,
    "is_translator": false,
    "listed_count": 3642,
    "location": "Contact →",
    "media_count": 730,
    "name": "Jim Fan",
    "normal_followers_count": 204532,
    "possibly_sensitive": false,
    "profile_banner_url": "https://pbs.twimg.com/profile_banners/1007413134/1672408318",
    "profile_image_url_https": "https://pbs.twimg.com/profile_images/1554922493101559808/SYSZhbcd_normal.jpg",
    "screen_name": "DrJimFan",
    "statuses_count": 3418,
    "translator_type": "none",
    "url": "https://t.co/H4rXo4Ei8X",
    "verified": true,
    "withheld_in_countries": [],
    "id_str": "1007413134"
  },
  "id": "1758210245799920123",
  "conversation_id": "1758210245799920123",
  "full_text": "If you think OpenAI Sora is a creative toy like DALLE, ... think again. Sora is a data-driven physics engine. It is a simulation of many worlds, real or fantastical. The simulator learns intricate rendering, \"intuitive\" physics, long-horizon reasoning, and semantic grounding, all by some denoising and gradient maths.\n\nI won't be surprised if Sora is trained on lots of synthetic data using Unreal Engine 5. It has to be!\n\nLet's breakdown the following video. Prompt: \"Photorealistic closeup video of two pirate ships battling each other as they sail inside a cup of coffee.\"\n\n- The simulator instantiates two exquisite 3D assets: pirate ships with different decorations. Sora has to solve text-to-3D implicitly in its latent space.\n- The 3D objects are consistently animated as they sail and avoid each other's paths.\n- Fluid dynamics of the coffee, even the foams that form around the ships. Fluid simulation is an entire sub-field of computer graphics, which traditionally requires very complex algorithms and equations. \n- Photorealism, almost like rendering with raytracing.\n- The simulator takes into account the small size of the cup compared to oceans, and applies tilt-shift photography to give a \"minuscule\" vibe.\n- The semantics of the scene does not exist in the real world, but the engine still implements the correct physical rules that we expect.\n\nNext up: add more modalities and conditioning, then we have a full data-driven UE that will replace all the hand-engineered graphics pipelines.\n\nhttps://t.co/7BikSgE7iN",
  "reply_count": 538,
  "retweet_count": 2692,
  "favorite_count": 12981,
  "hashtags": [],
  "symbols": [],
  "user_mentions": [],
  "urls": [],
  "media": [
    {
      "media_url": "https://pbs.twimg.com/ext_tw_video_thumb/1758203933921853442/pu/img/jSN_G79_WJ2_X_KC.jpg",
      "type": "video",
      "video_url": "https://video.twimg.com/ext_tw_video/1758203933921853442/pu/vid/avc1/1280x720/mycSG9QC90f7AMil.mp4?tag=12"
    }
  ],
  "url": "https://twitter.com/DrJimFan/status/1758210245799920123",
  "created_at": "2024-02-15T19:22:43.000Z",
  "#sort_index": "1758355737066299600",
  "view_count": 3907559,
  "quote_count": 746,
  "is_quote_tweet": false,
  "is_retweet": false,
  "is_pinned": false,
  "is_truncated": true,
  "startUrl": "https://twitter.com/drjimfan/status/1758355737066299692"
}