{
  "type": "tweet",
  "id": "2073183871126897000",
  "url": "https://x.com/dair_ai/status/2073183871126897000",
  "twitterUrl": "https://twitter.com/dair_ai/status/2073183871126897000",
  "text": "RT @omarsar0: Multimodal prompting is clearly the future. \n\nI love experimenting with new ways to interact with agents. \n\nAs a researcher a…",
  "source": "Twitter for iPhone",
  "retweetCount": 2,
  "replyCount": 0,
  "likeCount": 19,
  "quoteCount": 0,
  "viewCount": 2470,
  "createdAt": "Fri Jul 03 23:15:27 +0000 2026",
  "lang": "en",
  "bookmarkCount": 14,
  "isReply": false,
  "inReplyToId": null,
  "conversationId": "2073183871126897000",
  "displayTextRange": [
    0,
    140
  ],
  "inReplyToUserId": null,
  "inReplyToUsername": null,
  "author": {
    "type": "user",
    "userName": "dair_ai",
    "url": "https://x.com/dair_ai",
    "twitterUrl": "https://twitter.com/dair_ai",
    "id": "889050642903293953",
    "name": "DAIR.AI",
    "isVerified": false,
    "isBlueVerified": true,
    "verifiedType": null,
    "profilePicture": "https://pbs.twimg.com/profile_images/1643277398522187778/31dedbLo_normal.jpg",
    "coverPicture": "https://pbs.twimg.com/profile_banners/889050642903293953/1773242460",
    "description": "Democratizing AI research, education, and technologies. Learn about AI Agents for FREE at https://t.co/HHXg8rryu4",
    "location": "",
    "followers": 127325,
    "following": 1,
    "status": "",
    "canDm": true,
    "canMediaTag": true,
    "createdAt": "Sun Jul 23 09:12:45 +0000 2017",
    "entities": {
      "description": {
        "urls": [
          {
            "display_url": "academy.dair.ai/courses/elemen…",
            "expanded_url": "https://academy.dair.ai/courses/elements-of-ai-agents",
            "indices": [
              90,
              113
            ],
            "url": "https://t.co/HHXg8rryu4"
          }
        ]
      },
      "url": {
        "urls": [
          {
            "display_url": "dair.ai",
            "expanded_url": "https://www.dair.ai/",
            "indices": [
              0,
              23
            ],
            "url": "https://t.co/lkqPZtMU5s"
          }
        ]
      }
    },
    "fastFollowersCount": 0,
    "favouritesCount": 4721,
    "hasCustomTimelines": true,
    "isTranslator": false,
    "mediaCount": 269,
    "statusesCount": 3411,
    "withheldInCountries": [],
    "affiliatesHighlightedLabel": {},
    "possiblySensitive": false,
    "pinnedTweetIds": [
      "2073065231790809214"
    ],
    "profile_bio": {},
    "isAutomated": false,
    "automatedBy": null
  },
  "extendedEntities": {},
  "card": null,
  "place": {},
  "entities": {
    "user_mentions": [
      {
        "id_str": "3448284313",
        "indices": [
          3,
          12
        ],
        "name": "elvis",
        "screen_name": "omarsar0"
      }
    ]
  },
  "quoted_tweet": null,
  "retweeted_tweet": {
    "type": "tweet",
    "id": "2073183732492603411",
    "url": "https://x.com/omarsar0/status/2073183732492603411",
    "twitterUrl": "https://twitter.com/omarsar0/status/2073183732492603411",
    "text": "Multimodal prompting is clearly the future. \n\nI love experimenting with new ways to interact with agents. \n\nAs a researcher and engineer, I've found that the richer the inputs to the agent and the richer the outputs I consume, the better the overall results of the collaboration.\n\nIn this little walkthrough, I go over what I mean by a multimodal prompt and when you might find it useful. \n\nIt's more than simple text prompting, so I call it a \"task\" for lack of a better word. It helps me record my voice, annotate the screen, click/mouse actions, and more. \n\nThen all of that is preprocessed and passed to the agent to complete the task more efficiently. The agent has the high-level prompt, but it also has the raw transcriptions if needed. So naturally, I am also using this to build out multimodal skills that I reuse in workflows where agents tend to struggle. \n\nThis has saved me hours of work. And even the older models are pretty great at understanding the tasks more clearly. Some noise is introduced in the process, but it doesn't seem to hurt the performance. I've also found that this new way of prompting has reduced the number of frustrating interactions I have with agents.\n\nThis is something I have been thinking about for some time now because we are going to move more into multimodal AI models. And so the interactions are going to evolve with models being able to handle a variety of modalities natively. Currently, I process all the recorded tasks with another model in the background, but it's not crazy to think that all of it will just be naturally consumed by omnimodel in the future.\n\nAll of these recorded tasks (which you can also think of as rich annotated datasets) are things I mine and recursively improve over time and, in some cases, package as reusable workflows/patterns/skills. \n\nThis process has really elevated how I use coding agents for all kinds of work. I use multimodal prompting in things like web development, designing, artifact creation, prototyping, researching, reading, simulations, AI-assisted writing, and much more. \n\nSo it's not just about prompting. It's going deeper into understanding and exploring the right level of detail that the agents need to make the right decision and to push/maximize their capabilities.",
    "source": "Twitter for iPhone",
    "retweetCount": 2,
    "replyCount": 0,
    "likeCount": 19,
    "quoteCount": 0,
    "viewCount": 2470,
    "createdAt": "Fri Jul 03 23:14:54 +0000 2026",
    "lang": "en",
    "bookmarkCount": 14,
    "isReply": false,
    "inReplyToId": null,
    "conversationId": "2073183732492603411",
    "displayTextRange": [
      0,
      279
    ],
    "inReplyToUserId": null,
    "inReplyToUsername": null,
    "author": {
      "type": "user",
      "userName": "omarsar0",
      "url": "https://x.com/omarsar0",
      "twitterUrl": "https://twitter.com/omarsar0",
      "id": "3448284313",
      "name": "elvis",
      "isVerified": false,
      "isBlueVerified": true,
      "verifiedType": null,
      "profilePicture": "https://pbs.twimg.com/profile_images/939313677647282181/vZjFWtAn_normal.jpg",
      "coverPicture": "https://pbs.twimg.com/profile_banners/3448284313/1565974901",
      "description": "Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO",
      "location": "DAIR.AI Academy",
      "followers": 309694,
      "following": 893,
      "status": "",
      "canDm": true,
      "canMediaTag": true,
      "createdAt": "Fri Sep 04 12:59:26 +0000 2015",
      "entities": {
        "description": {
          "urls": [
            {
              "display_url": "academy.dair.ai/courses/elemen…",
              "expanded_url": "https://academy.dair.ai/courses/elements-of-ai-agents",
              "indices": [
                97,
                120
              ],
              "url": "https://t.co/P5SA9u54xO"
            }
          ]
        },
        "url": {
          "urls": [
            {
              "display_url": "dair.ai",
              "expanded_url": "https://www.dair.ai/",
              "indices": [
                0,
                23
              ],
              "url": "https://t.co/XQto5ypkSM"
            }
          ]
        }
      },
      "fastFollowersCount": 0,
      "favouritesCount": 37352,
      "hasCustomTimelines": true,
      "isTranslator": false,
      "mediaCount": 4764,
      "statusesCount": 18621,
      "withheldInCountries": [],
      "affiliatesHighlightedLabel": {},
      "possiblySensitive": false,
      "pinnedTweetIds": [
        "2073183732492603411"
      ],
      "profile_bio": {},
      "isAutomated": false,
      "automatedBy": null
    },
    "extendedEntities": {
      "media": [
        {
          "additional_media_info": {
            "monetizable": false
          },
          "allow_download_status": {
            "allow_download": true
          },
          "display_url": "pic.x.com/davKmkTPAb",
          "expanded_url": "https://x.com/omarsar0/status/2073183732492603411/video/1",
          "ext_media_availability": {
            "status": "Available"
          },
          "id_str": "2073176981588348928",
          "indices": [
            280,
            303
          ],
          "media_key": "13_2073176981588348928",
          "media_results": {
            "result": {
              "media_key": "13_2073176981588348928"
            }
          },
          "media_url_https": "https://pbs.twimg.com/amplify_video_thumb/2073176981588348928/img/93pcmh0UZ3EqpWyM.jpg",
          "original_info": {
            "focus_rects": [],
            "height": 1080,
            "width": 1920
          },
          "sizes": {
            "large": {
              "h": 1080,
              "resize": "fit",
              "w": 1920
            },
            "medium": {
              "h": 675,
              "resize": "fit",
              "w": 1200
            },
            "small": {
              "h": 383,
              "resize": "fit",
              "w": 680
            },
            "thumb": {
              "h": 150,
              "resize": "crop",
              "w": 150
            }
          },
          "type": "video",
          "url": "https://t.co/davKmkTPAb",
          "video_info": {
            "aspect_ratio": [
              16,
              9
            ],
            "duration_millis": 549766,
            "variants": [
              {
                "content_type": "application/x-mpegURL",
                "url": "https://video.twimg.com/amplify_video/2073176981588348928/pl/RrBzOOlXDkwTh5iU.m3u8?tag=28&v=137"
              },
              {
                "bitrate": 256000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2073176981588348928/vid/avc1/480x270/Ui0i_amYblcaMwkc.mp4?tag=28"
              },
              {
                "bitrate": 832000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2073176981588348928/vid/avc1/640x360/-k-E_fkl_J2xq5UI.mp4?tag=28"
              },
              {
                "bitrate": 2176000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2073176981588348928/vid/avc1/1280x720/xmdPArYVY8KXlul2.mp4?tag=28"
              },
              {
                "bitrate": 10368000,
                "content_type": "video/mp4",
                "url": "https://video.twimg.com/amplify_video/2073176981588348928/vid/avc1/1920x1080/XvtnO59u1gIwDi7r.mp4?tag=28"
              }
            ]
          }
        }
      ]
    },
    "card": null,
    "place": {},
    "entities": {
      "hashtags": [],
      "symbols": [],
      "timestamps": [],
      "urls": [],
      "user_mentions": []
    },
    "quoted_tweet": null,
    "retweeted_tweet": null,
    "article": null
  },
  "article": null
}