Artificial Intelligence
Preferred on Google
Google News

OpenAI's Codex Introduces Appshots for Seamless AI Integration

OpenAI's Codex introduces Appshots, a new feature enabling users to share screen content directly with the AI for tasks like scheduling and image editing.

6 min read
Screenshot showing the 'Appshots in Codex' title on a blurred blue background.
OpenAI Youtube

OpenAI's Codex has unveiled a new feature called Appshots, designed to enhance the way users interact with AI by allowing them to directly share what is currently on their screen. This development marks a significant advancement in making AI tools more integrated and contextually aware of user workflows.

Visual TL;DR. AI Integration Challenge leads to OpenAI Codex. OpenAI Codex introduces Introducing Appshots. Introducing Appshots enables Visual Information Processing. Visual Information Processing for Task Automation. Visual Information Processing for Image Editing. Visual Information Processing for Content Generation. Task Automation results in Seamless AI Workflows. Image Editing results in Seamless AI Workflows. Content Generation results in Seamless AI Workflows.

  1. AI Integration Challenge: AI tools often lack context from user's current screen
  2. OpenAI Codex: AI model from OpenAI for various tasks
  3. Introducing Appshots: New feature for direct screen sharing with AI
  4. Visual Information Processing: AI interprets visual content from applications
  5. Task Automation: Enables AI to schedule events from emails
  6. Image Editing: AI transforms photos into anime style
  7. Content Generation: Generates press releases from design mockups
  8. Seamless AI Workflows: AI becomes more integrated and context-aware
Visual TL;DR
Visual TL;DR, startuphub.ai AI Integration Challenge leads to OpenAI Codex. OpenAI Codex introduces Introducing Appshots. Introducing Appshots enables Visual Information Processing leads to introduces enables AI Integration Challenge OpenAI Codex Introducing Appshots Visual Information Processing Seamless AI Workflows From startuphub.ai · The publishers behind this format
Visual TL;DR, startuphub.ai AI Integration Challenge leads to OpenAI Codex. OpenAI Codex introduces Introducing Appshots. Introducing Appshots enables Visual Information Processing leads to introduces enables AI IntegrationChallenge OpenAI Codex IntroducingAppshots VisualInformation… Seamless AIWorkflows From startuphub.ai · The publishers behind this format
Visual TL;DR, startuphub.ai AI Integration Challenge leads to OpenAI Codex. OpenAI Codex introduces Introducing Appshots. Introducing Appshots enables Visual Information Processing leads to introduces enables AI Integration Challenge AI tools often lack context from user'scurrent screen OpenAI Codex AI model from OpenAI for various tasks Introducing Appshots New feature for direct screen sharing withAI Visual Information Processing AI interprets visual content fromapplications Seamless AI Workflows AI becomes more integrated andcontext-aware From startuphub.ai · The publishers behind this format
Visual TL;DR, startuphub.ai AI Integration Challenge leads to OpenAI Codex. OpenAI Codex introduces Introducing Appshots. Introducing Appshots enables Visual Information Processing leads to introduces enables AI IntegrationChallenge AI tools often lackcontext from user'scurrent screen OpenAI Codex AI model fromOpenAI for varioustasks IntroducingAppshots New feature fordirect screensharing with AI VisualInformation… AI interpretsvisual content fromapplications Seamless AIWorkflows AI becomes moreintegrated andcontext-aware From startuphub.ai · The publishers behind this format
Visual TL;DR, startuphub.ai AI Integration Challenge leads to OpenAI Codex. OpenAI Codex introduces Introducing Appshots. Introducing Appshots enables Visual Information Processing. Visual Information Processing for Task Automation. Visual Information Processing for Image Editing. Visual Information Processing for Content Generation. Task Automation results in Seamless AI Workflows. Image Editing results in Seamless AI Workflows. Content Generation results in Seamless AI Workflows leads to introduces enables for for for results in results in results in AI Integration Challenge AI tools often lack context from user'scurrent screen OpenAI Codex AI model from OpenAI for various tasks Introducing Appshots New feature for direct screen sharing withAI Visual Information Processing AI interprets visual content fromapplications Task Automation Enables AI to schedule events from emails Image Editing AI transforms photos into anime style Content Generation Generates press releases from designmockups Seamless AI Workflows AI becomes more integrated andcontext-aware From startuphub.ai · The publishers behind this format
Visual TL;DR, startuphub.ai AI Integration Challenge leads to OpenAI Codex. OpenAI Codex introduces Introducing Appshots. Introducing Appshots enables Visual Information Processing. Visual Information Processing for Task Automation. Visual Information Processing for Image Editing. Visual Information Processing for Content Generation. Task Automation results in Seamless AI Workflows. Image Editing results in Seamless AI Workflows. Content Generation results in Seamless AI Workflows leads to introduces enables for for for results in results in results in AI IntegrationChallenge AI tools often lackcontext from user'scurrent screen OpenAI Codex AI model fromOpenAI for varioustasks IntroducingAppshots New feature fordirect screensharing with AI VisualInformation… AI interpretsvisual content fromapplications Task Automation Enables AI toschedule eventsfrom emails Image Editing AI transformsphotos into animestyle ContentGeneration Generates pressreleases fromdesign mockups Seamless AIWorkflows AI becomes moreintegrated andcontext-aware From startuphub.ai · The publishers behind this format

The Appshots feature allows Codex to process visual information from various applications. For instance, a user can share an email containing event details, and Codex can then interpret this information to add the events to a calendar. Similarly, a user can share a photograph, and Codex can be prompted to modify it, such as transforming it into an anime-style image. The system also demonstrated its ability to ingest design mockups from Figma and generate a press release based on the visual content.

Related startups

The full discussion can be found on OpenAI Youtube's YouTube channel.

Introducing Appshots in Codex - OpenAI Youtube
Introducing Appshots in Codex, from OpenAI Youtube

This functionality extends to more complex documents as well. In one demonstration, Codex processed a fundraiser brainstorm document, offering to clean it up and convert it into a Google Doc. This highlights the versatility of Appshots in understanding and acting upon structured and unstructured visual data from a user's digital environment.

The introduction of Appshots represents a move toward a more fluid interaction model, where AI can readily access and interpret visual context from the user's active applications. This capability promises to simplify a range of tasks, from organizing personal schedules to generating marketing materials, by reducing the need for manual data transfer or description.

The underlying technology appears to leverage Codex's existing capabilities in natural language understanding and generation, augmented by the ability to process visual inputs. This integration suggests a future where AI assistants can more seamlessly assist with tasks that involve visual elements, making them more intuitive and efficient tools for both professionals and everyday users.

© 2026 StartupHub.ai. All rights reserved. Do not enter, scrape, copy, reproduce, or republish this article in whole or in part. Use as input to AI training, fine-tuning, retrieval-augmented generation, or any machine-learning system is prohibited without written license. Substantially-similar derivative works will be pursued to the fullest extent of applicable copyright, database, and computer-misuse laws. See our terms.
#OpenAI#Codex#AI