OpenAI's ChatGPT Gains Context with Computer History Feature

OpenAI is introducing a significant new capability to its ChatGPT and Codex platforms: Computer History. This feature allows users to show their AI agents how they work, enabling more natural and contextual conversations. By enabling Computer History in the desktop app settings on macOS, the AI can reference a user's recent activity, from clicks and typing to app switches, to understand their workflow and provide more relevant assistance.

Understanding User Workflow

Dominik Kundel, Developer Experience at OpenAI, demonstrated how Computer History works. When asked about the last Google Doc being edited, the agent could recall the specific document, "VideoScript Computer History," by referencing the user's recent activity. This contextual understanding extends to other applications, as shown when the agent confirmed a document was shared with specific individuals in a group DM, leveraging its knowledge of past conversations.

The full discussion can be found on OpenAI Youtube's YouTube channel.

The system captures interaction events rather than relying on screen or audio captures, making it more efficient and less intrusive. Users are given explicit control over their privacy, with the ability to exclude specific apps and websites from being tracked. These settings can be managed through a new menu bar entry or within the desktop app's settings, where users can also review, delete, or clear captured history.

Personalized AI Interactions

Computer History aims to make AI agents like ChatGPT and Codex more personalized and adaptable to individual work styles. By understanding a user's actions and patterns, the AI can suggest new skills and automations. For instance, it can propose creating a skill based on a recently performed workflow or generating an automation to draft daily standup updates.

This deeper understanding allows the AI to tailor its tool usage to the user's preferences, such as drafting documents in their preferred application. The goal is to move beyond simple command-response interactions towards a more collaborative and intuitive AI partnership that learns and adapts to the user's unique way of working.

Privacy and Control

OpenAI emphasizes user privacy with the Computer History feature. Users can granularly control what information is captured. Options include quickly excluding specific websites or entire applications via a new menu bar entry. Detailed control is also available in the desktop app's settings, where users can review all captured data, delete individual entries, clear history entirely, or even access the raw memory files. This transparency ensures users know exactly what their agent has remembered.

Beyond just remembering past actions, the feature is designed to be proactive. It will suggest skills and automations based on observed repetitive tasks. This could range from creating custom skills for specific workflows to automating routine actions like drafting team updates. Ultimately, Computer History aims to bridge the gap between AI capabilities and individual user needs, making interactions more efficient and personalized.