Third-party developers, Openi’s annual conference for Daved, kicked with a blast today as co-founder and CEO Sam Altman Made a new announcement "Apps SDK" It makes "It is possible to make apps inside the chat," Companies, including paid apps, can charge users to use Openai’s recently unveiled agentic commerce protocol (ACP).
In other words, instead of launching the app one by one on your phone, computer or web-now you can do all that Without Ever leaving chat.
This feature allows the user to log in to their accounts on those external apps and bring all their information back into chat, and uses the apps in the same way how they already do outside the chatbot, but now what can each app offer on themselves.
You can direct canva to make slides based on a text detail, ask Zilo for home listing in a certain area meeting some requirements, or ask Angrera about the content of a specific text, while playing on the details on the video, all within the chat – all the chats – are already offering their own connections with many other apps (see below).
"This will enable a new generation apps that are interactive, adaptive and personal, with whom you can chat," Altman said.
While Apps SDK is available in preview today, Openai said This will not start accepting new apps within Chatgpt or will not allow users to charge them "later this year."
Chatgpt in-line app access is already rolling out for chat, plus, go and pro users-the outside of the European Union-is expected to get access to apps at the end of this year with-business, enterprises and education levels.
Common MCP made above standard
Made on the open source standard model reference protocol (MCP) introduced by rival anthropic about a year ago, Apps SDK gives third party developers independently or to add large and small selected data to work on behalf of enterprises, "Present trigger actions, and a fully interactive UI (user interface)" Ultman explained during his introductory main speech.
SDK contains apps "Talm" Chatgpt and built-in GPT-5 or others "O-series" Models going below to get updated reference from third -party app or service, so model, so model "It always knows that you are interacting with the user," According to another presenter and openi engineer, Alexi Cristacice.
Developers can create apps that:
-
Feel like In -line Chat as a light card or carousel
-
Expand full screen For immersive functions like map, menu, or slide
-
Use picture in Picture For live sessions like video, game or quiz
Each mode is designed to preserve the minimum, conjunctival flow of chatgpt when combining the presence of interaction and brand.
Initial integration with Coursra, Canva, Zillow and more …
Crystachis showed initial integration External apps made apps over SDKIncluding e-learning company people CoursraCloud Design Software Company CanvaAnd real estate listing and agent connection search engine, Zillow,
ALTMAN also announced the apps SDK integration with additional partners, which officially did not officially demo: Booking.com, Expidia, Fig And Spotify And in documentation, more upcoming partners are on the deck: Alltrails, Peloton, Opentable, Target, Thefork and UberRepresenting lifestyle, commerce and productivity categories.
Korsera demo This includes an example of how the user includes an onboard for the external app, which includes a new login screen for the app (Kogsera), which appears within the Chatgpt chat interface, is only activated by a text prompt from the user: "Coursra can you teach me something about learning machine",
Once logged in, the app was launched within the chat interface, "In -line" And you can present anything from the web with interactive elements like videos.
Crystachis explained and showed that SDK also supports "picture in Picture" And "full screen" The scene allows the user to choose the way to interact with it.
When a courtra video appeared, he showed that it automatically pinned the video on top of the screen so that the user could see it, even they were running with a back-end-trunk dialogue in the lesson, which was with a chat in typical input/output prompts and chats in reactions.
Users can then ask the chat the content appearing in the video, which was actually said without specifyingThe SDK as agents pipes information from the backnd, server-side, connected app to the inherent chat AI model. so "Can you explain more about what they are saying right now" The surface will automatically give the surface to the relevant part of the video and provides that to analyze and respond to the underlying AI model through the text.
In another example, Christacice opened an old, existing chat conversation, which he had done about the business of his siblings’ dog running and resumed the conversation by asking another third-party app, CanvaTo generate a poster using one of the recommended commercial names of Chatgpt, "Walk this wag," With specific guidance about font choice ("sans serif") And overall color and style ("Bright and colorful.",
Instead of manually knowing the user and adding all those specific elements to the canva template, Chatgpt went and issued commands and took action on behalf of the user in the background.
After a few minutes, Chatgpt responded with several poster designs generated directly within the Canva app, but all of them displayed in the user’s chatgpt chat session, where they can see, review, expand and provide feedback, or ask for adjustment on all of them.
Crystachis then asked the chatgate to convert one of the slides to a whole slide deck, so that the founders of the dog walking business could introduce it to investors, which were in background in several minutes, while they presented a final unified app, Zillow,
He started a new chat session and asked a simple question: "Based on our conversation, what would be a good city to expand the dog’s running business."
Using Chatgpt’s alternative memory feature, it refers to the dog walk conversation and suggested Pittsburgh, which Crystachis used as a chance to type "Zillow" And "Show me some houses for sale there," Who listed an interactive map from Zilo for sales and prices with homes and called Hover-Over Animation, all in-line within all chats.
A fullscreen scene was also opened by clicking on a specific house "Most of the district experience," Without leaving the chat completely, including the ability to request home tourism and contact agents and to filter by other properties such as bedroom and outdoor space. The Chatgpt requested the requested filtered zilo draws as well as provides a lesson-based response that explains what he did and why.
The user may then ask follow-up questions about specific assets-like "How close is the dog park?" – Or compare it with other assets, within all chats.
It can also use apps in combination with its search function, find the web to compare the app information (in this case, zillow) with other sources.
Security, privacy and developer standards
Openai insisted on this Apps should follow strict privacy, security and materials Standards The Chatgpt is to be listed in the directory. Apps need:
-
Serve Clear and valuable objective
-
Happen Forecast and reliable In behavior
-
Happen Safe for general audienceWith a teenager of the age of 13-17 years
-
Honor user privacy And limit the data collection only that is required
Must join every app Clear, published privacy policyGet the consent of the user before connecting, and identify any action that modifies external data (eg, posting, sending, uploading).
Apps that violate policies of Openai, often crash, or presents their abilities incorrectly, can be removed at any time. Developers have to submit verified accountprovide Customer aid contactAnd maintain your apps for stability and compliance.
Openai also published Developer design guidelinesExplaining how apps should see, sound and behave. They should follow the visual system of the spat – including persistent color straps, typography, vacancy and icography – and maintain access standards such as the alt text and readable opposite ratio.
Partners can show the brand logo and pronunciation colors but cannot change the core interface of the chat or use the promotional language. Apps should remain “Connivance, intelligent, simple, responsible and accessible,” According to documentation.
A new interactive app ecosystem
By opening a chatgate for third -party apps and payments, Openai is taking a big step towards converting a chatbot into a full -filled with a chatbot AI operating mechanism – A one that combines intelligence, rich interfaces and embedded commerce.
For developers, this means direct access More than 800 million Chatgpt usersWhich can discover the apps “at the right time” apps through natural interactions – whether traveling, learning, or planning to shop.
For users, it means A new generation apps with which you can chat – Where a single interface helps you book a flight, designs a slide deck, or learn a new skill without leaving a chat anytime.
As Openai said: “This is only the beginning of apps in Chatgpt, bringing new utility for users and new opportunities for developers.”
Some big questions remain, ie: 1. What happens with all the data of those third-party applications because they interface with chat and its users … Does Openii get it and can it be trained on it? 2. What happens to Openai’s once very hypertured GPT store, which in the past was promoted in a way for third-party creators and developers, which earn money on them through Custom, Custom, Accessible versions of CHATGPT, and usage-based revenue share models?
We have asked the company about both issues and will update when we listen back.
