The always-on AI personal assistant, which keeps working in the background even when you arenâÂÂt asking it to, is this yearâÂÂs answer to the question of how people will actually use deep learning models. The startup Instinct became an overnight sensation, and Meta put the full force of its marketing behind its assistant, Muse.
OpenAI wasnâÂÂt going to be left out. The company released dots, its assistant offering, at its developer day in late September. Alexander Embiricos, who leads OpenAIâÂÂs enterprise product team, joined us at TechCrunch Disrupt this month to explain where the product came fromâÂÂstarting with the question of why so many companies seem to be turning to cutesy mascots as avatars for their trillion-parameter matrix multiplication machines.
âÂÂThereâÂÂs kind of this convergent evolution happening,â Embiricos said of the efforts to build AI assistants. âÂÂAs we were working on the product, we realized if we could frame this as, itâÂÂs an entity and itâÂÂs a single conversation, not many different conversationsâ¦.it starts to become intuitive.âÂÂ
The assistant is available in the ChatGPT desktop and mobile apps to subscribers on the Pro tier or higher, with plans starting at $100 a month. Once it is connected to your calendar, email, computer and other tools, the agent tries to help you get your work done.
Embiricos points out that you could achieve much of dotsâ functionality with Open AIâÂÂs Codex app, its coding tool, released at the beginning of this year. But that requires more work and hand-holding. He recalled celebrating when his wife started leaving her computer on all night so that her agents could keep working.
âÂÂOn the product team, what I think about is, how do we make this intuitive and useful to people?â he told Disrupt attendees. âÂÂA lot of that isnâÂÂt building some new piece of tech into the product; itâÂÂs how you frame it to the user and how it feels.âÂÂ
The path from chat bot to coding tool to personal assistant
Making the technology feel intuitive meant repackaging the functionality of the companyâÂÂs models into something more accessible, a path it was already on as it spun ChatGPT Work out of the agentic coding tools it had built for software engineers. Even the nameâÂÂa play on the negative space inside of OpenAIâÂÂs logoâÂÂis intended âÂÂto feel like just something that could eventually be ubiquitous.â (Asked when he learned that rival AI entrepreneur Elon Musk owns the dot.com URL, Embiricos said, âÂÂI found out very late.âÂÂ)
The idea of a persistent agent is that it doesnâÂÂt need prompting. For OpenAI, means more token usage, and for users, a more pro-active assistant âÂÂthatâÂÂs sort of thinking about you and thinking how to help you,â as Embiricos put it.
In our testing, the assistantâÂÂs ability to think ahead is apparent and often useful, but it isnâÂÂt quite there yet. It will flag calendar conflicts and upcoming deadlines, but not necessarily in the most timely fashion.
âÂÂThe first time it told me about one of those [conflicts]âÂÂthis is like early in developmentâÂÂit told me three minutes before the thing,â Embiricos says of his dot. âÂÂItâÂÂs like, âÂÂHey, this thing is coming up. You might want to do something about it.â I only have three minutes!âÂÂ
Embiricos expects the timing to improve over time, but the proactive approach is key to the product. âÂÂI was hearing about an engineer at a drone delivery startup, and they were saying, âÂÂWe had this outage, and by the time I noticed that the outage was going on, my dot had already noticed the outage was happening, had already analyzed the outage, and had come to me with useful information for how we could resolve the outage.âÂÂâÂÂ
Giving dot the keys
As with most AI agent use cases, thereâÂÂs a tension between the personal information an AI model needs to be useful and exactly how much personal data you are exposing to a software company. Muse has been criticized for the profiles it builds of your family and friends, which the software uses to know, say, what kind of restaurant you might want to go to with a specific pal, but could also add incredible value to MetaâÂÂs advertising business. Does dots collect similar data?
âÂÂYes, we have a thing that we built into dots, which we call proactive research,â Embiricos said. âÂÂOn a cadence, it will think about what it knows about you, what is the conversation that itâÂÂs had, and then what have you given it access to that it can think about, and then it will go and research, âÂÂWhat could I do to be more helpful to you?â And then, basically, it will propose that.âÂÂ
With dots, OpenAI says that the agent has the same privacy controls as ChatGPT itself: Users can turn off model training (stopping OpenAI from using their conversations to improve its AI), and control what resources it accesses within your computer and how. Still, those controls arenâÂÂt granular and the app can be pushy. For example, it refuses to accept read-only access to cloud drives.
âÂÂWhat I think we need to do is basically build out super, super, super granular controls,â Embiricos said, but he pointed to the modelâÂÂs intelligence and discretion as the other side of this coin.
âÂÂThis is actually something we kind of got some flack about when we launched,â Embiricos said. âÂÂWe had really conservative defaults over what the agent would do, and it would ask for permission a lot. I remember knowing that we were going to see that feedback, but thinking, âÂÂThis is okay, we can tune that over time.âÂÂâÂÂ
Can personal AI agents scale?
The other big question about AI agents is whether they can scale. TheyâÂÂre fun when only a few people have them, and stories of agents snagging hard-to-get reservations abound. But businesses donâÂÂt necessarily like dealing with agents and might not be equipped to. People certainly donâÂÂt like dealing with them (note: stop having your AI agents pitch me), and Embiricos is among those people. He also has a human assistant because OpenAIâÂÂs corporate partners want to interact with a person, he said, adding, âÂÂI personally never intend to have a meeting with someone elseâÂÂs agent.âÂÂ
If the AI industry is right that agents are our future, can we get there without overwhelming the infrastructure that our world currently runs on, from businesses and websites to payment networks?
âÂÂAt OpenAIâ¦weâÂÂre not always moving the fastest in terms of shipping the next ability for the agent to work with the world,â he said. âÂÂWhen we do, weâÂÂre doing it really closely in collaboration with the rest of the ecosystem. I probably canâÂÂt say too much here, but weâÂÂre deep in lots of conversations with payment processors.âÂÂ
Letting an AI assistant spend money through partnerships with payment companies would be a potentially lucrative first for OpenAI, but also a big ask for consumers. Giving an assistant access to my email inbox already feels like a big ask, but my bank account is off limits. For now.
When you purchase through links in our articles, we may earn a small commission. This doesnâÂÂt affect our editorial independence.
