Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

OATs Gives Everyday Objects Gemini-Powered Digital Pets

AI summary

Carnegie Mellon University researchers developed OATs (Object Agent Twins), tiny E Ink avatars that attach to household objects and express sensor-driven emotions. A web interface uses Google Gemini to generate pixel characters, behavior rules, and 12 expressions, while ESP32-S3 hardware with environmental and motion sensors can be assembled for under $20. A seven-day test involving 12 participants covered objects including plants, a coffee machine, dumbbells, and a 3D printer, but reported battery life varies from about one week to three or four days.

In-depth insight

OATs demonstrates how generative AI, inexpensive sensors, and anthropomorphic interfaces can move agent-like interactions out of phone screens and onto physical objects.

You forgot to water the plant. Instead of seeing yellowing leaves, you see a cute plant-shaped pet on a tiny screen, looking sad and dejected. Maybe that'll give you the push you needed to grab the watering can. As you pour water into the soil, the plant pet on the screen gets excited and happy.

That's the idea behind OATs, or Object Agent Twins—micro-agent AI avatars on tiny E Ink displays designed to pair with everyday household objects. The tech was created by Daehwa Kim, a fifth-year PhD student in Carnegie Mellon's Future Interfaces Group. Kim presented the project at the ACM Symposium on User Interface Software and Technology in Detroit in early November, a forum where academics and industry experts explore human-computer interfaces, and she earned two Honorable Mention awards.

You might remember Tamagotchi, the popular egg-shaped toys from the ‘90s that housed digital pets requiring real-time care and attention. Kim’s goal was to bring a similar experience to physical objects in our lives. “We bring this joy of caring from virtual to physical objects,” she tells WIRED. While folks have encouraged Kim to sell OATs kits online, she hasn't decided whether to pursue it as a business opportunity.

#OATs#Carnegie Mellon University#Future Interfaces Group#Google Gemini#ESP32-S3

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.