And by the way, we already have the app that you can use to control the robot at distance, so you can use the skills you taught it remotely as you make it navigate your home!

On the fact it would get bricked if the company goes under, note that our agent runs on other clouds so it's very easy to run if the company goes under - we would open-source it. But if you're not in the US we can't easily ship it to you for the first batch anyway :)

We do a lot of it with off-the-shelf components, and we design the whole system so that we can quickly iterate, manufacture and ship from our garage in Palo Alto.

You're not the first person to ask me this! If you look closely, there is actually a camera on the arm (that's partly how it learns tasks so fast) and we can use it to take pictures too. You can definitely define a primitive that would be "take picture", another one that is "send to server" and then have your own software assemble it in the way you want. Or just record and send it to the cloud / your computer.

Now if it's about using a better camera that the robot would hold, you'll need to wait for the next generation that we'll reveal later next year

For this small form factor (25cm high), here is what we foresee (and it's a small subset of what's possible).

- Picking up trash and moving it away.

- Tidying up the floor after your kids (moving toys away), so that a roomba could clean - or a version of Maurice with a vacuum.

- Watching for burglars / other surveillance tasks, and sending you an email or notification if it perceives someone or something fishy.

- Greeting you in the morning, waking you up, telling you about your emails.

- Playing with you or your kids: Hide and seek, Tag, Simon Says, Easy board games... Maybe this one is a bit of a stretch at first, but I could see it play Connect Four?

- Taking pictures. I had multiple folks tell me they would like the robot to go around at home events, take pictures, and assemble them / put them somewhere in the cloud after. This should be pretty straightforward to do!

- Check in on your kids or elders frequently, see if they are okay. Especially this second one is very important to us. You could then define a primitive to send you an email or notification is something's wrong. Or a daily recap of the people did, with pictures. And ask the robot remotely to do something.

For many of these use-cases we will post videos in the coming months about how to do them, as the AI and software gets more reliable.

For bigger robots running on the same system we develop (we have a bigger robot to reveal later), that would be:

- Folding laundry, putting dishes in the dishwasher, cleaning countertops, tidying up the place... Chores-type tasks

- Service robot bringing you food and drinks

- Cooking. This one will come once it's safe enough, you want to be careful especially when there's heat involved, or liquids.

Sky is the limit for this technology, but the bottleneck is data. The more data there is, the faster it will learn and the more complex the tasks. We can't promise all of these are possible now, but it will get there faster than people think. You can look at research papers from our labs, like Universal Manipulation Interface or ALOHA, for existing physical use-cases.

EDIT: I say LLM but it's really not just an LLM. From the outside perspective it looks like it because we decided to do so, but under the hood it's multiple models (as described in the post)

It's also pretty rare to find HRI people, so I'm very happy to chat further if you're interested (there's a Discord link in the docs and on the website)

This is how it started for us too! Check this out: https://x.com/ax_pey/status/1853462975216234851

And like you did, a SAM + VLM is the first thing we tried and it felt high-potential already. It takes a lot of software work to put the right pieces together though, but we think we now ended up with something promising, scalable and extendable for a lot of people.

And on the price: same, our initial prototype was around $250 but I had to connect it to my computer. It's unclear to many others in the field whether we'll be able to offload compute with latency low enough to a computer somewhere else in the house or even in the cloud. In the meantime at least, we decided to have onboard compute so that you can get started quickly. Even for you it would be useful, just because we did the work of putting all the hardware and electronics together, it's a pretty good computer onboard :)

And yeah it's a powerful architecture, but it's not enough if you want to perform task, the VLMs orchestrate but you need another model for manipulation. And we put all of these together :)

Happy to chat further!

Thanks for the comment though, means that we should make it clearer maybe?

On types of tasks, we're envisioning chores first. So laundry, cleaning, tidying up, dishes etc... That should be the primary focus for this category of robots. But we're very open to other tasks, we know some folks have expressed desire for more interactive kinds of tasks. In another comment I described multiple categories of tasks that folks have expressed interest in. You can find it by searching for "here is what we foresee" on this page

- Battery life is like 3-4 hours on a very high intensity usage. Most likely that should last a whole day once we start optimizing :) It's a big battery for now

- Yes we will allow full control. We don't intend to lock folks in our ecosystem, and if you look at the SDK you can see that you could actually train your own policies and just trigger them on the primitives. You could even scrap the whole agent, but then we think you lose a lot of the value of it, but why not?

Apart from the cloud agent, most of the code will be open source anyway!

Maurice is our base machine. We're going to open source the design and hardware so that users can change it - for example switch the gripper with something more complex or a different end-effector. Is that what you meant?

We're also working on a bigger one, which will be able to reach tabletops for example. The idea is as much to create a really powerful robot for the home as showing our brain can work in different bodies.

Ideally our software should power all kinds of robots easily but it needs a lot more training data, and right now it still plugs in standard classical robotics software for some tasks, because it can't control everything immediately. But for example, provided they give us the right interface, iRobot and other Roomba manufacturers should be able to use our AI to make their robots instantly smarter. We can also put it in Unitree dogs (go2 for example). But one thing at at time :)

Once it is, we'll be able to get rid of it and do everything on edge. In theory it's already possible, but the time it takes to run large models would make the robot look inactive most of the time, and not even remotely reactive enough to handle the real world.

But really, that's our goal

The Fall one just ended, and we were 93 companies presenting at Demo Day (vs ~250 during the summer).

I think though that it's very clear that it's sped up a lot at some moments. Plus, you can sort of see it at the speed of the messages on the left.

But you're right, for the sake of transparency we'll figure out a way to show it better.

EDIT: For the sake of transparency I can already tell you that it's sometimes sped up to 10x, mostly when it's navigating cause the robot hardware is slow. And by the way, the version we'll ship in February has a much faster drive train.

The first, small platform you see here is a first product but we're aiming bigger

Here, this was a suboptimal decision by Maurice, and by default we indeed have it avoid making costly mistakes. But consider all the good decisions the agent did otherwise: navigating in all these different rooms with no prior knowledge of where anything is (just pictures it took earlier), close to the glass where Vignesh was, back to Axel, back to bed at the end...

And here's the thing: every time an LLM provider releases a new model, Maurice gets better. We haven't even started fine-tuning the agent yet but that will also improve its decisions a lot. There's many many low hanging fruits to make it able to make better decisions, and we expect that in the coming months the system will quickly get smarter and faster.

If someone wants to train a physical task the data is sent to us for training, so we would not allow this.

And even if you somehow did that, the brain itself has knowledge of what it task is and what to do with it, and since it's running on very smart VLMs trained by the best labs, I expect they have protections naturally (on top of ours)

We'll have to write a guide to explain how to plugin our AI agent, but it can work on any hardware for which the base controls display the right interface.

If you want to chat more about what you need feel free to join our discord!

On your example: You can also teach it to fill the glass with water before going to the plant.

And you're right, this is not even close to something the mass public would use, but that's not our goal for now. Right now this is for people who want to make robots, and the value proposition lies in the method to teach it and see what you can make of it. It's our job to make something that learns fast enough that it actually feels useful to our customers.

I take from what you said that the website does not make it clear what the use-cases are, so we'll make an effort on that. Although it's a goal for us to market this clearly right now as a builder's tool, and I don't want to make it seem like we're already at mass-market capability.

I added in another comment a list of use-cases that are already / will be possible, I can't put a link to it though but you can find it by searching on the page for "here is what we foresee" :)