They open-sourced a crippled version of sesame (1B)
not the one they're using in actual demo
stevev 326 days ago [-]
A16z won’t allow it. For them there is Money to be made.
drivebyhooting 326 days ago [-]
Very disappointing.
theoryofx 326 days ago [-]
Really is. Seems like they lost their nerve. Their credibility is in the toilet now. Clearly not good faith actors.
Which is a shame because seems like there's a real opportunity to really shake things up with an open voice model that's competitive with the proprietary ones.
Oh well. Someone else will do what they claimed to want to do.
is there any reason why it inserts multiple-seconds-long awkward pauses into the output? are you seeing that behavior in your example? (on a 2021 M1 Max MBP)
simonw 326 days ago [-]
Oh interesting, no I haven't spotted that. I'm on an M2, but I haven't spent a great deal of time poking at it with longer inputs.
thegrim33 326 days ago [-]
The Sesame demo is really impressive but the fact that they record and review your conversations make it a complete non-starter for me to actually use it. I can't feel comfortable knowing some person could actually listen to everything we say. Open sourcing it is great so I could self-host it, although it seems like you can't quite get to something similar to the demo from this so I'm not sure what the point is.
zhyder 326 days ago [-]
Any provider already hosting this (similar to how many providers host Whisper for STT)? Looks like doesn't support streaming tho (same with Whisper coincidentally), but great to see open models get so much better.
nshm 326 days ago [-]
It is useless actually. Very slow and quality is suboptimal and it is just speech generation component. See discussion here:
This just goes to show that, especially with Voice AI, people should be thinking in terms of "systems" not "agents". Sesame claims this slow barebones base model is what their demo is built around. Regardless of if that's true or not, it is true that there's a whole lot more that goes into a slick demo like Sesame's Maya and Miles than just hooking up a few models together.
learncomputer 326 days ago [-]
Neat project! How does it handle different accents or speech speeds—does it need a lot of training data for that? Excited to see more open-source stuff in this space.
low_tech_punk 326 days ago [-]
OpenSeasame would be a great project name!
Rendered at 12:40:55 GMT+0000 (Coordinated Universal Time) with Vercel.
They open-sourced a crippled version of sesame (1B)
not the one they're using in actual demo
Which is a shame because seems like there's a real opportunity to really shake things up with an open voice model that's competitive with the proprietary ones.
Oh well. Someone else will do what they claimed to want to do.
You can run it with uv like this:
is there any reason why it inserts multiple-seconds-long awkward pauses into the output? are you seeing that behavior in your example? (on a 2021 M1 Max MBP)
https://github.com/SesameAILabs/csm/issues/80