For example, I have several posts that explain concepts in detail, with supporting images. They're written in Markdown, and I keep refining them until I'm confident that the average person can read them and immediately understand the concept.
The problem is that text is becoming a less popular medium for learning, while short form videos are increasingly being used to explain the same ideas.
From what I can tell, this tool only lets you provide a prompt. Can it turn my existing Markdown posts and images into videos, or is it mainly intended for generating videos from simple prompts? I'm looking for something that preserves the explanations I've already written rather than creating something entirely new.
faangguyindia 3 days ago [-]
it works, but can u add different style of videos like this one:
These are the two styles that consistently keep me watching. I can't really describe them well in words, so I linked the videos directly to avoid losing important details in the translation from visual format to text.
Maybe someone with more experience in video production can explain what techniques are being used here and why they're so effective at holding viewers' attention.
gpt5 3 days ago [-]
They cut to the next scene a moment before the next sentence, and they cut to the next sentence before the last word finished (i.e. no periods between sentences).
pw 3 days ago [-]
So this is really just a kinda proof of concept, but I'd be pretty easy to turn it into what you want. It sounds like you've already got both basically a script and images to go with it?
faangguyindia 3 days ago [-]
Your project reminds me of something I built a while ago using Pollination.ai for images, Gemini Flash for script / captions / inserting transitions and all other editing, Google Cloud TTS for narration/voice, and FFmpeg drive by flash, back then Gemini Flash 2.5 (free) is what i used for these experiments. The result looked like this:
I wasn't happy with how it turned out, so after making 3–4 videos I dropped the idea.
Later, I came across several different video styles that consistently kept me watching. That's when I realized what my videos were missing they simply didn't have the same ability to capture and hold attention.
But i never managed to generate those styles after dozens of attempts and gave up.
nickvec 3 days ago [-]
Fun idea! Hope it doesn't cost you too much to keep up depending on how much traction this thread gets ;)
One small quirk I noticed with the generated short video: for each new slide/photo, there is a very gradual "zoom in" effect that occurs, which causes text to jitter a bit and is a bit disorienting. Not sure if that is specific to the "The Great Molasses Flood of 1919 in Boston" prompt I used or not.
Also, is Claude involved in the video generation itself? I noticed the generated video has "By Claude" in the top left corner, but the logs seem to indicate that only GLM-5.2, Gemini Flash, and GPT-4o are involved (just curious!)
pw 3 days ago [-]
Yeah, that's suppose to be a Ken Burns style zoom but I haven't figured out how to stop the shake the should probably just remove it. And I need to remove the "By Claude" too. That's a remnant from porting from my internal framework for the [By Claude)(https://www.youtube.com/@byclaude) Youtube, TikTok, etc channels.
Quotations from Chairman Mao Tse-tung (Short form)
The audio narration is great and the documentary is accurate. Improvements could include more pictures or animations.
This is a very great tool and framework! Thank you so much.
pw 3 days ago [-]
No, thank you for trying it!
f055 3 days ago [-]
You could probably make your infra cheaper if you sent the generated slides to the web client and use some js ffmpeg wasm to compile the video in the browser. This way you could probably use the cheapest VPS to handle this.
albert_e 3 days ago [-]
Currently getting errors
---
File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
result = self.fn(self.args, *self.kwargs)
File "/home/ubuntu/byclaude/video/harness/pipeline/pipeline.py", line 829, in build_clip
clip = round(dur + TAIL, 3)
TypeError: unsupported operand type(s) for +: 'NoneType' and 'float'
Video build failed (pipeline exit 1) — please try again.
Powered by AI · by Claude · ~
pw 3 days ago [-]
Should be fixed now
eckelhesten 3 days ago [-]
It’s an interesting concept, perhaps it could go more from ”narrated slide show” to ”video clip” in the near future if it doesn’t cost too much.
pw 3 days ago [-]
Yeah I'd been thinking of Gemini Omni for that but it adds about 10 cents per second of video, so not cheap.
ramon156 3 days ago [-]
Cool idea! Looks like my prompt is stuck, though. Might be an idea to provide a share link at the moment of hitting the button so you can check back later, because if I close the tab I will lose my prompt
pw 3 days ago [-]
Yeah the disk on the instance filled up and it was down. Sorry. It's up again now.
pw 3 days ago [-]
I'm around to answer questions or receive feedback if anyone as any!
urbnspacecowboy 3 days ago [-]
Please, pretty please, link some pre-generated examples.
pw 3 days ago [-]
On it!
djdndnjdf 3 days ago [-]
[dead]
bitelchux 2 days ago [-]
Could you publish the source code or how to do it for our sueltes?
pw 3 days ago [-]
Ugh looks like I'm hitting my Gemini Tier 1 usage limits. Sorry!
pw 3 days ago [-]
Fixed!
ms7892 3 days ago [-]
Image not generating?
pw 3 days ago [-]
Fixed!
pw 3 days ago [-]
Working on it!
mellosouls 3 days ago [-]
I'm guessing its being hugged now - it says generate in under a minute but my short is taking ten minutes and counting; anyway I like the simplicity and am interested in seeing the results - though I do think it is quite depressing as we will see this sort of service mostly put to use for slop.
pw 3 days ago [-]
Hi! Sorry yeah, I'm been bumping up against rate limits, but it should be working again now!
mellosouls 3 days ago [-]
Ah great yes just tried it, nice and simple!
I think that simplicity is its main selling point at the moment as its otherwise a pretty crowded marketplace.
Best of luck with it, however you decide to progress it.
pw 3 days ago [-]
Thank you! Simplicity and speed were exactly what I was going for.
jazzyjackson 3 days ago [-]
Did you really rent a 64 vCPU EC2 without exploiting ffmpeg GPU acceleration?
pw 3 days ago [-]
I'm no expert here and was working w/ GLM-5.2, but whatever rendering we were doing ended up being CPU bound.
gosun 3 days ago [-]
[flagged]
Rendered at 23:17:02 GMT+0000 (Coordinated Universal Time) with Vercel.
For example, I have several posts that explain concepts in detail, with supporting images. They're written in Markdown, and I keep refining them until I'm confident that the average person can read them and immediately understand the concept.
The problem is that text is becoming a less popular medium for learning, while short form videos are increasingly being used to explain the same ideas.
From what I can tell, this tool only lets you provide a prompt. Can it turn my existing Markdown posts and images into videos, or is it mainly intended for generating videos from simple prompts? I'm looking for something that preserves the explanations I've already written rather than creating something entirely new.
Style 1: https://www.youtube.com/shorts/vGjrv2zjfsM
Style 2: https://www.youtube.com/shorts/6KoRHpAZ4zk
These are the two styles that consistently keep me watching. I can't really describe them well in words, so I linked the videos directly to avoid losing important details in the translation from visual format to text.
Maybe someone with more experience in video production can explain what techniques are being used here and why they're so effective at holding viewers' attention.
https://www.youtube.com/shorts/IhGR8AC3a_g
Uploaded on sep 24, 2024.
I wasn't happy with how it turned out, so after making 3–4 videos I dropped the idea.
Later, I came across several different video styles that consistently kept me watching. That's when I realized what my videos were missing they simply didn't have the same ability to capture and hold attention.
But i never managed to generate those styles after dozens of attempts and gave up.
One small quirk I noticed with the generated short video: for each new slide/photo, there is a very gradual "zoom in" effect that occurs, which causes text to jitter a bit and is a bit disorienting. Not sure if that is specific to the "The Great Molasses Flood of 1919 in Boston" prompt I used or not.
Also, is Claude involved in the video generation itself? I noticed the generated video has "By Claude" in the top left corner, but the logs seem to indicate that only GLM-5.2, Gemini Flash, and GPT-4o are involved (just curious!)
Quotations from Chairman Mao Tse-tung (Short form)
The audio narration is great and the documentary is accurate. Improvements could include more pictures or animations.
This is a very great tool and framework! Thank you so much.
---
File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run result = self.fn(self.args, *self.kwargs) File "/home/ubuntu/byclaude/video/harness/pipeline/pipeline.py", line 829, in build_clip clip = round(dur + TAIL, 3) TypeError: unsupported operand type(s) for +: 'NoneType' and 'float' Video build failed (pipeline exit 1) — please try again. Powered by AI · by Claude · ~
I think that simplicity is its main selling point at the moment as its otherwise a pretty crowded marketplace.
Best of luck with it, however you decide to progress it.