NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
Paper Tape Is All You Need – Training a Transformer on a 1976 Minicomputer (github.com)
kristopolous 39 minutes ago [-]
I like how the author's "modern" machine to connect to it is still 20 years old.

With a concave trackpoint, respect.

BTW, I nag Framework at every conference I go to that people want this shell and keyboard. It's been years. I think it's time to go through the effort to figure out how to do the production run of the case myself. Framework actually wants people to do things like this but you know, manufacturing is hard. Anyone wanna help?

arglebarnacle 2 hours ago [-]
Fascinating. We hear that the leaps in AI have been made possible by orders of magnitude increases in compute and data availability, and of course that’s substantially true—but exactly how true? It’s a nice exercise in perspective to see how much or how little modern machine learning methods would have been capable of if you brought them by time machine to the 70’s and optimized them for that environment.
kmoser 32 minutes ago [-]
> I don't have an actual paper tape reader, so the object code is directly deposited in memory through the console.

So, really, a Turing Machine is all you need?

rahen 2 hours ago [-]
Thanks for reposting! I'm the author of ATTN-11. Happy to answer any questions about the fixed-point arithmetic, the PDP-11 hardware, or the training process.
functional_dev 50 minutes ago [-]
Incredible work! Fitting transformer into 32KB RAM is crazy

For those who read this project and do not know PDP-11 it could be hard to understand that working with these memory limits is difficult. Here is visual guide for PDP11 architecture - https://vectree.io/c/pdp-11-hardware-architecture

Thanks for this amazing project!

PaulHoule 11 minutes ago [-]
That PDP-11 was the most fun minicomputer of the late 1970s in my opinion. Growing up in NH about an hour north of Digital's HQ all sorts of schools from primary to secondary as well as museums had PDP-8, PDP-10, PDP-11 and later VAX machines.

The PDP-11 had a timesharing OS called RSTS/E which could give maybe 10 people a BASIC programming experience a little bit better than an Apple ][. If you were messing with 8-bit microcomputers in 1981 you might think a 16-bit future would look like the PDP-11 but the 1970 design was long in the tooth by 1980 -- like 8-bit micros it was limited to a 64kb logical address space. Virtual memory let it offer 64k environments to more users, but not let a user have a bigger environment.

AnimalMuppet 2 hours ago [-]
Woah. Dude has a running PDP-11/34 in 2026? Personally, I find that more impressive than the program.
rahen 1 hours ago [-]
That thing is a Tamagochi though, it constantly needs attention, pardon the pun. I did most of the development and tuning on ll-34 for that reason.
budman1 32 minutes ago [-]
I am a bit surprised, but I guess everything eventually wears out.

In the 1980's I worked as a field engineer that supported a lot of pdp-11's. They were very reliable for the time; tape drives and disks were the #1 maintenance items. To actually have to open up the processor and change a board was not a regular activity.

Other machines of that era, like those from Gould or Perkin/Elmer or DG gave regular practice in the art of repairing processors.

Guess I expect them to work forever. Like a Toyota.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 15:24:33 GMT+0000 (Coordinated Universal Time) with Vercel.