It’s like the classic essay, “Why Jonny Can’t Code”.
I remember entering program listings from computer magazines into the Vic 20 as a kid, then modding them to make new things. But still, it was a minority of kids who had a computer back then, and even most of them (and myself most of the time) would just play games rather than write games.
The difference now is that everyone has a cell phone, but it’s still only a small minority that care.
The mad “gold rush” mentality towards AGI is nerve-racking. I’m reminded of Protogen’s attitude towards the Protomolecule in The Expanse.
I figured we still had 5-ish years to figure it out, but the rapid progress against HLE (Humanity’s Last Exam) makes me nervous.
But sure, let’s just rush headlong towards the precipice, how hard can alignment be really? My anxiety about the future and the importance of getting this right are not eased by people scoffing because “just count the fingers!” When the field is changing so fast, looking at what was going on a few years ago isn’t helpful.
Well, past my pay grade.