I guess these days, I try to do what you did. But, instead of carrying written directions, I'd refer to my phone/maps for any clarifications, detours, etc.
Once I have the general feel of a route (especially a fairly short one like the one you were seeking), I guess I just sort of wing it. With a destination address written down someplace, of course.