Do you guys not downshift and use engine braking when you're going downhill?
I tow my rig pretty regularly (~6k between rig and trailer) without trailer brakes, with a stock '98 Tahoe (350 vortec, 4l60e, 4x4) and as long as I take it easy I don't have to use my brakes much, don't get brake fade and it doesn't get scary on me. Not that trailer brakes aren't a very good idea, just sayin I don't think you will die without them.