While you're right that the sights are not going to slow you down, we're actually talking about "point shooting". The next time you go to the range, try it. You'll be amazed at how 70 year of pointing your finger at things has taught you to also point a gun well.
Here's an exercise I use. Standing about 3 feet from the target, draw your weapon, fire two rounds and step back 2 paces. Fire two more rounds and step back again. Fire two more then holster your weapon. Your aiming point is center mass or the center of the target. The exercise is to simulate self preservation in a confrontation. Try it again, only this time step to the right as well as back, or to the left.
I'm not trying to talk you out of the sights or to convince you of anything. With the possible exception of relying on the sights. Night sights are a great addition to any gun, but one should never learn to depend on them.
BTW, you're only 5 years older than me.