Hi Byron!
Why not try your idea and see how it works for you - you may find you can manage.
However if you are working /P and QRP you'll most likely find find that contacts come quite slowly and you'll have plenty time to use a simple note book and write down the details, put down your pen and start keying.
Another possible alternative is to use a mini recorder with VOX and record yourself saying callsign, RST etc though this would mean you'd have to remember the callsign when replying and on overs rather than looking at notes, and if your memory is like mine it isn't such a great idea !!!
72,
