When I am dead, I hope it is said;

You don't just rebind it? Who uses caps lock anyway?

Oh I'm so happy now that you reminded me of this; I found the original Johnny Zweig caps lock rant from Usenet, circa 1989 (I loved it so much I printed it out on the Printronix in Terry Hall and taped it to the door of the terminal room...)
http://groups.google.com/group/alt.peeves/browse_frm/thread/5abd6c108aec2a86

Hell, I'll just reproduce it. It might be my favorite Usenet post ever (well, except anything Clay Bond(Asmodeus) wrote in alt.flame, but that's a special case...)

I don't know why it hasn't made it to alt.peeves yet, but one of my most
cherished and encouraged pet-peeves is the existence of such a useless,
stupid, nasty, treacherous and evil menace to the progress of humankind
is the CAPS LOCK KEY.

Anyone who has used vi will know that there is no easier way to fuck
up a document than to JJJJJ when you meant to jjjjj. And then there's
those times whEN YOU ACCIDENTALLY HIT THE SONOFABITCH IN THE MIDDLE OF
A SENTENCE. Or if you program in a language other than FORTRAN. Or if
you want to type command names in UNIX. Or.....

In my estimation, the only sensible place for a Caps Lock key would be in
a fairly deeply recessed hole in the back of the monitor, or, preferably,
in another room altogether.

I mean, what the hell is the point of equipping every goddamn keyboard on
the planet with a key that is only used deliberately about 1% of the
times it gets hit? Why not just a "Fuck Things Up Randomly" key? What kind
of stupid moron jackass would sell a piece of equipment with anything so
thoroughly evil right there on the important part? And while I'm in a mood
to name names, I think Sun should be shot for not only having this
abomination in the sight of the Lord on every keyboard, but it doesn't have
tactile-feedback (i.e. click-down/click-up like sensible keyboards), has
no LED to notify the unsuspecting typist of the shit s/he's just gotten
him/herself into. Just because they have nice workstations, people are willing
to put up with this nonsense. Christ! What the hell kind of twisted mind
would perpetrate a crime of such immense proportions on an unsuspecting
public? I suspect Foul Play, and corruption and treachery at very high
levels.

Then again, I just tell my Xdesktop to change the keyboard-mapping to return
to God's cherished mode in which hitting that stupid little fucker DOES
NOTHING AT ALL. SEE HOW NICE IT IS?

-Johnny When-I-want-caps-I'll-hit-the-fucking-Shift-key

less than three