I used to get such ingrown hairs a LOT. Things that I've found help tremendously:

1) Shaving in the shower... hot steamy air seems to help.
2) Using a shaving brush and a good shaving soap... the mechanical action seems to be a great preventative.
3) Using the shaving brush and soap to wash my face immediately after shaving.