You have a choice. You can be an asshole manager, or you can be a respected manager. If you mistreat the guy, other workers will notice it and distrust you. My recommendation is you try your best to find the best spot that matches this guy's skills and get the highest quality work he's able to deliver. Holding grudges will just give you ulcers.
The wheel of life turns. One day he may be YOUR boss.