Clearing cached recipient addresses in Mac OS X Mail

In Mail, choose Window → Previous Recipients. Mark the ones of interest and press Remove From List.