If someone is from Georgia, grown up with fried chicken and grits, that person is no more inherently "right" or "wrong" than someone from Washington State with their apples and cherries. Do you like New York foldable pizza better than Chicago's thick-crust pizza? Fine. Do you like Texas spicy baked beans better than Boston's sweet baked beans? OK. Neither is right or wrong, just personal preference, and someone should be neither qualified nor disqualified from public office on the basis of such personal culture.
Similarly, is not voting for someone exclusively because of skin color or gender the very definition of racism or sexism? I have no problem with a person being elected (or "confirmed", as the case may be) to office, who may happen to be of a particular heritage or gender, but nobody should be elected or confirmed primarily because of such bias.
Voting for such a person in large part because of a bias is just as bad as voting against the person because of a bias.
A Senator who confirmed Judge Sonia Sotomayor primarily because she has a Latina heritage is just as bad as someone who voted against Barack Obama just because he's black. There is no difference.