The color of the fat in beef is controlled by what they eat. Grass fed cattle will have yellow fat (dairy cows), grain fed cows will have white fat. (Beef cattle)
    I assume that the same may hold true with deer. I've cut them with both types of fat and have never heard of any difference  in the taste of the meat. 
    In Michigan it is legal to bait and/or feed deer so most have white fat because of the Smorgasbord of food available.

Dave