A lot of guys would kill to have your problem! This ladies and gents, is what genetics is all about. When it comes to building a crazy muscle, guys often have a great foundation like this guy does with calves. Where there are some guys that can't get them to grow, no matter what.
Heres my thought. This is bodybuilding. Key part of that is "building". So instead of trying to shrik a muscle down, why don't you work on getting the other surrounding muscles bigger so that everything flows together? Focus on building some quads and hams and then your calves will match. In the process, avoid doing any direct calve work so that they may stay the same size while the upper legs grow