Sir,
I have boxed with tall, huge and massive people in sparring and training. I am myself tall, but when i faced 6'2 and above, all i had to do was to duck under a Cross punch (right arm punch), get on their right side side and hit them with a jab (on their face if uncovered, or on their ribs if uncovered- had to choose which one is uncovered) or if lucky get on their rear with one leap using my left foot and box at their neck from back. By the time they turned, i had hit them one or two good scoring shots. Don't worry- there are techniques to fight any sort of height,weight and class.
As for climbing a ladder, have you been in an assault course ? Anyone can use a leg to climb a wall, roll over it and land in fighting posture on the other side. You don't need a ladder.
This guy is a huge target, he will expose a lot of himself even if he ducks. His silhouette will be different from the rest of the team, even in darkness or against the wall, going in for the kill. His reach for throwing grenade maybe more - but he can compromise the team. If on a mission BEL or in difficult terrain like Siachen, true that he can lift more combat equipment than others but he will eat more rations than others for keeping his body temp warm or stabilizing it. For med evac or lifting a wounded soldier, there are techniques that soldiers even with height 5'5 or 5'6 can lift wounded soldiers who are heavier or taller than themselves.