Ok, so you understand that fruit is not required to build muscle at all. So the simple answer to your actual question is "then don't eat fruit – it won't affect your muscle building at all".
The slightly more advanced answer would be to substitute veggies for fruit. Might depend on your allergies. All fruits? Some fruits? Fruits and veggies too?
But it sounds like what you are really asking is what should you snack on if you are trying to build muscle.
Well, there the answer is "don't snack". Eat 6 actual meals a day (possibly small meals depending on your size and goals). But by a meal, I mean a lean protein and a carb or a lean protein and a fat.
For "small" meals that are convenient, how about
– almonds, a glass of milk and some celery
– a glass of milk, a cold chicken breast you cooked the night before, and a carrot
– a low-fat, low-sugar yogurt with grape nuts cereal