I have a peach tree and blueberry and raspberry bushes that did quite well this year but they have some very large branches that had no fruit. Should these be cut off since they are taking energy from the branches that did?
It is an erroneous concept that leaves or branches that are not producing fruit are taking energy from another part of the plant.
Those leaves are producing energy just like the leaves on branches with fruit. That energy is actually being transferred to the fruit just like nearby leaves
The only branches of blueberries that should be removed are brown, dead ones.
Occasionally, extra long branches are shortened to shape plants. New branches do not always bear fruit the first year but will have fruit the second year.
This is also true for raspberries. Raspberry canes die after the second year. Dead canes that do not develop leaves in the spring should be removed at ground level.
There is no benefit to shortening the live canes back to an arbitrary height such as 5 or 6 feet. Canes can be bent down to pick higher fruit.