Obviously it depends on whether you think the risk of Duffy getting injured is higher than the added value we'd get from the valuable game time where Goldson and Duffy get to play alongside each other.
It's not just the risk of an injury but the risk of a red card. Only way I see Duffy starting is if Uwe isn't fit.