From what I understand, there is somewhat of a threshold in terms of how much fructose can be digested in your gut vs requiring your liver to get involved. It depends on a lot of factors (body size obviously, your overall calorie intake, some genetic factors, etc), but in general of you're only consuming a few grams of fructose and it's buffered by fiber, you're probably not exceeding that threshold. Fruit fits that bill, unless you're being weird and consuming a whole lot of sugary fruit.
There's a very good interview on the topic here: https://youtu.be/V02z9mqTWzg