Well if you spend too much time sitting and don't reduce your calorie intake to match, you get fat. Being fat generally does bad things to your health, and one known example of that is that being fat reduces your fertility.
Being fat correlates with reduced fertility. It may ultimately be caused by whatever thing that results in reduced fertility, but there is no evidence of being fat causing reduced fertility.