So what happens when there is too much sugar in your diet? Well, a lot. Too much sugar can affect your mood, weaken your body’s ability to cope with stress, and increase your risk for developing depression. Cutting back on sugar can trigger withdrawal symptoms like anxiety, irritability, confusion, and fatigue (Lindberg, 2020).