@matthewades Hi OP, generally it is a good idea to clear off the highest interest debts. Some may even advice you to aim for higher return investment.
Since 6% return still offset your 4% interest. But as you said, the debts are you main stressors, so paying off the debts first may be more...