You can use a less demanding i.e. higher input impedance component(s) downstream, including putting some kind of active preamp in front (which might also hurt SQ to some extent). Or, you could build/buy some kind of switch to disconnect the output you are not using, e.g. SYS works for RCA. Would be a PITA to do this twice, so something DIY might be better. Which DAC, and what do you have it connected to?