DAC A/B Test Procedure Question?

Discussion in 'Digital: DACs, USB converters, decrapifiers' started by TMoney, Nov 14, 2015.

  1. TMoney

    TMoney Shits on SBAF over at Head-Case to be cool

    Joined:
    Sep 27, 2015
    Likes Received:
    760
    Trophy Points:
    93
    Location:
    Sausalito, CA
    Hey, all.

    I'm trying to set up an A/B test between a few DACs using my preamp and I wonder if there is anything wrong with my procedure.

    Right now I have the DACs set up like this:

    • DAC A (which IS a renderer) plays FLAC files off my NAS. DAC A has digital outs. DAC A is connected to input 1 of the preamp with a balanced connection.
    • DAC B (which IS NOT a renderer) is connected to DAC A via coax to DAC A's digital outs. DAC B is connected to input 2 of the preamp with a balanced connection.
    • The preamp is connected to an amp via its balanced outputs.
    Assume for the sake of argument that both DAC A and DAC B output at the exact same volume.

    Is this a valid way to A/B test these DACs?

    Is there any reason to believe that using DAC A to play files and output a digital signal to DAC B will effect or color DAC B's performance?
     
  2. purr1n

    purr1n Desire for betterer is endless.

    Staff Member Pyrate BWC
    Joined:
    Sep 24, 2015
    Likes Received:
    90,083
    Trophy Points:
    113
    Location:
    Padre Island CC TX
    Yes. The source of the digital does matter 25%-60% of the sound. I had several CD transports and a USB to AES converter. They all sounded different through the same DAC. I know it's hard to believe.
     
  3. TMoney

    TMoney Shits on SBAF over at Head-Case to be cool

    Joined:
    Sep 27, 2015
    Likes Received:
    760
    Trophy Points:
    93
    Location:
    Sausalito, CA
    Well, I'll have to borrow a second laptop then and connect both via USB and try and sync the tracks.
     
  4. purr1n

    purr1n Desire for betterer is endless.

    Staff Member Pyrate BWC
    Joined:
    Sep 24, 2015
    Likes Received:
    90,083
    Trophy Points:
    113
    Location:
    Padre Island CC TX
    What about volume matching?
     
  5. TMoney

    TMoney Shits on SBAF over at Head-Case to be cool

    Joined:
    Sep 27, 2015
    Likes Received:
    760
    Trophy Points:
    93
    Location:
    Sausalito, CA
    As I said above, assume volumes are perfectly matched for the sake of argument.
     
  6. purr1n

    purr1n Desire for betterer is endless.

    Staff Member Pyrate BWC
    Joined:
    Sep 24, 2015
    Likes Received:
    90,083
    Trophy Points:
    113
    Location:
    Padre Island CC TX
    I guess you could build a resister ladder to get the devices output to match. Sort of a pain and something I had to deal with. Some crazy people will tell you that your test is invalid if you can only get 0.2db match.
     
  7. SKiring

    SKiring Friend

    Pyrate
    Joined:
    Oct 3, 2015
    Likes Received:
    203
    Trophy Points:
    43
    Location:
    Rotterdam
    If this is Bifrost Multibit by chance, measure it, seriously up until 0.1dB both me and @paranoidroid were able to find the differences with long periods of listening. Out of the box it seems to be 0.8dB and that was clearly noticeable on my end of testing.
    Sub 0.1dB was our aim at least which made the test significantly harder. On the plus side until 0.3dB counts as volume matched according to the pure objectivists... Don't ask me how to measure however, friend of mine did all that, I was just the guy with the equipment and mostly the listener haha.

    Also not to discourage at all, I think it's a lot of fun, just a heads-up in what I've learned so far in my Bifrost Multibit experience.
     
  8. purr1n

    purr1n Desire for betterer is endless.

    Staff Member Pyrate BWC
    Joined:
    Sep 24, 2015
    Likes Received:
    90,083
    Trophy Points:
    113
    Location:
    Padre Island CC TX
    If you are using pots / volume controls, they can drift over time. 0.1db consistently can very difficult to obtain with mechanical devices. Did you measure the volume differences after the test? If not, your test was invalid. (Just in case you were wondering, I am saying all this is jest.)
     
  9. SKiring

    SKiring Friend

    Pyrate
    Joined:
    Oct 3, 2015
    Likes Received:
    203
    Trophy Points:
    43
    Location:
    Rotterdam
    He did indeed, we made sure after each session to do another measurement to verify or readjust. This test took two full days of switching around and playing around, including prolonged sighted/relaxed listening of course.
     
  10. TMoney

    TMoney Shits on SBAF over at Head-Case to be cool

    Joined:
    Sep 27, 2015
    Likes Received:
    760
    Trophy Points:
    93
    Location:
    Sausalito, CA
    The exact volume matching will come. I'm try trying to make sure I have an apples-to-apples comparison with the DACs first.

    Now that I have a preamp that can switch inputs nearly instantly I want to see if I can (poorly) recreate the experience blind-testing DACs as part of Tyll's big sound project.

    Getting two DACs synced up perfectly on equal footing is step one. Matching volumes will be step two.
     
    Last edited by a moderator: Apr 1, 2016
  11. purr1n

    purr1n Desire for betterer is endless.

    Staff Member Pyrate BWC
    Joined:
    Sep 24, 2015
    Likes Received:
    90,083
    Trophy Points:
    113
    Location:
    Padre Island CC TX
    But some will say your preamp will kill the resolution of the DACs. Actually I will say that too. :) Unless it's passive.
     
    Last edited: Apr 1, 2016
  12. TMoney

    TMoney Shits on SBAF over at Head-Case to be cool

    Joined:
    Sep 27, 2015
    Likes Received:
    760
    Trophy Points:
    93
    Location:
    Sausalito, CA
    Ha!

    It isn't passive. The active vs. passive pre is a discussion best had elsewhere.

    I'm not really interested in universal truths about DACs here. More how they play in my particular setup.

    The preamp (Pass XP-10) is going to be driving power amps. It is going to be the center of my setup whether it kills resolution or not.
     
  13. TMoney

    TMoney Shits on SBAF over at Head-Case to be cool

    Joined:
    Sep 27, 2015
    Likes Received:
    760
    Trophy Points:
    93
    Location:
    Sausalito, CA
    Well, I've been listening to both DACs connected via USB (eliminating the problem of using one as a renderer) and... well... next time I see the bay area SBAF group I'm going to have to let you guys take the challenge.

    I don't want to say anything more than I'm back in the "DACs sound mostly the same" camp until I hear otherwise.

    Being able to instantly A/B really is incredible.

    I also heard essentially zero difference driving the DACs via USB vs using one as a renderer to play files to the other though I wasn't able to do the same kind of instant A/B testing on this.
     

Share This Page