Headphone Measurement Stuff

Discussion in 'Random Thoughts' started by castleofargh, Sep 15, 2016.

  1. castleofargh

    castleofargh Acquaintance

    Joined:
    Aug 24, 2016
    Likes Received:
    28
    Trophy Points:
    18
    aside from the obvious problem of calibration(a mic calibrated for room measurement and calibrated for enclosed measurements aren't the same thing), I would simply try to ignore/remove compensation above 10 or 12khz. measurement above that can go wrong for so many reasons, and any small displacement might have huge impact.
    the mid range has overall better stability, the higher freqs up to 10khz can move around but you usually can tell if something is wrong by ear and locate the problem rather precisely(or move the headphone a little bit in front or something). but above it becomes kind of hard to do anything precise, at least in my experience.
     
  2. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    This is not correct.

    I've seen the IF article on this (with MH going all crazy about 6 sigma and shit), but you have to take into consideration that Tyll is using a head + ear coupler. A flat coupler should not have significant impact in measurements in the treble area as far as displacement and repeatability is concerned. At least not as significant as some would have one believe. Hell, I think Tyll even acknowledged this on his article about his Philips road trip or something. They (Philips) had a flat coupler rig for measurement repeatability.

    This is also my experience and I can provide data to back this up as I've done in the past. I believe The Merv has done this as well.

    The concern here is not about repeatability and displacement. The concern is about the coupler being sufficiently "transparent" for the lack of a better word. I have some ideas about how to handle this burrowed from some work JA did in the past.

    And yes, I'm not that concerned about mic calibration as I'm concerned about coupler interactions.
     
    Last edited: Sep 15, 2016
  3. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    BTW, sorry if I'm being a bit insistent on this. But I've seen this being thrown out in too many places already, and it's something I feel is a severe misconception that has done more wrong that good in the pursuit of a meaningful reference.

    I don't like to oversimplify problems just as I don't like to overcomplicate them. And I definitively hate it when I perceive folks are implying that this or that is impossible, it's never going to happen, it's just too hard, and we just don't understand pretty much nothing. That, IMO is complete and utter bullshit.

    (BTW this rant is not directed at @castleofargh, it's more of a general statement)
     
    Last edited: Sep 15, 2016
  4. Serious

    Serious Inquisitive Frequency Response Plot

    Pyrate BWC MZR
    Joined:
    Sep 28, 2015
    Likes Received:
    2,595
    Trophy Points:
    113
    Location:
    near Munich, Germany
    I think it's less about the coupler being "transparent" and more about it being accurate. I don't think accuracy through the upper midrange is ever going to happen with a flat plate coupler approach and perfect accuracy in the treble is never going to happen with a dummy head/in-ear-mic approach. I don't think perfect neutrality can be achieved by calibrating against the B&K target with a flat plate coupler, but it didn't sound bad when I tried it with my HD600.
    I'm not sure if a completely open approach like the old JA measurements tells us all that much except if the driver is flat or not, or where it has trouble spots. Although in many cases a flat driver frequency response does sound good in headphones.
     
  5. castleofargh

    castleofargh Acquaintance

    Joined:
    Aug 24, 2016
    Likes Received:
    28
    Trophy Points:
    18
    @ultrabike , not sure I understand what you're saying is wrong?
    do you mean that moving the hd600 around doesn't impact the trebles much? because even by ear I often end up moving my 650 a little for something that annoys me around 10khz. of course my own experience is 99% IEM so there trebles are simply a nightmare to handle with positioning, plus I use a coupler that has the worst sensitivity in the trebles so after compensation I don't always know if I'm measuring the noise of something else. but I'm conscious that it's a specific problem for a specific coupler. no I was talking in general, with shorter frequencies it's easier to get into all kinds of problems, so I suggest not to rely too much on the measurements in the high freqs.

    or did you talk about me saying that the calibration isn't going to be the same? if that's it then yeah you're right. it's not the calibration of the mic that changes, it's the rig and enclosure that alter the response. I use the calibration file to try and compensate for that so I do make a bad amalgam between calibration and target curve. I should have said it differently.
     
  6. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    An all open measurement will effectively remove the coupler and the ear from the equation, as it should. It would fail at lower frequencies, but that's where the flat coupler shines. There may be ways to improve the flat coupler in the upper frequencies however.

    I think the target curve is flat from mids to treble on an open approach, and flat from bass to lower mids in a flat plate approach. As far as accuracy. I think it can be achieved with a dummy head, but its IMO an unnecessary pain in the ass, which can be alleviated with a flat plate coupler.

    I'm not sure I understand your concern about using a flat coupler when looking at the mids.

    I mean the former. Moving the HD600 around does not impact the trebles much in a flat coupler (w some absorption material - at least not that much). IEM are very different animals.
     
  7. Serious

    Serious Inquisitive Frequency Response Plot

    Pyrate BWC MZR
    Joined:
    Sep 28, 2015
    Likes Received:
    2,595
    Trophy Points:
    113
    Location:
    near Munich, Germany
    I think ringing and resonances can be suppressed or highlighted depending on the coupling material and the headphone type like you see with Marv's foam vs CD/creatology foam/felt couplers. I guess the question here is how the skin behaves vs some of the materials we have available. I might make a thread some time on some of the coupling experiments I've done with a few different materials and how they affect accuracy. LOL, I remember asking about help for my coupler on CS a long time ago and then I essentially recreated his V2 coupler and thought "WTF, this doesn't work with the HD800 at all", until I realized that the V1 coupler was very different.
    What I mean is that the flat plate coupler will never be able to recreate the natural interaction between headphone and ear and since every headphone interacts differently with the ear (essentially changing the FR in different ways), the target response for a perceived neutral sound will be different for every headphone when using a flat plate coupler approach. That's why I posted all the coupler vs IE-Mic difference plots in the thread.
    Actually I'm more against measurements than people realize -- I'm trying to show that there's no accurate method for measuring headphones (and also for speakers for that matter - yes, the B&K target at the listening position is no guarantee for the same or even similar FR at the eardrum. In other words different rooms/speakers need a different target response for the same perceived FR). People like to give blind trust in plots without understanding how they come about and in what way inaccuracies are involved. In what way they're compromised by design choices in the coupler design or mic choice (mainly for distortion measurements).

    Of course measurements are in no way meaningless, but it's always important to show and highlight where the plots don't explain the sound. For example when the Utopia measurements had a lot of ringing in the treble, but Marv said that it subjectively sounded much smoother than measured. And then the foam coupler measurements showed clean decay with very little ringing.

    @castleofargh I'm pretty sure ultrabike's coupler design is less sensitive to big changes in the FR by slight positioning differences in the upper treble. Again, this depends a lot on the coupler design but overall I would agree with ultrabike. Generally the coupler measurements are very reliable. Marv used to retake measurements from months before and they matched the old measurements almost perfectly.
     
  8. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    I don't think how the skin behaves is the question. I think the question is, if driven volume is not a problem from a particular frequency and up, then how can we get a coupler that will yield equally valid measurements in the bass, mids and treble. In other words, how can we make a coupler that will not f**k up upper mids and treble, and behave like an open measurement.

    I believe we have the coupler only because the volume driven is small and that matters for low frequencies. I don't think it matters than much for high frequencies.

    I feel we need to remove the ear out of the equation completely, or as much as possible, as is done with speakers.

    Hell, even if you do make measurements with a sex doll, you have to compensate... i.e. remove the ear model response.

    Interactions between full size headphones with the ear may be equivalent to interactions between a speaker and the ear at higher frequencies, because the only thing bypassed it the head. The ear is fully present in both full size headphones and speakers.

    I do not recommend using in-ear mics for measurements unless you absolutely have to. You will need the exact model of the ear only to remove it later. And now you do have to worry about positioning.
     
  9. Serious

    Serious Inquisitive Frequency Response Plot

    Pyrate BWC MZR
    Joined:
    Sep 28, 2015
    Likes Received:
    2,595
    Trophy Points:
    113
    Location:
    near Munich, Germany
    FWIW I find my IEM results to more accurately capture tonal balance. I feel it's the other way around - we have to compensate with the coupler measurements but not with the in-ear-mic measurements. And I feel that the compensation has to be different for every headphone.
     
  10. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    WHAT!?

    I don't think this is up for debate. Without compensation, a set of in-ear-mic measurements would all have a huge boost around 1k to 10k region, and then it severely rolls off.

    Take a look at this article:

    http://www.innerfidelity.com/content/headphone-measurements-explained-frequency-response-part-one

    I feel compensation has to be different for every different set of ears, if that's what is being used for measurements. Not for headphones.
     
  11. Serious

    Serious Inquisitive Frequency Response Plot

    Pyrate BWC MZR
    Joined:
    Sep 28, 2015
    Likes Received:
    2,595
    Trophy Points:
    113
    Location:
    near Munich, Germany
    All of my in-ear-mic measurements are without compensation*. That plot is for speakers, not headphones. Most headphones interact very differently with the ear than speakers do with the body/head/ear, which I also showed in that thread.

    *At least without compensating for the in-ear method. So are Hands' measurements. They do however have the usual mic and system calibration.
     
  12. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    How did you remove the gain the outter ear has on the 1k to 10k region?

    I've done this, the boost is there and it's huge.

    And what's this interactions stuff I'm hearing? Can you elaborate?
     
  13. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    OK... I see the post amends...

    So you do have a "system calibration" that takes care of the outter ear gain between 1k and 10k, and severe roll off above 10k (both of which are ear to ear different and dependent)?
     
  14. Serious

    Serious Inquisitive Frequency Response Plot

    Pyrate BWC MZR
    Joined:
    Sep 28, 2015
    Likes Received:
    2,595
    Trophy Points:
    113
    Location:
    near Munich, Germany
    The simple fact is that the outer ear doesn't have as big of a gain for most headphones. Big headphones with huge drivers that are far away from the ear come closer to the interaction* you get with speakers, but they still don't show as much gain.

    I meant the usual electronics calibration which Hands seems to need when I wrote system calibration. The in-ear-mic results do look like that without compensation. The area around 3-4kHz isn't boosted nearly as much as with speakers and I find flat to work well here as a target, something that I wrote here a long time ago. Actually @Tyll Hertsens' new article does seem to agree with me that speakers and headphones need different target curves at the ear drum.
    The severe roll off above 10kHz with speakers depends a lot on the angle afaik. My in-ear-mic results do seem too rolled off at the top for me, but I'm not planning to compensate for that, at least not yet. I feel my coupler is more accurate in the treble anyway

    I know it's hard to accept at first that the in-ear-mic results don't look like they need compensation. I wonder why noone questioned if Hands used a compensation back on CS. I know OJ was wondering about the same thing.

    It's possible that the results would look very different at the eardrum, much closer to Tyll's raw plots.

    *With interaction I'm simply referring to the differences in FR between no ear and with the ear, so in this case between a flat coupler and the in-ear-mic measurements.
     
  15. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    I've measured speakers with a fake ear 1 meter away. The gain is still there, and it's still huge.
     
  16. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    ... and I've measured the HD600 with a fake ear. The gain is still there, and it's still huge.

    I'll do it again tonite.

    BTW, Tyll's raw plots with fake ears have a gain, and it's still huge.
     
  17. Serious

    Serious Inquisitive Frequency Response Plot

    Pyrate BWC MZR
    Joined:
    Sep 28, 2015
    Likes Received:
    2,595
    Trophy Points:
    113
    Location:
    near Munich, Germany
    That's what I'm saying. The HD600 plots with an in-ear-microphone will look mostly flat, while speaker measurements will show the huge gain. I do have speaker HRTF* measurements in my thread and the post I linked above.

    *for lack of a better term. The effect the ear has on the FR for speaker measurements (against the omni mic).

    Was that the ear you used for your IEM measurements? If so, try it without the ear canal. And even then I have my doubts if the fake ear is close to the real deal. The measurements Audeze showed us show us that the curves look like Tyll's results at the eardrum while they look like mine and Hands' at the ear canal opening, even with a real ear. Not really that surprising. But Audeze didn't seal off the ear canal so they got a 30db dip at 8kHz in their measurements. They might have done this on purpose to make the LCD4 measurements look better compared to the HEK.
     
    Last edited: Sep 15, 2016
  18. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    Dude. Serious-ly, same mic for speakers and HD600s, huge boost if I remember correctly.

    I mean, I dunno why you say Tyll's measurements support your argument. Tyll's raw measurements, all exhibit the gain I described. If you do not have to apply compensation and you are using an ear, something is pretty fishy.

    I mean, look at Tyll's HD600 raw and compensated measurements:
    http://www.innerfidelity.com/images/SennheiserHD600.pdf

    There is a 1k to 10k boost. It's not subtle.

    Will redo my HD600 with fake ear tonite.
     
  19. Serious

    Serious Inquisitive Frequency Response Plot

    Pyrate BWC MZR
    Joined:
    Sep 28, 2015
    Likes Received:
    2,595
    Trophy Points:
    113
    Location:
    near Munich, Germany
    Oops, getting all confused. Meant ear, not mic.

    What I'm saying is there is a big difference between bypassing the ear canal and not. The difference between having to apply compensation and not.
     
  20. ultrabike

    ultrabike Measurbator - Admin

    Staff Member Pyrate MZR
    Joined:
    Sep 25, 2015
    Likes Received:
    8,960
    Trophy Points:
    113
    Location:
    Irvine CA
    There is a huge difference between bypassing the entire outter ear and not.

    The ear canal you don't bypass. That is only relevant for IEMs because that's the only volume they drive. It's negligible for speakers and full size headphones in terms of volume. And you don't mess with that for such measurements as well.
     

Share This Page