For most sports, we can't just observe within-sex performance and extrapolate to some kind of commensurable, absolute ability. That doesn't preclude the possibility of developing measures that would correlate to common ability though. It just means we have work to do in figuring out what those are.