Why Are So Many Labels Similar to Each Other?