Yeah thats exactly what I feel is the case. Either Dragon is an ex Admiral and rivals with Akainu back in the day, maybe even having his trust before or Dragon is ex CP0 or ex Holy Knight or something. Ex Admiral seems most likely to me though, especially due to Garp as well.