What am I waiting for? Nay, it is the truth from the Lord of the Worlds so that you may admonish thereby people to whom no warner has come before you in order that they may receive guidance.
Since Khalid, like his father, was one of the most prominent figures in Quraish, if not the very most prominent one, he felt he should have had the lion's share of the Qur'an and the Prophetic Mission had they only been his father's lot, and he would have inherited Prophetic Mission and authority just as prophet Solomon had inherited David.
Had Ali as not surrendered and ordered everyone to go out to swear it, you would certainly have carried out your threat.