o Mu'awiyah! Your relatives refuse to carry out your order concerning the allegiance to Yazid.
Marwan ibn al-Hakam

It is reported in the book of al-Imamah wa as-siyasah of Ibn
Qutaybah: Mu'awiyah wrote a letter to Marwan who was his governor at Medina, asking him to propose the allegiance to Yazid to the people of that city. This was an unpleasant task for Marwan and also the Quraysh chiefs of Medina were by no means willing to show allegiance to Yazid. So Marwan wrote to Mu'awiyah, saying: 'Your relatives refuse to carry out your order concerning the allegiance to Yazid. Write your view to me.

Mu'awiyah was annoyed at the conduct of Marwan and at his negative answer, and dismissed him from the governorship of Medina, replacing him by Sa'id ibn al-'As. Marwan departed for ash-Sham with a group of the Umayyads, being full of rage the whole time.
He visited Mu'awiyah and spoke harshly in his presence. But cunning Mu'awiyah did not think it expedient to be sharp then. So he treated him calmly and mildly, and after increasing his salary, he sent him back to Medina.(228)
After this incident he thought of a new plan. He thought that the best way of carrying out the question of Yazid's succession, was to create a division among the chiefs of his own tribe, the Umayyads. Consequently he wrote a decree and sent it to Sa'id ibn al-'As, governor of Medina, ordering him to demolish the house of Marwan ibn al-Hakam and confiscate all his property including Fadak.
Ibn al-Athir writes: In the year 54 of the Hijrah, Mu'awiyah dismissed Sa'id ibn al-'As as governor of Medina and replaced him by Marwan. The reason for his dismissal was that Mu'awiyah had written to Sa'id during his governor-ship ordering him to demolish Marwan's house and confiscate all his property and even Fadak which he had granted to him in the past. But Sa'id had ignored his order and had failed to act upon