The order comes after Kenya witnessed several instances of internet shutdown.
The Senator was thrown out in the presence of Health Cabinet Secretary Aden Duale.
Calls for stricter inspection and enforcement have been growing after numerous deaths from building collapses.
The highway is part of an initial Ksh190 billion deal to ease traffic along one of the country's busiest transport corridors.
The anchor was last seen on the screens some time in 2024.
The government also announced plans for another separate loan from the World Bank.
Duale has affirmed that no amount of uproar will prompt him to reverse his decision.
The orders are to be implemented immediately
The former Prime Minister had listed the stipend as one of the items of his manifesto during the 2022 General Elections campaigns.
The Kenyan was living with a Ugandan in India at the time of the incident.