How does the president exercise control over the bureaucracy?

The primary function of administrative agencies is policy implementation, which is to say that they carry out the authoritative decisions of Congress, the president, and the courts. The bureaucracy does not simply administer policy; it also makes it and judges it (quasi-powers mimic the powers of the three branches