Of course they do have such power. Each department/agency has legislation that spells out its scope. An underling in Department A doesn’t have the authority to act outside the scope of its Department A’s power/purview.