Resolution

It's not possible to restrict the API. Certain API calls can be done by anyone (unauthenticated); while others require prior authentication for successful execution.

The API is also used when using the Workspace, System Settings, or the Dashboard.

So it is not possible to restrict this further.