Restrict load-scripts.php while accessing directly on browser

Is that safe to have the load-scripts.php to be accessed publicly? If we are restricting them to be accessed only by logged in users, we are getting issues in loading js and CSS files from other plugins for non logged in users.

So as per PCI compliance should we restrict the public access to load-script file or it is fine to be leave them accessed in public? Please advise

Also is there a way to block the direct access to this file and allow ajax calls alone?