Possible Feature – Looking for Feedback
-
The links in the songlist pages have instructions which tell most crawler bots not to attempt to follow them. Unfortunately, not all bots really care about these instructions so some bot requests still go through. As a way of combating this, I am considering implementing an optional feature which will require someone to be registered and logged into the website in order to make requests.
Another possibility is to implement a form of website side throttling for users who aren’t logged in. For example, you could allow unregistered/unknown users to request 1 song an hour (or 1 song a day or whatever) while allowing registered users to submit according to your request policy in SAM. This could be used to reduce or eliminate bot requests.
- The topic ‘Possible Feature – Looking for Feedback’ is closed to new replies.