Parse User-Agents and Identify Robots in Python

Cloudmersive
1 min readDec 28, 2020

When providing access to users for a website or other platform, you may also invite other entities such as robots. The following API will allow you to parse HTTP user-agent strings to identify access data, as well as identify any robots that may be accessing your site.

Run this command to install the SDK:

pip install cloudmersive-validate-api-client

Then, you can call the function:

from __future__ import print_function
import time
import cloudmersive_validate_api_client
from cloudmersive_validate_api_client.rest import ApiException
from pprint import pprint
# Configure API key authorization: Apikey
configuration = cloudmersive_validate_api_client.Configuration()
configuration.api_key['Apikey'] = 'YOUR_API_KEY'
# create an instance of the API class
api_instance = cloudmersive_validate_api_client.UserAgentApi(cloudmersive_validate_api_client.ApiClient(configuration))
request = cloudmersive_validate_api_client.UserAgentValidateRequest() # UserAgentValidateRequest | Input parse request
try:
# Parse an HTTP User-Agent string, identify robots
api_response = api_instance.user_agent_parse(request)
pprint(api_response)
except ApiException as e:
print("Exception when calling UserAgentApi->user_agent_parse: %s\n" % e)

This will return responses stating the OS and Browser information for the user-agent, whether the scan was successful and if a bot was detected, and the bot name and URL. You can retrieve the API Key from the Cloudmersive website at no cost and with no commitment. This will provide you with 800 monthly calls across our library of APIs.

--

--

Cloudmersive

There’s an API for that. Cloudmersive is a leader in Highly Scalable Cloud APIs.