web browser in python

There are several ways to automate web browsing in Python. Two popular methods are using the requests module and using Selenium.

Using Requests

The requests module is useful for sending HTTP requests to web servers and receiving responses. However, it is limited to making requests only and does not interpret JavaScript or render images as a web browser would.

Here's an example of using requests to get the HTML content of a web page:

main.py
import requests

url = 'https://www.google.com'
response = requests.get(url)
content = response.text

print(content)
117 chars
8 lines

This will print the HTML content of the Google homepage.

Using Selenium

Selenium is a popular framework for automating web browsers. It can interact with web pages just like a user would, including filling out forms, clicking buttons, navigating to different pages, and more.

To use Selenium, you will need to download a driver for the browser you want to automate (e.g. ChromeDriver for Google Chrome). Here's an example of using Selenium to open a web page and get its title:

main.py
from selenium import webdriver

url = 'https://www.google.com'
driver = webdriver.Chrome()  # or webdriver.Firefox(), etc.
driver.get(url)

title = driver.title
print(title)

driver.quit()  # close the browser
210 chars
11 lines

This will open a Google Chrome browser and navigate to the Google homepage. It will then print the title of the page ("Google"). Finally, it will close the browser.

These are just two examples of how you can automate web browsing in Python – there are many other libraries and frameworks available depending on your needs.