save the raw html to a local file in python

To save raw HTML to a local file in Python, we can use the requests library to make a HTTP request to the webpage, get the HTML content, and then use file input/output (I/O) operations to write the content to a file.

Here's an example code snippet that demonstrates this method:

main.py
import requests

# Make a HTTP request and get the response object
url = "https://example.com"
response = requests.get(url)

# Get the raw HTML content
html_content = response.content

# Write the content to a local file named "output.html"
with open("output.html", "wb") as f:
    f.write(html_content)
304 chars
13 lines

In this example, we first import the requests library. Then we set the url variable to the URL of the webpage we want to scrape. We make a HTTP request to the URL using the requests.get() function, which returns a response object that contains the raw HTML content of the webpage.

We get the raw HTML content by accessing the content attribute of the response object.

Finally, we write the raw HTML content to a local file named "output.html" using the open() function in file I/O mode "wb" (write binary mode) and the write() method of the file object. By using binary mode, we ensure that the correct encoding is used when writing the file.