parse twitch.tv for list of top 100 stream in python

To parse Twitch.tv for a list of the top 100 streams in Python, you could either use web scraping or the official Twitch API. In this answer, we will focus on how to achieve this using web scraping.

We can use the requests library to send an HTTP GET request to the Twitch.tv website and retrieve its HTML content. Then, we can use the BeautifulSoup library to parse the HTML content and extract the information we need.

Here's the code to retrieve the list of the top 100 Twitch.tv streams in Python using web scraping:

main.py
import requests
from bs4 import BeautifulSoup

url = "https://www.twitch.tv/directory/all"
response = requests.get(url)
soup = BeautifulSoup(response.content, "html.parser")

stream_list = soup.find_all("div", {"class": "tw-tower"})
for i, stream in enumerate(stream_list[:100]):
    stream_title = stream.find("p", {"class": "tw-c-text-overlay"}).text.strip()
    stream_viewer_count = stream.find("span", {"class": "tw-pd-l-1"}).text.strip()
    print(f"{i+1}. Title: {stream_title} - Viewer Count: {stream_viewer_count}")
525 chars
13 lines

This script will print out the title and viewer count for the top 100 streams on Twitch.tv. The stream_list variable contains a list of all the div elements with a tw-tower class, which represents each stream block on the webpage. We then loop through the first 100 stream blocks and extract the title and viewer count by searching for specific HTML elements using the find() method provided by Beautiful Soup.

Note that web scraping may not always provide the most up-to-date information, and Twitch may have usage limits on web scraping. In such cases, using the official Twitch API may be a better solution.