Skip to content

Upgrade Saskia #11

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Aug 25, 2025
Merged

Upgrade Saskia #11

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
03a5a5d
Merge pull request #5 from anmerinoto/main
anmerinoto Aug 24, 2025
29e23aa
Merge pull request #7 from anmerinoto/main
anmerinoto Aug 24, 2025
daa2980
Merge pull request #9 from anmerinoto/JENNY_ALAVA
anmerinoto Aug 24, 2025
4347d8a
Merge pull request #10 from anmerinoto/Saskia_Guerrrero
anmerinoto Aug 24, 2025
4af9922
agrego traduccionn del paso 1
julizzazeime456-afk Aug 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
202 changes: 164 additions & 38 deletions lessons/02_web_scraping.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,7 @@
},
{
"cell_type": "code",
"execution_count": 2,
"execution_count": null,
"metadata": {},
"outputs": [
{
Expand All @@ -128,18 +128,20 @@
}
],
"source": [
"# 🧩 El comando %pip install lxml instala la librería lxml en tu entorno de Jupyter Notebook.\n",
"# ⚡ lxml es un parser rápido y eficiente para analizar y procesar archivos HTML y XML, muy útil para usar con Beautiful Soup en web scraping.\n",
"%pip install lxml"
]
},
{
"cell_type": "code",
"execution_count": 5,
"execution_count": 23,
"metadata": {
"tags": []
},
"outputs": [],
"source": [
"# Import required libraries\n",
"# importamos las librerías necesarias\n",
"from bs4 import BeautifulSoup\n",
"from datetime import datetime\n",
"import requests\n",
Expand All @@ -152,45 +154,60 @@
"source": [
"<a id='extract'></a>\n",
"\n",
"# Extracting and Parsing HTML \n",
"# Extracción y análisis de HTML\n",
"\n",
"In order to succesfully scrape and analyse HTML, we'll be going through the following 4 steps:\n",
"1. Make a GET request\n",
"2. Parse the page with Beautiful Soup\n",
"3. Search for HTML elements\n",
"4. Get attributes and text of these elements"
"Para extraer y analizar correctamente HTML, seguiremos los siguientes 4 pasos:\n",
"1. Realizar una solicitud GET\n",
"2. Analizar la página con Beautiful Soup\n",
"3. Buscar elementos HTML\n",
"4. Obtener atributos y texto de estos elementos"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Step 1: Make a GET Request to Obtain a Page's HTML\n",
"## Paso 1: Realiza una solicitud GET para obtener el HTML de una página\n",
"\n",
"Podemos usar la librería Requests para:\n",
"\n",
"We can use the Requests library to:\n",
"1. Realizar una solicitud GET a la página, y\n",
"\n",
"1. Make a GET request to the page, and\n",
"2. Read in the webpage's HTML code.\n",
"2. Leer el código HTML de la página web.\n",
"\n",
"The process of making a request and obtaining a result resembles that of the Web API workflow. Now, however, we're making a request directly to the website, and we're going to have to parse the HTML ourselves. This is in contrast to being provided data organized into a more straightforward `JSON` or `XML` output."
"El proceso de realizar una solicitud y obtener un resultado se asemeja al flujo de trabajo de una API web. Sin embargo, en este caso estamos haciendo la solicitud directamente al sitio web y tendremos que analizar el HTML por nuestra cuenta. Esto es diferente a cuando se nos proporciona la información ya organizada en un formato más sencillo como JSON o XML."
]
},
{
"cell_type": "code",
"execution_count": 1,
"execution_count": 24,
"metadata": {
"tags": []
},
"outputs": [
{
"ename": "NameError",
"evalue": "name 'requests' is not defined",
"output_type": "error",
"traceback": [
"\u001b[31m---------------------------------------------------------------------------\u001b[39m",
"\u001b[31mNameError\u001b[39m Traceback (most recent call last)",
"\u001b[36mCell\u001b[39m\u001b[36m \u001b[39m\u001b[32mIn[1]\u001b[39m\u001b[32m, line 2\u001b[39m\n\u001b[32m 1\u001b[39m \u001b[38;5;66;03m# Make a GET request\u001b[39;00m\n\u001b[32m----> \u001b[39m\u001b[32m2\u001b[39m req = \u001b[43mrequests\u001b[49m.get(\u001b[33m'\u001b[39m\u001b[33mhttp://www.ilga.gov/senate/default.asp\u001b[39m\u001b[33m'\u001b[39m)\n\u001b[32m 3\u001b[39m \u001b[38;5;66;03m# Read the content of the server’s response\u001b[39;00m\n\u001b[32m 4\u001b[39m src = req.text\n",
"\u001b[31mNameError\u001b[39m: name 'requests' is not defined"
"name": "stdout",
"output_type": "stream",
"text": [
"<!DOCTYPE html>\n",
"<html lang=\"en\">\n",
"<head id=\"Head1\">\n",
" <meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0\" />\n",
" <meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\" />\n",
" <meta http-equiv=\"X-UA-Compatible\" content=\"IE=Edge\" />\n",
" <meta charset=\"utf-8\" />\n",
" <meta charset=\"UTF-8\">\n",
" <!-- Meta Description -->\n",
" <meta name=\"description\" content=\"Welcome to the official government website of the Illinois General Assembly\">\n",
" <meta name=\"contactName\" content=\"Legislative Information System\">\n",
" <meta name=\"contactOrganization\" content=\"LIS Staff Services\">\n",
" <meta name=\"contactStreetAddress1\" content=\"705 Stratton Office Building\">\n",
" <meta name=\"contactCity\" content=\"Springfield\">\n",
" <meta name=\"contactZipcode\" content=\"62706\">\n",
" <meta name=\"contactNetworkAddress\" content=\"[email protected]\">\n",
" <meta name=\"contactPhoneNumber\" content=\"217-782-3944\">\n",
" <meta name=\"contactFaxNumber\" content=\"217-524-6059\">\n",
" <meta name\n"
]
}
],
Expand All @@ -216,9 +233,35 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 25,
"metadata": {},
"outputs": [],
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"<!DOCTYPE html>\n",
"<html lang=\"en\">\n",
" <head id=\"Head1\">\n",
" <meta content=\"width=device-width, initial-scale=1.0\" name=\"viewport\"/>\n",
" <meta content=\"text/html;charset=utf-8\" http-equiv=\"content-type\"/>\n",
" <meta content=\"IE=Edge\" http-equiv=\"X-UA-Compatible\"/>\n",
" <meta charset=\"utf-8\"/>\n",
" <meta charset=\"utf-8\"/>\n",
" <!-- Meta Description -->\n",
" <meta content=\"Welcome to the official government website of the Illinois General Assembly\" name=\"description\"/>\n",
" <meta content=\"Legislative Information System\" name=\"contactName\"/>\n",
" <meta content=\"LIS Staff Services\" name=\"contactOrganization\"/>\n",
" <meta content=\"705 Stratton Office Building\" name=\"contactStreetAddress1\"/>\n",
" <meta content=\"Springfield\" name=\"contactCity\"/>\n",
" <meta content=\"62706\" name=\"contactZipcode\"/>\n",
" <meta content=\"[email protected]\" name=\"contactNetworkAddress\"/>\n",
" <meta content=\"217-782-3944\" name=\"contactPhoneNumber\"/>\n",
" <meta content=\"217-524-6059\" name=\"contactFaxNumber\"/>\n",
" <meta content=\"State Of Illinois\" name=\"originatorJur\n"
]
}
],
"source": [
"# Parse the response into an HTML tree\n",
"soup = BeautifulSoup(src, 'lxml')\n",
Expand Down Expand Up @@ -254,9 +297,37 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 26,
"metadata": {},
"outputs": [],
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[<a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"en\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-us\"></span> English\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"af\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-za\"></span> Afrikaans\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"sq\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-al\"></span> Albanian\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"ar\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-ae\"></span> Arabic\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"hy\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-am\"></span> Armenian\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"az\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-az\"></span> Azerbaijani\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"eu\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-eu\"></span> Basque\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"bn\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-bd\"></span> Bengali\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"bs\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-ba\"></span> Bosnian\n",
" </a>, <a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"ca\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-es\"></span> Catalan\n",
" </a>]\n"
]
}
],
"source": [
"# Find all elements with a certain tag\n",
"a_tags = soup.find_all(\"a\")\n",
Expand All @@ -274,11 +345,24 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 27,
"metadata": {
"tags": []
},
"outputs": [],
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"<a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"en\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-us\"></span> English\n",
" </a>\n",
"<a b-0yw6sxot5c=\"\" class=\"dropdown-item\" data-lang=\"en\" href=\"#\">\n",
"<span b-0yw6sxot5c=\"\" class=\"flag-icon flag-icon-us\"></span> English\n",
" </a>\n"
]
}
],
"source": [
"a_tags = soup.find_all(\"a\")\n",
"a_tags_alt = soup(\"a\")\n",
Expand All @@ -295,9 +379,17 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 28,
"metadata": {},
"outputs": [],
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"270\n"
]
}
],
"source": [
"print(len(a_tags))"
]
Expand All @@ -315,11 +407,22 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 29,
"metadata": {
"tags": []
},
"outputs": [],
"outputs": [
{
"data": {
"text/plain": [
"[]"
]
},
"execution_count": 29,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# Get only the 'a' tags in 'sidemenu' class\n",
"side_menus = soup(\"a\", class_=\"sidemenu\")\n",
Expand All @@ -337,11 +440,22 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 30,
"metadata": {
"tags": []
},
"outputs": [],
"outputs": [
{
"data": {
"text/plain": [
"[]"
]
},
"execution_count": 30,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# Get elements with \"a.sidemenu\" CSS Selector.\n",
"selected = soup.select(\"a.sidemenu\")\n",
Expand All @@ -359,7 +473,7 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 31,
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -382,11 +496,23 @@
},
{
"cell_type": "code",
"execution_count": null,
"execution_count": 32,
"metadata": {
"tags": []
},
"outputs": [],
"outputs": [
{
"ename": "IndexError",
"evalue": "list index out of range",
"output_type": "error",
"traceback": [
"\u001b[31m---------------------------------------------------------------------------\u001b[39m",
"\u001b[31mIndexError\u001b[39m Traceback (most recent call last)",
"\u001b[36mCell\u001b[39m\u001b[36m \u001b[39m\u001b[32mIn[32]\u001b[39m\u001b[32m, line 5\u001b[39m\n\u001b[32m 2\u001b[39m side_menu_links = soup.select(\u001b[33m\"\u001b[39m\u001b[33ma.sidemenu\u001b[39m\u001b[33m\"\u001b[39m)\n\u001b[32m 4\u001b[39m \u001b[38;5;66;03m# Examine the first link\u001b[39;00m\n\u001b[32m----> \u001b[39m\u001b[32m5\u001b[39m first_link = \u001b[43mside_menu_links\u001b[49m\u001b[43m[\u001b[49m\u001b[32;43m0\u001b[39;49m\u001b[43m]\u001b[49m\n\u001b[32m 6\u001b[39m \u001b[38;5;28mprint\u001b[39m(first_link)\n\u001b[32m 8\u001b[39m \u001b[38;5;66;03m# What class is this variable?\u001b[39;00m\n",
"\u001b[31mIndexError\u001b[39m: list index out of range"
]
}
],
"source": [
"# Get all sidemenu links as a list\n",
"side_menu_links = soup.select(\"a.sidemenu\")\n",
Expand Down