How do I use the BeautifulSoup package to scrape the list of research labs located at https://research.fit.edu. Recall that BeautifulSoup is a parser and I would need to first get the web data with a package such as requests or urllib. First, I would need to store the list of labs and their corresponding URLs in a 2D list of the form:   research_labs = [ ['Lab 1', 'lab1_url'], ['Lab 2', 'lab2_url'], ... ['Lab n', 'Labn_url'] ] Next, complete the function find_lab(search_str) that accepts a lab name or partial lab name in any case and returns a list containing the full lab name and its URL. For example, find_lab('Concussion Project') should return ['Sport Related Concussion Project', 'http://research.fit.edu/concussion/'] find_lab('Orion Research Lab') should return ['Orion Research Lab', 'http://research.fit.edu/orion/'] def find_lab(search_str): root_url = "https://research.fit.edu/" research_labs = get_web_data(root_url) # Return the first lab you find containing the search string # in the form ['Full Lab Name', 'lab_url']. # You may break your code into functions. # The search_str may be in any case. return [] # This function gets the data from the webpage as a 2D list def get_web_data(url): data_table = [] return data_table

Database System Concepts
7th Edition
ISBN:9780078022159
Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Chapter1: Introduction
Section: Chapter Questions
Problem 1PE
icon
Related questions
Question

How do I use the BeautifulSoup package to scrape the list of research labs located at https://research.fit.edu. Recall that BeautifulSoup is a parser and I would need to first get the web data with a package such as requests or urllib. First, I would need to store the list of labs and their corresponding URLs in a 2D list of the form:

 

research_labs = [ ['Lab 1', 'lab1_url'], ['Lab 2', 'lab2_url'], ... ['Lab n', 'Labn_url'] ]

Next, complete the function find_lab(search_str) that accepts a lab name or partial lab name in any case and returns a list containing the full lab name and its URL.

For example, find_lab('Concussion Project') should return ['Sport Related Concussion Project', 'http://research.fit.edu/concussion/']

find_lab('Orion Research Lab') should return ['Orion Research Lab', 'http://research.fit.edu/orion/']

def find_lab(search_str):
root_url = "https://research.fit.edu/"
research_labs = get_web_data(root_url)
# Return the first lab you find containing the search string
# in the form ['Full Lab Name', 'lab_url'].
# You may break your code into functions.
# The search_str may be in any case.
return []

# This function gets the data from the webpage as a 2D list
def get_web_data(url):
data_table = []
return data_table
Expert Solution
steps

Step by step

Solved in 3 steps with 1 images

Blurred answer
Knowledge Booster
Lists
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
Database System Concepts
Database System Concepts
Computer Science
ISBN:
9780078022159
Author:
Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Publisher:
McGraw-Hill Education
Starting Out with Python (4th Edition)
Starting Out with Python (4th Edition)
Computer Science
ISBN:
9780134444321
Author:
Tony Gaddis
Publisher:
PEARSON
Digital Fundamentals (11th Edition)
Digital Fundamentals (11th Edition)
Computer Science
ISBN:
9780132737968
Author:
Thomas L. Floyd
Publisher:
PEARSON
C How to Program (8th Edition)
C How to Program (8th Edition)
Computer Science
ISBN:
9780133976892
Author:
Paul J. Deitel, Harvey Deitel
Publisher:
PEARSON
Database Systems: Design, Implementation, & Manag…
Database Systems: Design, Implementation, & Manag…
Computer Science
ISBN:
9781337627900
Author:
Carlos Coronel, Steven Morris
Publisher:
Cengage Learning
Programmable Logic Controllers
Programmable Logic Controllers
Computer Science
ISBN:
9780073373843
Author:
Frank D. Petruzella
Publisher:
McGraw-Hill Education