python scrape data from aspx page
#pip install requests
#pip install lxml
#pip install bs4
import requests
from bs4 import BeautifulSoup
r_obj = requests.Session()
url = "aspx_website_url_here" # i.e. http://bisegrw.edu.pk/
r_soup = r_obj.get(url)
soup = BeautifulSoup(r_soup.content , "lxml")
hidden_inputs = soup.find_all("input",type="hidden")
data = {
hidden_inputs[0]['name']:hidden_inputs[0]['value'],
hidden_inputs[1]['name']:hidden_inputs[1]['value'],
hidden_inputs[2]['name']:hidden_inputs[2]['value'],
'other_input':'value', # i.e. 'rno':'487431',
'submitButton':'submit'}
url_needed = "aspx_endpoint" # i.e. http://bisegrw.edu.pk/result-card-matric.html
final = r_obj.post(url_needed,verify=False,data=data)
soup1 = BeautifulSoup(final.content,"lxml")
detail_tab = soup1.find_all("table")
Are there any code examples left?
New code examples in category Python
-
Python 2023-04-11 03:04:20
-
Python 2022-03-27 22:40:04 pycharm no module named
-
Python 2022-03-27 22:25:05 assign multiple variablesin one line
-
Python 2022-03-27 22:20:02 levenshtein distance
-
Python 2022-03-27 21:35:09 get text from url python last slash
-
Python 2022-03-27 21:30:30 df concatenate df
-
Python 2022-03-27 21:25:09 python odd or even
-
Python 2022-03-27 21:15:32 python include function from another file
-
Python 2022-03-27 21:10:01 color module python
-
Python 2022-03-27 21:00:27 python tkinter cursor types