Hi, I’m trying to use beautiful soup to get the html page of a yelp url, but it isn’t returning the full page when I run it in pythonanywhere, but it works fine when I run it on my computer on a local host site.
response = requests.get(“https://www.yelp.com/biz/famous-dumpling-house-san-jose”)
soup = BeautifulSoup(response.text, ‘html.parser’)
print(soup)
If I run this code in terminal on my computer, this code will print the entire page source of that url, but when I run it in pythonanywhere, the server log shows:
2019-08-28 02:58:11 #012#012#012#012#012#012 #012#012#012#012Yelp#012#012<link href=“https://s3-media2.fl.yelpcdn.com/assets/srv0/yelp_styleguide/118ff475a341/assets/img/logos/favicon.ico” rel=
2019-08-28 02:58:11
I saw this other topic, Web Scraping: Code Not Working in PythonAnywhere : Forums : PythonAnywhere, and it seems to be the same issue, but I don’t understand how to fix it.