Is using beautiful soup, selenium headless, and/or scraping against the TOS?
If not I can’t fathom why I keep getting the browser messaage about not being able to use this Replt.
In a bit of a fit I started hooking up brew (osx), vscode & it’s various extensions and tools on my local machine & Replit is far easier to get up and running etc etc…
If not breaking the TOS, what is happening??
Can we see your code and try to identify the problem? (by the way, this would be a better fit in Replit Help rather than General)
Hi @SteveMallett !
What website are you trying to scrape?
If you are trying to scrape secure sites like government sites etc, I think that they could be blocked by Replit.
It’s a reddit sub, and I’m not scheduling it or hitting it as much as I would reddit itself.
Should/Can I move it to that topic?
I’ve already moved the topic to Replit Help. I also notified staff BTW, so hopefully they respond soon.
I used Beautiful Soup once to scrape my own website (for testing purposes). I got no such error. To my knowledge (which could be wrong), web scrapers are not inherently against the Replit ToS.
If there is a visible error, can you please show it? If you’re just asking about the nature of scraping, it should be allowed. Just remember to not scrape websites that Replit banned or your repl will go down.
IIRC (probably wrong) scraping is in the 100 days of Python thing? IDK, just remember seeing it somewhere on Replit.
Could we have your repl link?
The Repl: https://replit.com/@SteveMallett/UFO3-reddit
I’ve just finished the 100 days of python course so:
- Primarily looking for a reason why the code would trigger not being to 'use this Repl… TOS… " msg in the browser.
- Secondary, newb python coder tips welcome.
The link you have provided is a 404.
try now. private → public
We do not do this, please do not suggest things without evidence
also https://old.reddit.com is more lightweight, especially with JS disabled