less subscribe buttons more rss feeds

anyway i am thinking of making a furaffinity to rss scraper

i found an existing one but it quotes lowtax in its readme so im going to pass

maybe someone who is actually familiar with how fa works should be doing this instead of me

it is extremely frustrating that i could scrape almost everything i need in a single request *except* submission date for which i need to visit each submission's page

this *could* have been easy but instead i'm going to have to involve *cache*

why does FA insist on calling every time zone "Something Standard Time"

shout outs for not having the same wonky time zone list as half the web but no shout outs for, whatever the fuck this is

Follow

update on this garbage: it works

i do not know how careful i should be hitting fa with automated requests so i'm not making it public quite yet

@codl you really really really gotta hammer them to get banned, i've done sustained 3-4 requests a second without being banned in the past

@codl I've written a browser extension that opens all submission links on a page into new tabs with a default rate limit of 1 sec per link, which is almost always fine. If the site is under heavy load it will sometimes start throwing 503s but it's rare. I imagine each link generates at least a couple of requests.

Sign in to participate in the conversation
Chitter

Chitter is a social network fostering a friendly, inclusive, and incredibly soft community.