Tumblr is virtually dead - Printable Version +- Like Ra's Naughty Forum (https://www.likera.com/forum/mybb) +-- Forum: Fetishes, obsessions, traits, features, peculiarities (https://www.likera.com/forum/mybb/Forum-Fetishes-obsessions-traits-features-peculiarities) +--- Forum: General (https://www.likera.com/forum/mybb/Forum-General) +--- Thread: Tumblr is virtually dead (/Thread-Tumblr-is-virtually-dead) |
RE: Tumblr is virtually dead - Like Ra - 01 Mar 2019 It's a "standard" UNIX program/library, called "curl", not something written by me. https://en.wikipedia.org/wiki/CURL RE: Tumblr is virtually dead - occorics - 01 Mar 2019 before the "purge", I was using their old v1 API to download new images from a list of tumblrs... it still seems to work, even without authentication... so basically this call to get a list of photo-posts: curl -s "${TUMBLR}/api/read?type=photo&num=${MAX_POSTS}&start=0" (with $TUMBLR being the blog's URL) and then grep for 'photo-url', a bit sed-magic and wget... If you want, I can post the script... RE: Tumblr is virtually dead - Tinker D - 01 Mar 2019 May not be a bad idea. At lease if it’s posted here, it can’t get deleted unless Ra kills it, and we can reference it when we need it. Does that make sense? RE: Tumblr is virtually dead - occorics - 01 Mar 2019 aight, here it is... you pass it the URL of the blog you want to download. It will create directories for the images and for status-files (they store the id of the latest downloaded post, so subsequent runs won't re-download images) You'll probably need to adapt the WORKDIR variable... Code: #!/bin/bash RE: Tumblr is virtually dead - Like Ra - 01 Mar 2019 Good one! Thanks! The way do rip the entire tumblr blogs! (Unless there's an API limitation). But for the automatic update I need to get access to the RSS. Or ... create a new wordpress plugin, what would require much more time 😁 Need to check the API... RE: Tumblr is virtually dead - Like Ra - 01 Mar 2019 (01 Mar 2019, 16:28 )occorics Wrote: I take it you run several scripts in parallel, right? Otherwise (for one blog only) I would add an '&' at the end of the 'wget' line: Code: wget -P "$IMAGE_DIR" -nc -b "$PHOTO"& RE: Tumblr is virtually dead - Tinker D - 02 Mar 2019 Can’t you take an existing Wordpress Plugin and adapt it suit the needs rather than creating a whole new plugin? RE: Tumblr is virtually dead - Like Ra - 02 Mar 2019 (02 Mar 2019, 02:13 )Tinker D Wrote: Can’t you take an existing Wordpress Plugin and adapt itThat's what I usually do - tinkering 😁 The problem is - there are no similar plugins around. The one I use for the RSS feeds was deleted by the author from everywhere and is, obviously, not supported. It's quite complex and buggy, but it works so far. The most recent version has some bugs fixed, but the caching is removed, what catastrophically degraded the performance, so I use one of the versions, that, actually, needs to be rewritten. The bottom line is - currently I tweak only what can be easily tweaked without digging into the details, and what will bring the maximum benefit. (BTW, I'm not even a programmer 😁 ) RE: Tumblr is virtually dead - Like Ra - 02 Mar 2019 There is no access to the RSS feed in either APIv1 or APIv2, but what might work is the following: Program 1: o- Grab the last x posts in the XML format o- Convert the XML into the RSS XML o- Store the results in memcache, indexed by the site name Program 2: o- Serve HTTP requests from the locallost o- Return memcache entry according to the site name in the query Then configure the RSS feed grabber (the current WP plugin) to use the Program 2 URL The problem #1 - figure out how to convert the Tumblr XML response to an RSS feed. RE: Tumblr is virtually dead - occorics - 02 Mar 2019 (01 Mar 2019, 17:54 )Like Ra Wrote: Good one! Thanks! The way do rip the entire tumblr blogs! (Unless there's an API limitation). It will only rip everything new. That's what the STATFILE is for. It stores the id of the latest downloaded post and the script stops there on the next run. For the first run, it's limited by MAX_POSTS |