[Fremantle Maemo5] cuteNews - RSS news and podcast aggregator - Page 6 - maemo.org

Active Topics

The N900 is now 15 years old! (7)
to Nokia N900 by Danct12 - 23 hrs, 29 mins ago
Sailfish OS for the Motorola Moto G7 Power (XT1955-5) - (ocean) (4)
to SailfishOS by Maemish - 1 day, 18 hrs ago
F(x)tec Pro1x (QWERTY) for sale (0)
to Buy & Sell by aln00000 - 4 days, 3 hrs ago
more...

Page 6 of 6

« First

< Prev

Thread Tools

	Maemish	2020-02-23 , 19:57
	Posts: 1,719 \| Thanked: 4,765 times \| Joined on Apr 2018 @ Helsinki, Finland.	#51

After following this feed for a while with feedcircuit app downloading it to sdcard for offline read I can recommend this: http://www.theregister.co.uk/security/headlines.atom

Interesting up to date information about cyber security related topics.

__________________
"I don't know how but I can try!" (active)

Master of not knowing (active)

For me it is possible to get lost in any case (active)

Learning to fall from high (DONE)

Learning to code with BASIC (WIP)

Quote & Reply |

	nonsuch	2020-03-01 , 09:18
	Posts: 584 \| Thanked: 1,550 times \| Joined on Sep 2019	#52

Originally Posted by Halftux

Originally Posted by nonsuch
Some enclosure downloads (audio podcasts) fail with cutenews' inbuilt capabilities

An example would be nice.

OK, let's concentrate on that first.

Here's a podcast that fails to download - the error message inthe Download window is simply "Failed: Error downloading http://stitcher.acast.com/..........".

However, the original URL is "http://open.live.bbc.co.uk/mediaselector/6/redir/version/2.0/mediaset/audio-nondrm-download-low/proto/http/vpid/p0858555.mp3" - so there's some redirecting happening.
(source: https://podcasts.files.bbci.co.uk/p02nq0gn.rss)

The log says:

Code:

2020-03-01T10:58:48: PluginManager::getConfigForEnclosure(). No Plugin found for enclosure http://open.live.bbc.co.uk/mediasele...d/p0858555.mp3
2020-03-01T10:58:48: file:///opt/cutenews/qml/DownloadDialog.qml:56:13: QML Label: Binding loop detected for property "width"
2020-03-01T10:58:49: file:///opt/cutenews/qml/DownloadDialog.qml:56:13: QML Label: Binding loop detected for property "width"
2020-03-01T10:58:49: file:///opt/cutenews/qml/DownloadDialog.qml:56:13: QML Label: Binding loop detected for property "width"
2020-03-01T10:58:51: Transfers::addEnclosureDownload(). URL: http://open.live.bbc.co.uk/mediasele...d/p0858555.mp3
2020-03-01T10:58:51: Transfer::setStatus(). ID: eb33d4d4-28c7-409f-b384-09992f6519a1, Status: Queued
2020-03-01T10:58:52: EnclosureDownload::startDownload(). URL: http://open.live.bbc.co.uk/mediasele...d/p0858555.mp3
2020-03-01T10:58:52: Transfer::setStatus(). ID: eb33d4d4-28c7-409f-b384-09992f6519a1, Status: Downloading
2020-03-01T10:58:53: EnclosureDownload::followRedirect(). URL: http://flex.acast.com/ak/mpg_mp3_vlo...b45a9be2eb8edf
2020-03-01T10:58:54: EnclosureDownload::followRedirect(). URL: http://stitcher.acast.com/livestitch...AFARUOTJQ3BLOQ
2020-03-01T10:58:54: Subscriptions::getScheduledUpdates(). Fetching subscriptions due for update since 2020-03-01T10:57:54
2020-03-01T10:58:55: Transfer::setStatus(). ID: eb33d4d4-28c7-409f-b384-09992f6519a1, Status: Failed: Error downloading http://stitcher.acast.com/livestitch...AFARUOTJQ3BLOQ - server replied: Forbidden
2020-03-01T10:58:55: Transfers::save(). 1 transfers saved

So yeah, I can clearly see the server reply: Forbidden.

Trying the same with wget:

Code:

$> wget "http://open.live.bbc.co.uk/mediaselector/6/redir/version/2.0/mediaset/audio-nondrm-download-low/proto/http/vpid/p0858555.mp3"
--2020-03-01 11:09:31--  http://open.live.bbc.co.uk/mediasele...d/p0858555.mp3
Resolving open.live.bbc.co.uk... 212.58.244.79, 212.58.249.158
Connecting to open.live.bbc.co.uk|212.58.244.79|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://flex.acast.com/ak/mpg_mp3_vlo...a216906e3e18ef [following]
--2020-03-01 11:09:31--  http://flex.acast.com/ak/mpg_mp3_vlo...a216906e3e18ef
Resolving flex.acast.com... 13.226.39.56, 13.226.39.36, 13.226.39.47, ...
Connecting to flex.acast.com|13.226.39.56|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://stitcher.acast.com/livestitch...AFARUOTJQ3BLOQ [following]
--2020-03-01 11:09:32--  http://stitcher.acast.com/livestitch...AFARUOTJQ3BLOQ
Resolving stitcher.acast.com... 13.226.39.127, 13.226.39.88, 13.226.39.46, ...
Connecting to stitcher.acast.com|13.226.39.127|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 15559573 (15M) [audio/mpeg]
Saving to: ‘p0858555.mp3’

p0858555.mp3                                        100%[=============================>]  14.84M   758KB/s    in 25s     

2020-03-01 11:09:57 (609 KB/s) - ‘p0858555.mp3’ saved [15559573/15559573]

So wget manages to follow the redirects without getting thrown out.

I compared the last two links, they are similar but not identical; I guess the server generates new access tokens for each request. But why is wget allowed to download in the end, and cutenews isn't?

BTW, this isn't a one-off, I constantly download podcasts from this particular feed with wget because they constantly fail with cutenews.

__________________
N900 in 2020
SFOS in 2021

Last edited by nonsuch; 2020-03-01 at 14:26.

Quote & Reply |

The Following User Says Thank You to nonsuch For This Useful Post:
Halftux

	nonsuch	2020-03-01 , 14:24
	Posts: 584 \| Thanked: 1,550 times \| Joined on Sep 2019	#53

Originally Posted by Halftux

Originally Posted by nonsuch
Some enclosure downloads (audio podcasts) fail with cutenews' inbuilt capabilities

An example would be nice.

Here's another, quite different example.

The error message in the Download window is "Failed: Invalid argument".

No redirection this time, but a weird URL: "https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisode Id=810921169&orgId=1&d=300&p=500005&story=81092116 9&t=podcast&e=810921169&size=4500000&ft=pod&f=5000 05"
(source: https://www.npr.org/rss/podcast.php?id=500005)

The log:

Code:

2020-03-01T16:03:14: PluginManager::getConfigForEnclosure(). No Plugin found for enclosure https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005
2020-03-01T16:03:14: file:///opt/cutenews/qml/DownloadDialog.qml:56:13: QML Label: Binding loop detected for property "width"
2020-03-01T16:03:14: file:///opt/cutenews/qml/DownloadDialog.qml:56:13: QML Label: Binding loop detected for property "width"
2020-03-01T16:03:14: file:///opt/cutenews/qml/DownloadDialog.qml:56:13: QML Label: Binding loop detected for property "width"
2020-03-01T16:03:15: Transfers::addEnclosureDownload(). URL: https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005
2020-03-01T16:03:15: Transfer::setStatus(). ID: 0eac10f7-59ce-4b2c-9de0-06fea9b735e3, Status: Queued
2020-03-01T16:03:16: EnclosureDownload::startDownload(). URL: https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005
2020-03-01T16:03:17: Transfer::setStatus(). ID: 0eac10f7-59ce-4b2c-9de0-06fea9b735e3, Status: Failed: Invalid argument
2020-03-01T16:03:17: Transfers::save(). 1 transfers saved

With wget, I have to either specify a filename:

Code:

 $> wget "https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005" -O npr_news_03-01.mp3
--2020-03-01 16:05:19--  https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005
Resolving play.podtrac.com... 18.213.53.54, 34.196.186.246
Connecting to play.podtrac.com|18.213.53.54|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005 [following]
--2020-03-01 16:05:20--  https://edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005
Resolving edge1.pod.npr.org... 52.41.7.141, 52.42.159.223, 52.43.22.12, ...
Connecting to edge1.pod.npr.org|52.41.7.141|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://edge2.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3/newscast080812.mp3_a5d67f1441dbe2e75598bc7e9282a87d_4473020.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005&hash_redirect=1&x-total-bytes=4473020&x-ais-classified=download&listeningSessionID=0CD_382_60__30f5726f1d10f8fc0d1e9dd2e1fc3a0f0bfe053b [following]
--2020-03-01 16:05:21--  https://edge2.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3/newscast080812.mp3_a5d67f1441dbe2e75598bc7e9282a87d_4473020.mp3?awCollectionId=500005&awEpisodeId=810921169&orgId=1&d=300&p=500005&story=810921169&t=podcast&e=810921169&size=4500000&ft=pod&f=500005&hash_redirect=1&x-total-bytes=4473020&x-ais-classified=download&listeningSessionID=0CD_382_60__30f5726f1d10f8fc0d1e9dd2e1fc3a0f0bfe053b
Resolving edge2.pod.npr.org... 2600:9000:21dd:200:16:61a3:16c0:93a1, 2600:9000:21dd:8400:16:61a3:16c0:93a1, 2600:9000:21dd:cc00:16:61a3:16c0:93a1, ...
Connecting to edge2.pod.npr.org|2600:9000:21dd:200:16:61a3:16c0:93a1|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4473020 (4.3M) [audio/mpeg]
Saving to: ‘npr_news_03-01.mp3’

npr_news_03-01.mp3                                  100%[=========================>]   4.27M   608KB/s    in 9.6s    

2020-03-01 16:05:31 (457 KB/s) - ‘npr_news_03-01.mp3’ saved [4473020/4473020]

or shorten the URL:

Code:

$> wget "https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3"
--2020-03-01 16:11:45--  https://play.podtrac.com/npr-500005/edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3
Resolving play.podtrac.com... 34.196.186.246, 18.213.53.54
Connecting to play.podtrac.com|34.196.186.246|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3 [following]
--2020-03-01 16:11:47--  https://edge1.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3
Resolving edge1.pod.npr.org... 34.208.108.43, 34.218.166.10, 35.163.189.178, ...
Connecting to edge1.pod.npr.org|34.208.108.43|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://edge2.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3/newscast080812.mp3_a5d67f1441dbe2e75598bc7e9282a87d_4473020.mp3?hash_redirect=1&x-total-bytes=4473020&x-ais-classified=download&listeningSessionID=0CD_382_60__30f5726f1d10f8fc0d1e9dd2e1fc3a0f0bfe053b [following]
--2020-03-01 16:11:48--  https://edge2.pod.npr.org/anon.npr-mp3/npr/newscasts/2020/03/01/newscast080812.mp3/newscast080812.mp3_a5d67f1441dbe2e75598bc7e9282a87d_4473020.mp3?hash_redirect=1&x-total-bytes=4473020&x-ais-classified=download&listeningSessionID=0CD_382_60__30f5726f1d10f8fc0d1e9dd2e1fc3a0f0bfe053b
Resolving edge2.pod.npr.org... 2600:9000:21dd:7a00:16:61a3:16c0:93a1, 2600:9000:21dd:1000:16:61a3:16c0:93a1, 2600:9000:21dd:7c00:16:61a3:16c0:93a1, ...
Connecting to edge2.pod.npr.org|2600:9000:21dd:7a00:16:61a3:16c0:93a1|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4473020 (4.3M) [audio/mpeg]
Saving to: ‘newscast080812.mp3’

newscast080812.mp3                                  100%[==================================>]   4.27M   625KB/s    in 8.4s    

2020-03-01 16:11:58 (523 KB/s) - ‘newscast080812.mp3’ saved [4473020/4473020]

The resulting audio file is the same.

__________________
N900 in 2020
SFOS in 2021

Quote & Reply |

The Following User Says Thank You to nonsuch For This Useful Post:
Halftux

	Halftux	2020-03-01 , 16:05
	Posts: 868 \| Thanked: 2,516 times \| Joined on Feb 2012 @ Germany	#54

Originally Posted by nonsuch

Here's a podcast that fails to download

So here is what I did:
added feed

Code:

https://podcasts.files.bbci.co.uk/p02nq0gn.rss

Updating it and click on the *Topic Title*.
After this I clicked the top menu, then on Enclosures, then on the url and "Open url externally" the browser opens and ask to play with media player or to download. Clicked download and it is working, also media player is working. The button "Open URL in browser" is not working.

It seems I can't follow you what you did. I don't know how to use this url openers or if the custom download command really works.
The url is without ssl encryption so no problem for the browser.
Maybe you need to write an enclosure plugin. Don't know how the application works.

I did the same with the other podcast feed it has a ssl url but it is working too with this method.

edit: My test were done with the latest version from git and qssl correction and user-agent fix for app and client which hopefully solves all download problems. Released under cutenews 1.3.2

__________________
N900: gpxsee, fahrplan, gpscon, genwall, qrcode, hextool, libjansson4, libevent-2.0-5, cnee, psi-plus, mihphoto, shc

Maemo flasher/rescue live image.
Fremantle Harmattan SDK VM

Last edited by Halftux; 2020-03-01 at 22:35.

Quote & Reply |

The Following User Says Thank You to Halftux For This Useful Post:
nonsuch

	nonsuch	2020-03-03 , 07:43
	Posts: 584 \| Thanked: 1,550 times \| Joined on Sep 2019	#55

Originally Posted by Halftux

After this I clicked the top menu, then on Enclosures, then on the url and "Open url externally" the browser opens and ask to play with media player or to download. Clicked download and it is working, also media player is working. The button "Open URL in browser" is not working.

Ah!
What I do:

long-tap the enclosure URL and choose “Download”
a pop-up asks me to enter a command but I just leave that empty and tap “Done”

For most podcasts this works as expected.

It's good to know about an additional workaround though.
It works for the first podcast (BBC news), but NOT for the 2nd (NPR news).

edit: My test were done with the latest version from git and qssl correction and user-agent fix for app and client which hopefully solves all download problems. Released under cutenews 1.3.2

Thanks for the new version!
Unfortunately no change to either example from my posts above.

__________________
N900 in 2020
SFOS in 2021

Quote & Reply |

	Halftux	2020-03-03 , 11:32
	Posts: 868 \| Thanked: 2,516 times \| Joined on Feb 2012 @ Germany	#56

Originally Posted by nonsuch

It works for the first podcast (BBC news), but NOT for the 2nd (NPR news).

For me NPR news (03-03-2020 5AM ET) is working. Are you on cssu stable or testing?
I think you need microb-engine and libnss3 from community-testing.
Can you make a package look up for maemosec if all packages are from devel?

Code:

dpkg --list | grep maemosec

Maybe I implement enclosure download with wget and will also look into region problem.
But it could be for region that qt has a locale region bug or that something need to be changed for the sql database.
In principle I managed to download also with other region settings also with https by patching qhttpresponse.cpp. But then I guess the database gives wrong time or date and cutenews behave as there were no new feeds. The source is very modular and flexible but you need to make changes at many different location in the source.

__________________
N900: gpxsee, fahrplan, gpscon, genwall, qrcode, hextool, libjansson4, libevent-2.0-5, cnee, psi-plus, mihphoto, shc

Maemo flasher/rescue live image.
Fremantle Harmattan SDK VM

Quote & Reply |

The Following User Says Thank You to Halftux For This Useful Post:
nonsuch

	nonsuch	2020-03-06 , 07:23
	Posts: 584 \| Thanked: 1,550 times \| Joined on Sep 2019	#57

Originally Posted by Halftux

For me NPR news (03-03-2020 5AM ET) is working.

Mystery partly solved!
I still had an URL opener defined, and for some reason it activated for that download - and no other download afaics - but did not download anything.
The log shows it:

2020-03-06T09:09:49: PluginManager::getConfigForArticle(). No Plugin found for article https://play.podtrac.com/npr-500005/...t=pod&f=500005
2020-03-06T09:09:49: PluginManager::getConfigForEnclosure(). No Plugin found for enclosure https://play.podtrac.com/npr-500005/...t=pod&f=500005
2020-03-06T09:09:51: UrlOpenerModel::open(). URL: https://play.podtrac.com/npr-500005/...t=pod&f=500005, Command: /usr/bin/wget --ca-directory=/etc/certs/common-ca -q https://play.podtrac.com/npr-500005/...t=pod&f=500005 -O test.mp3

This is the urlopener:

Code:

[user:~/.config/cutenews] $> cat urlopeners 
[urlopeners]
1\regExp=http(s|)://.+\\.mp3.+
1\command="/usr/bin/wget --ca-directory=/etc/certs/common-ca -q %u -O test.mp3"
size=0

Of course, the question remains: why don't URL-openers and custom download commands work?

In case you still want to know about microb-engine and libnss3, afaics they're both on testing levels.
BTW, I'm using CSSU Thumb.

Code:

microb-engine:
  Installed: 1:20100401-1.9.2-5.2+0m5+0cssu3
  Candidate: 1:20100401-1.9.2-5.2+0m5+0cssu3
libnss3:
  Installed: 1:20100401-1.9.2-5.2+0m5+0cssu3
  Candidate: 1:20100401-1.9.2-5.2+0m5+0cssu3

Thank you for continued interest in this!

__________________
N900 in 2020
SFOS in 2021