Skip to contentSkip to conversation

docs/website: fixing query.yahooapis.com shutdown

PATCH New Angelo Compagnucci 3 participants 3 messages Feb 4, 2019

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 docs/website: fixing query.yahooapis.com shutdown

This patch rework the use of query.yahooapis.com to do the conversion from xml to json required by our script and moves to the use of a js library. Datas are therefore now converted in json format on the client.

Unfortunately, cause of the CORS restriction on nabble and buildroot.org, we cannot retrieve directly the xml data from these servers and we need a CORS proxy to do that.

---
I'm in contact with anbble system administrator to give us access to cors request for their mailing archive so hopefully we can remove the call to an external service in a not so distant future.

 docs/website/footer.html     |  1 +
 docs/website/js/buildroot.js | 19 +++++++++----------
 2 files changed, 10 insertions(+), 10 deletions(-)
docs/website/footer.html +1 -0
index 5b18047..820c269 100644
@@ -1,6 +1,7 @@
 	<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/3.1.1/jquery.min.js" integrity="sha256-hVVnYaiADRTO2PzUGmuLJr8BLUSjGIZsDYGmIJLv2b8=" crossorigin="anonymous"></script>
 	<script src="https://cdnjs.cloudflare.com/ajax/libs/twitter-bootstrap/3.3.7/js/bootstrap.min.js" integrity="sha256-U5ZEeKfGNOja007MMD3YBI0A3OSZOQbeG6z2f2Y0hu8=" crossorigin="anonymous"></script>
 	<script src="https://cdnjs.cloudflare.com/ajax/libs/clipboard.js/1.7.1/clipboard.min.js" integrity="sha256-Daf8GuI2eLKHJlOWLRR/zRy9Clqcj4TUSumbxYH9kGI=" crossorigin="anonymous"></script>
+	<script src="https://cdnjs.cloudflare.com/ajax/libs/x2js/1.2.0/xml2json.min.js" integrity="sha384-pEpOtyRrTt7XzQzg30fXkhig417px5mP0UbPdI8mjl2KehUX2bDT807mfjJkg1H2" crossorigin="anonymous"></script>
 	<script type="text/javascript" src="js/buildroot.js"></script>
 </body>
 </html>
docs/website/js/buildroot.js +9 -10
index ec28cbb..fa5ad9a 100644
@@ -1,17 +1,16 @@
 function load_activity(feedurl, divid) {
-    var yqlURL = "https://query.yahooapis.com/v1/public/yql";
-    var yqlQS = "?q=select%20entry%20from%20xml%20where%20url%20%3D%20'";
-    var yqlOPTS = "'%20limit%2010&format=json&callback=";
     var container = document.getElementById(divid);
-    var url = yqlURL + yqlQS + encodeURIComponent(feedurl) + yqlOPTS;
-
-    $.getJSON(url, function(data){
-        var result = data.query.results;
+    $.ajax({
+      url: "https://cors.io/?" + feedurl
+    })
+    .done(function(data){
+        var x2js = new X2JS();
+        var result = x2js.xml_str2json(data);
         var loaded = 0;
         var nb_display = 8;
         if (result==null) return;
-        for (var i = 0; i < result.feed.length; i++) {
-            var entry = result.feed[i].entry;
+        for (var i = 0; i < result.feed.entry.length; i++) {
+            var entry = result.feed.entry[i];
             if (entry.title.indexOf("git commit") != -1)
                 continue;
             loaded += 1;
@@ -24,7 +23,7 @@ function load_activity(feedurl, divid) {
             var text = document.createTextNode(data);
             link.appendChild(text);
             link.title = entry.title;
-            link.href = entry.link.href;
+            link.href = entry.link._href;
             div.appendChild(link);
             container.appendChild(div);
         }
Signature · 1 line
2.7.4
#1 lore raw

PATCH 1/1 docs/website: fixing query.yahooapis.com shutdown

Quoted 9 lines · On Mon, 4 Feb 2019 14:30:04 +0100 Angelo Compagnucci…

This patch rework the use of query.yahooapis.com to do the conversion from xml to json required by our script and moves to the use of a js library. Datas are therefore now converted in json format on the client.

Unfortunately, cause of the CORS restriction on nabble and buildroot.org, we cannot retrieve directly the xml data from these servers and we need a CORS proxy to do that.

This patch doesn't apply to master.. because it depends on:

http://patchwork.ozlabs.org/patch/1035811/

which is not yet applied. When you have such dependencies, sending a series is preferred, as it makes the dependency obvious.

Thanks,

Thomas

Signature · 3 lines
Thomas Petazzoni, CTO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com
#2 lore raw

PATCH 1/1 docs/website: fixing query.yahooapis.com shutdown

In reply to Angelo Compagnucci
Quoted 11 lines
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line

"Angelo" == Angelo Compagnucci <[email protected]> writes:

This patch rework the use of query.yahooapis.com to do the conversion from xml to json required by our script and moves to the use of a js library. Datas are therefore now converted in json format on the client.

Unfortunately, cause of the CORS restriction on nabble and buildroot.org, we cannot retrieve directly the xml data from these servers and we need a CORS proxy to do that.

Committed after changing the integrity tag to use sha256 for consistency with the others, thanks.

Signature · 1 line
Bye, Peter Korsgaard