loads datasets upload gibberish #176

Activity

1. frafra commented on Nov 18, 2020

   

   frafra

   on Nov 18, 2020

   ContributorAuthor

   More actions

   It seems to return a gzip file containing an HTML response "Resource not found".
2. frafra commented on Nov 18, 2020

   

   frafra

   on Nov 18, 2020

   ContributorAuthor

   More actions

   It looks for an url in the JSON file, which is not there, as ckanapi dumps datasets creates resources like this:

       {
         "description": "Coordinates of all sites included in the dataset",
         "format": "TXT",
         "name": "s-ptarmigan-counts-coordinates-txt",
         "path": "data/s-ptarmigan-counts-coordinates-.txt",
         "title": "S_ptarmigan_counts_coordinates.txt"
       },
   

   ckanapi/ckanapi/cli/load.py

   Line 289 in 8c563b8

   f = requests.get(resource['url'],stream=True)
3. frafra commented on Nov 19, 2020

   

   frafra

   on Nov 19, 2020

   ContributorAuthor

   More actions

   In addition to making dump compatible with loads, a suggestion could be to raise a warning or an error when accessing a resource with an HTTP error.
4. frafra commented on Feb 1, 2022

   

   frafra

   on Feb 1, 2022

   ContributorAuthor

   More actions

   ckanapi load datasets fails even when using ckanapi action ckan_package_search output, because it cannot get private datasets. CKAN returns a 404, potentially gzipped, which then gets uploaded as resource.