Skip to content
This repository has been archived by the owner on Dec 6, 2024. It is now read-only.

Latest commit

 

History

History
30 lines (16 loc) · 1.2 KB

readme.md

File metadata and controls

30 lines (16 loc) · 1.2 KB

Science Robotics Paper Download

This is a web crawler which can download all the papers on Sci Rob in 5 mins.

The technique architecture are based on Scrapy and Python.

Prerequisites

In order to use this crawler, you should make sure you have the access to the paper resources on science robotics website (right IP).

Finally, a pdf combination script (pdfcom.py) is provided for combining the papers belongs to one issue into one single pdf, also a pdf file containing all the downloaded pdfs are generated. Papers in the combined pdf file are arranged in their original order on the web.

Documentation

A detailed tutorial of scrapy and this demo are given at here.