I recently posted looking for previous work on clinical trials scraping. As part of the Open Trials project, we’re on a continuing hunt for work done scraping other sources of clinical trial information, e.g. this work done on scraping Australia New Zealand Clinical Trials. A list of ideal registries is available here. Any suggestions?
At ContentMine, we have already built scrapers for doing work like this. For example here.
We’d be more than happy to help.