#cloudscrape

After creating the robot on CloudScrape I then set it off on a “run”. It took 48 hours for this to be completed. The outcome of the robot’s run was a CSV file that contained the name , weight, and price of  5749 products that were available on the mysupermarket.co.uk that fulfilled the criteria of the items on our UK Food list. It all appeared perfect at first but then there was another slight obstacle. The robot set off at 10 different locations at the same meaning that the CSV file was completely mixed. To overcome this I had to use the filter function in Excel to sort the data. I simply had to select filter and choose by “contains” and then searched for the name of the food item in the name column. I then copy and pasted these items  into a different Excel sheet and categorised them appropriately. This proved a very effective strategy although it was a little time consuming and tedious. 

CloudScrape have developed an easy to develop “robot” system that is capable of scraping data from websites. You simply have to hover over the feature on the website which you wish to extract. After a number of times the program recognises the features and duplicates this on ever element available. I simple made a loop of the elements I wished to extract which can be seen at the bottom of the photos 

A couple of days after my post on “Expats living in Copenhagen” I was linked to the Linkedin profiles of Henrik and Stefan. These two guys were the co founders of CloudScrape, a web scraping tool that turned out to be capable of completing my task !!!!