Web scraping

We help companies get a competitive edge by extracting information from the web and turn it into machine readable data in order to extract insights and integrate it into existing systems which are typically business intelligence, a predictive model or a web application.

Request for a proof of concept meeting

Setup

The setup of a web scrape is done in a number of steps.

1 We have a meeting with you to discuss on what website you want to scrape and what you are planning to do with the data. Next we discuss on the type of data which is needed and the output format. Example on https://colruyt.collectandgo.be below.

2 Next we discuss on the type of data which is needed and the output format. We set up an initial scrape to see how quickly we can extract the information and give you a price proposal.

3 BNOSAC either packages the code so that you can schedule the scrape yourself or sets up the architecture to schedule the scrape at specific timepoints (outsourcing).

4 We make sure the data is integrated into your backend systems and set up the appropriate tooling to make sure you have information on the completeness of the scrapes, issues with the scrape or updated websites.

5 We can also support in building a frontend application on top of the data. More information on that here