#jsonpath

How to apply JSONPath expressions in C#, using the Json.net library.

Introduction In this tutorial we will learn how to apply JSONPath expressions in C#, using the Json.net library. Continue reading C#: JSONPath

How to apply JSONPath expressions in C#, using the Json.net library.

Introduction In this tutorial we will learn how to apply JSONPath expressions in C#, using the Json.net library. JSONPath is a powerful query language for JSON, similar to XPath regarding XML. In our examples below, we will focus on how to apply simple expressions, as our focus will be on how to use the C# API exposed by the Json.net library. How to apply JSONPath expressions We will start…

We will check how to apply JSONPath expressions to query JSON objects and obtain the values of the properties.

(more…)

Oleg Volodin

2015-03-05 20:07

           Comments                                    

This is the second post about extracting movie information from the site Justdial. The first one was devoted to scraping the same data using Selenium. This post describes the abilities of the Scrapy framework to extract data including dynamically loaded Javascript objects.

Scrapy is the great framework for crawling both the whole site and the only part of it. Along with crawling, Scrapy can be used for extracting, processing and saving data. Moreover, Scrapy uses Twisted asynchronous networking Python library.

Unfortunately, Scrapy cannot download the part of a webpage that is loaded by means of JSON. In this post I'll show how to circumvent this flaw.

In the beginning, we should create a spider in the Scrapy standart spider folder. Read more