#intelligentdataextraction

Infrrd Labs is working on tackling tough problems. Its focus is currently on key-value pairs, to better map data representations — such as mapping ‘Dallas’ to ‘City’, irrespective of document type. The company looks to build solutions that will be useful across customers and domains. It’s also trying to build models to account for common fields from the get-go, to further reduce the reliance on training data.

A Gartner analyst takes 20 calls a month on OCR and Intelligent Document Processing from enterprise buyers looking to make their next moves.

We asked him what they’re looking for in a data extraction solution.

And he said, “solution accuracy.”

Here’s why: Vendors aren’t generally willing to provide this most critical metric. Instead, they say, “it depends.” They don’t want to commit, which is unsatisfactory to the enterprises who have real money on the line.

We sat down with Amit Jnagal, Founder/CEO, to find out more about where Infrrd came from and where it’s headed.

Infrrd pivoted to financial services and used our understanding of harnessing unstructured content to tackle different business problems. We had built powerful AI capabilities, and this was a great way to use them.

We just had to decide where to focus and what customer problem to solve.

Are your employees spending too much of their time collecting and sorting paperwork, trapped in the monotony of keying in expenses and attaching receipts?Humans are the smartest and most expensive resource investment you can make. If you’re not making their time as productive as possible, you’ve got a problem that needs attention. And if receipt data extraction is stealing too much of their time, automation can save the day. What many organizations don’t realize is automation isn’t what it used to be. It’s far better now. Advancements in artificial intelligence and intelligent data capture make automation viable today, where it wasn’t just a few years ago.

Explore how Infrrd's artificial intelligence and machine learning could be applied in the oil and gas sector.

Optical Character Recognition (OCR) tools have come a long way since their introduction in the early 1990s. The ability of OCR software to convert different types of documents such as PDFs, files or images into an editable and easily storable format has made corporate tasks effortless. Not only this, it’s the ability to decipher a variety of languages and symbols give Infrrd OCR Scanner an edge over ordinary scanners.However, building technology like this isn’t a cakewalk. It requires an understanding of machine learning and computer vision algorithms. The main challenge one can face is identifying each character and word. So in order to tackle this problem we’re listing some of the steps through which building an OCR scanner will become much more clearer. Here we go:

1. START WITH OPTICAL SCANNING: Consider the idea of putting together a good optical scanner, to begin with. With a scanner, one can capture an image of the original file or document. Remember to select an optical scanner (optical scanning system) with a good sensing tool and transport mechanism such that it can convert light intensity into grey levels. It’s a fact that printed documents are mostly in the format of black printed letters on a white background. Hence, the OCR scanner app must convert this into a bi-level white and black image which is known as thresholding.

2. DELVE INTO SEGMENTATION: Segmentation generally works in 2 ways – location and character. Location segmentation refers to the ability of the OCR software (optical recognition software) to locate the corners or regions of the document which has the printed data on it. Whereas if we talk about character segmentation, it’s the isolation of characters or words. Focus on writing specific OCR algorithms that can help attain these kinds of segmentation. Keep in mind that the fragmented characters should be isolated with vigilance, noise and text should be differentiated from each other, and graphs & geometric symbols interpreted properly.

3. PRE-PROCESSING IS A NECESSITY: This is a crucial component in every OCR engine. It processes the Raw data in different stages which makes it interpretable and usable by the system. Once the scanner has finished image scanning there may be certain amounts of noise in it or the characters may be broken. With pre-processing, we resolve such flaws once and for all. It includes smoothening and normalizing. Preparing data for OCR learning is an extremely vital step.

4. SEGMENT ONCE AGAIN: After a clean character image has been produced with pre-processing, it’s then segmented into several sub-components. This entire process includes an amalgamation of explicit segmentation (cutting up of a character into meaningful components via dissection) and implicit segmentation (a recognition-based process where an image is searched for components that match with the predefined class).

5. REPRESENTATION GOES A LONG WAY: Writing algorithms to make the OCR engine (OCR tool) represent characters or images is the next stage. The OCR engine extracts a set of features for each class when one feeds binary images or grey levels into the recognition system. This, in turn, helps in distinguishing these images from the rest. However, in most of these systems to avoid complexity and enhance the accuracy of the algorithms, we need a more compact and characteristic representation. The character representation has 3 main methods. They are global transformation and series expansion, statistical representation, and geometrical and topological representation.

6. FEATURE EXTRACTION SOLVES THE COMPLEXITIES: This is regarded as one of the trickiest components in an OCR scanner. The main objective is to extract the essential characteristics of symbols. There are different techniques for feature extraction such as the distribution of points, transformations and series expansions, and structural analysis. Also, during this process, it identifies and assigns each character to its apt character class through classification.

7. TRAINING AND RECOGNITION REDEFINE AN OCR: To investigate the OCR pattern recognition one can go ahead with template matching, statistical classification, syntactic or structural matching, and artificial neural networks. We need to train the system in a way that we can solve the problem which relates to limited vocabulary.

8. POST-PROCESSING GIVES A FINAL TOUCH: In this final process, activities like grouping, error detection and correction are conducted. During grouping, symbols in the text associate themselves with strings. After which we can obtain a set of individual symbols. However, it’s not possible to attain 100% correct identification of characters. We can detect and delete only some of the errors based on the context.To sum it all up, these steps are just the basic ones to help build an OCR engine. It does require a lot of effort and logic behind the codes. People are no longer using template-based models. Instead, they chose an artificial neural network to simplify the entire process of OCR building also. It also helps them to improve the quality of intelligent data extraction and recognition.