Oct 8, 2016
Machine Learning in Spark - LDA : A Complete example for clustering.
Machine Learning in Spark – LDA : A Complete example for clustering.
In this blog we will be demonstrating the functionality of applying the full ML pipeline over a set of documents which in this case we are using 10 books from the internet.
So lets start with first thing first..
What is Clustering ?
Clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to…
View On WordPress
#apache spark#cleaning data#clustering#clustering in distributed systems#distributed LDA#document Clustering#full example#introduction to machine learning#LDA algorithm#lemmatization#machine learning#Machine Learning Pipeline#Natural language processing#NLP#opensource#Spark#Spark package#stanford nlp#Stemming#Stopwords removal#testing#tokenization#Topic identification
