Algorithms of the Intelligent Web

Customer Reviews

• A soon to be classic Algo book for improving intelligent web applications  Jun 19, 2009 (33 of 33 found this helpful)

  I have always had an interest in AI, machine learning, and data mining but I found the introductory books too mathematical and focused mostly on solving academic problems rather than real-world industrial problems. So, I was curious to see what this book was about.
  
  I have read the book front-to-back (twice!) before I write this report. I started reading the electronic version a couple of months ago and read the paper print again over the weekend. This is the best practical book in machine learning that you can buy today -- period. All the examples are written in Java and all algorithms are explained in plain English. The writing style is superb! The book was written by one author (Marmanis) while the other one (Babenko) contributed in the source code, so there are no gaps in the narrative; it is engaging, pleasant, and fluent. The author leads the reader from the very introductory concepts to some fairly advanced topics. Some of the topics are covered in the book and some are left as an exercise at the end of each chapter (there is a "To Do" section, which was a wonderful idea!). I did not like some of the figures (they were probably made by the authors not an artist) but this was only a minor aesthetic inconvenience.
  
  The book covers four cornerstones of machine learning and intelligence, i.e. intelligent search, recommendations, clustering, and classification. It also covers a subject that today you can find only in the academic literature, i.e. combination techniques. Combination techniques are very powerful and although the author presents the techniques in the context of classifiers, it is clear that the same can be done for ecommendations -- as the Bell Korr team did for the Netflix prize.
  
  I work in a financial company and a number of people that I work with have PhD degrees in mathematics and computer science. I found the book so fascinating that I asked them to have a look. They had nothing but praise for this book. The consensus is that everything is explained in the simplest possible way, with clarity but without sacrificing accuracy. As one of them told me, this is a major step forward in teaching AI techniques and introducing the field to millions of developers around the world. Even for experts in the field and experienced software engineers, there are important insights in almost every chapter.
  
  We had tried to write a software library, for a small project, that analyzes log files and assesses IT risk (e.g. probability of intrusion; preemptive alerts on application performance issues, and so on) based on Segaran's book "Programming collective intelligence". We spend about six weeks trying to find how to match what was in Segaran's book and what we wanted to do but we did not find the depth and clarity that was required. On top of that, Segaran used Python so the code had to be rewritten and things didn't quite work as expected! We are now using the code from Marmanis' book and our code analyzes apache and weblogic log files in order to assess risk! It just works! We wrote the code in one week! We would not have been able to succeed without reading this book.
  
  Clearly, I am deeply impressed. This is an outstanding book; it was not just useful, it was inspiring! It is a "must have" book for every Java developer.
  
  The content of the book includes:
  * the PageRank algorithm; a content based algorithm similar to PageRank to which the author coined the term "DocRank" because it applies to Word, PDF, and other documents rather than Web pages; search improvements based on probabilistic methods (Naive Bayes); precision, recall, F1-score, and ROC curves;
  * collaborative filtering as well as content based recommendations;
  * k-means, ROCK, DBSCAN for clustering; the best explanation about the "curse of dimensionality" ever! I finally learned what this mystic term means!
  * Bayesian classification; declarative programming

• Artfully splits the difference between providing recipes and teaching algorithms  Aug 16, 2009 (16 of 16 found this helpful)

  This is a book that is for the working professional who already knows Java and wants to not only implement intelligent algorithms, he/she wants to understand the theory behind it. All of the code is in Java, so if you don't know this language this book will be over your head. It would also help if you have some background in algorithms along the lines of the material covered in Introduction to Algorithms.
  
  The author is attempting to teach both the algorithms behind the information retrieval that is done on the web and at the same time show those algorithms implemented in Java in such a way that it is clear to the reader what has been done. This approach can be a tricky middle ground often resulting in books that are confusing from both a textbook and from a cookbook standpoint. Fortunately, the author has done a good job of integrating these two viewpoints into a cohesive whole and the result is a book I can heartily recommend. The author makes liberal use of figures and explains what is being done at a high level first, showing pseudocode before actually showing the Java code. Discussions on the inner workings of the algorithms follow.
  
  Note that use is made of higher level libraries such as Lucene when they are available, because this is a book for professionals after all, and your boss would not be pleased if you reinvented the wheel every time you implemented an algorithm. But, don't worry, the explanation behind the code is there too. Another good book that is language agnostic that makes a good companion to this one is Machine Learning (Mcgraw-Hill International Edit). It is an oldie but a goodie.
  
  The product description does not yet show the table of contents so I do that next:
  
  Chapter 1. What is the intelligent web?
  Section 1.1. Examples of intelligent web applications
  Section 1.2. Basic elements of intelligent applications
  Section 1.3. What applications can benefit from intelligence?
  Section 1.4. How can I build intelligence in my own application?
  Section 1.5. Machine learning, data mining, and all that
  Section 1.6. Eight fallacies of intelligent applications
  Section 1.7. Summary
  References
  
  Chapter 2. Searching
  Section 2.1. Searching with Lucene
  Section 2.2. Why search beyond indexing?
  Section 2.3. Improving search results based on link analysis
  Section 2.4. Improving search results based on user clicks
  Section 2.5. Ranking Word, PDF, and other documents without links
  Section 2.6. Large-scale implementation issues
  Section 2.7. Is what you got what you want? Precision and recall
  Section 2.8. Summary
  Section 2.9. To do
  References
  
  Chapter 3. Creating suggestions and recommendations
  Section 3.1. An online music store: the basic concepts
  Section 3.2. How do recommendation engines work?
  Section 3.3. Recommending friends, articles, and news stories
  Section 3.4. Recommending movies on a site such as[...]
  Section 3.5. Large-scale implementation and evaluation issues
  Section 3.6. Summary
  Section 3.7. To Do
  References
  
  Chapter 4. Clustering: grouping things together
  Section 4.1. The need for clustering
  Section 4.2. An overview of clustering algorithms
  Section 4.3. Link-based algorithms
  Section 4.4. The k-means algorithm
  Section 4.5. Robust Clustering Using Links (ROCK)
  Section 4.6. DBSCAN
  Section 4.7. Clustering issues in very large datasets
  Section 4.8. Summary
  Section 4.9. To Do
  References
  
  Chapter 5. Classification: placing things where they belong
  Section 5.1. The need for classification
  Section 5.2. An overview of classifiers
  Section 5.3. Automatic categorization of emails and spam filtering
  Section 5.4. Fraud detection with neural network

• Instructive and entertaining review of algorithms and techniques relevant to providing intelligent web apps  Dec 8, 2009 (4 of 4 found this helpful)

  This books is not a "heavy" Artificial Intelligence tome. Instead it is a thought-provoking, instructive and very enjoyable read. It covers many of the everyday problems that web applications face: searching, clustering, relevance, etc.. In general, problems involving large quantities of typically imperfect, multi-dimensional data.
  
  I have been working with these kinds of problems for several decades now and this is one of the best books I've come across. It is particularly relevant to the problems that are typically faced by web application developers in the Web 2.0 era.
  

• Great insight into intelligent web designs  Oct 18, 2009 (1 of 1 found this helpful)

  I do have a decent background in crawling and indexing websites. This book was a pleasant read and gave a to-the-point, no-nonsense
  technical guidance for IR techniques. This covers most of the areas for web crawling/indexing in a simple straight forward manner.
  It has great Java code snippets that are easy to follow. And the authors certainly know what they're talking about. For best use, have some working knowledge of Java programming.

• Author is intelligent and articulate  Jun 12, 2009 (4 of 21 found this helpful)

  I attended a talk given the by author last night at the New England Java User's Group on the same topic as the book (full disclosure I haven't read the book yet, but there are no reviews yet so this may be better than nothing!). The author is funny and engaging and makes even the more mathematical aspects of calculating recommendation similarity feel interesting. His examples are simple enough to be be easily understood and yet full enough to illustrate the depths and complexities of the problems being solved.