Big Numbers in the News

[Egan Ford]

(06-08-2014 12:33 AM)Bill (Smithville NJ) Wrote:  The problem with this technique is that you must read between the lines of the documents to really understand the subtext of what the interaction is between the parties. For example, few people will actually write that something is unsafe. They will write in a very passive method that only vaguely touches on the real problem, if it even touches on the problem at all. Most companies will actually discourage anyone actively describing the problem.

Machine learning is becoming an increasing part of data analytics. The best example would be spam filters. It's possible to train/code a system to identify such things with reasonable accuracy. However, there are limits as you suggest.

The interaction between parties is actually a very well understood problem. Thanks to social media, and the need for many companies to extract information from complex patterns of interaction, a wealth of algorithms has emerged. Both awesome and spooky at the same time.