Changing a Lightbulb with a Hammer: Predictive Analytics with Machine Learning

Machine Learning (ML) isn’t so mystical after all. Machine Learning is a new term that re-packages well-established statistical techniques that have been around for decades. Machine Learning reacts to new information by learning. The “learning” happens by observing the past—sometimes the very recent past. Machine Learning can deliver on the promise of self-adjusting algorithms that can react to new information adeptly. However, before employing Machine Learning-driven predictions, ask this question: Is operating in a reactive mode our best option? Why not detail future events and their outcomes while linking the past and present to the many possible future outcomes—ML cannot deliver high-precision insights on the outcomes that have not yet transpired. Machine Learning can react, perhaps quickly, but is limited to past observations in development of predictive forecasts.

When limited to analyze a single data set—collected in the past—we are severely constrained. We cannot travel back into the past and generate another set of data so we’re limited with to the single historical data set, and we are forced to devise a clever approach to making the most out of badly weakened position.

This technique promises a lot with its new name: Machines will learn on their own—this is AI, isn’t it? Well, not really. Machine Learning refers to broad set of classifiers used to develop predictions from historical data. Supervised Machine Learning includes training a classifier using historical data:

1. Separate data into a training set and a test set.
2. Describe the data attributes in the training data set. This step may include shrewd clustering of data in groups, detection of patterns and anomalies, connecting models of nodes with links, and/or cyclical training, among other techniques. It attempts to draw insights out of the rear-facing data collection.
3. Apply a predictive technique to extract more information from the historical training data (many predictive techniques are available: decision trees, principal components, neural networks, etc.).
4. Use the test data to evaluate the predictor—see how closely you can predict known outcomes in the test data.
5. If not satisfied with the results, try another predictor. Repeat while minimizing error.
6. Once you settle on the best (or adequate) prediction algorithm, the Machine Learning predictions can be used to take new inputs (where the outcome is unknown) and predict a new result.
7. You may have to re-visit the process (re-train) if the environment generating the inputs changes. i.e. dynamic situations will reduce the effectiveness of your predictions.

The prediction algorithms are well known and generally available. The value is in the ability to quickly compare between multiple approaches and in having the ability to handle large historical data sets. Also, dealing with unstructured data, like free text, is useful to this approach. Recent growth in our ability to handle large and varied historical data sets at high speed has brought Machine Learning to the forefront of rear-view predictions.

Unsupervised Machine Learning examines the underlying structure in historical data using clustering algorithms to establish patterns and relationships. Machine Learning may outperform other forecasting techniques like exponential smoothing and moving averages. However, it is still constrained to historical data. So the accuracy of Machine Learning predictions is likely to be closer to traditional historical methods than to well-defined, high-resolution, predictive simulation (simulation supported by fine-tuned business rules and a representation of future events).

Machine Learning seeks to bypass the analyst-in-the-loop statistical modeling by mapping input factors to outputs without requiring various specific models to be tested. Instead, ML starts with the outcome and works to identify meaningful factors that drive that outcome, regardless of the relationship that links them. Machine Learning is not limited by assumptions of consistent data generation processes—like traditional forecasting techniques. However, Machine Learning predictions are limited by the focus on analyzing historical data.

We tend to regard ourselves as the Puppets of the Past.  As driven along by something that is always behind us.

–Alan Watts

Machine Learning is firmly rooted in historical data analysis and thus subscribes to the notion that the future is determined by observing the past. We’ve already established the need for realistic modeling of future operations. For accurate results in complex, dynamic systems, we need a more complete approach to analysis is free from the constraint that defines predictions in terms of a future being driven by the past. We understand that complex business processes may actually be defined in a manner that requires future events drive the past. We may see outcomes that decouple the future from the present and the past. Thus any model, like ML, that limits our view of operations to fit a rear-facing, reactive world view is severely hampered and bound to veer off target in complex, uncertain environments. Other clear, fast ways manufacturers can capitalize on data analytics can be found in our previous article.

This article was written by Serg Posadas, a published author and frequent speaker at conferences. Serg has over 20 years of experience in applied advanced predictive analytics deployments in industry and Department of Defense environments.