The goal of a machine learning regression problem is to predict a single numeric value. For example, you might want to predict the annual income of a person based on their sex (male or female), age, ...

Decision trees are useful modeling tools to help you make decisions. Decision trees offer a structure to organize options and help you understand the possible results of choosing specific options.

Dr. James McCaffrey of Microsoft Research says the technique is easy to tune, works well with small datasets and produces highly interpretable predictions, but there are also trade-off cons. The goal ...