Using Deep Learning for Tabular Data

Let’s use a neural network to make predictions on tabular data. What kinds of problems are a good fit for neural nets? What are the benefits? What are some concerns about using neural networks?