This chapter describes with the comparison of the most used back propagations training algorithms neural networks, mainly Levenberg-Marquardt, conjugate gradient and Resilient back propagation are discussed. In the present study, using radial overcut prediction as illustrations, comparisons are made based on the effectiveness and efficiency of three training algorithms on the networks. Electrical Discharge Machining (EDM), the most traditional non-traditional manufacturing procedures, is growing attraction, due to its not requiring cutting tools and permits machining of hard, brittle, thin and complex geometry. Hence it is very popular in the field of modern manufacturing industries such as aerospace, surgical components, nuclear industries. But, these industries surface finish has the almost importance. Based on the study and test results, although the Levenberg-Marquardt has been found to be faster and having improved performance than other algorithms in training, the Resilient back propagation algorithm has the best accuracy in testing period.