Distributed Data Mining is an interesting research community with respect to next generation of computing platform such as SOA, Grid and Cloud etc. and important paradigms such as Peer to Peer. There are mainly three types of Distributed Data Mining algorithms: DDM based parallel data mining agent, DDM based on mete learning, DDM based on Grid. In this paper analyses the key issues in Distributed Data Mining and a detailed survey on three kinds of DDM algorithms, its performance and its various pros and cons. The paper finally comes with an essential characteristics needed for a good DDM algorithm. © 2006-2014 Asian Research Publishing Network (ARPN).