In the current biometric human recognition scenario, novel ideas are evolving to solve the errors in facial and ear recognition system. In this proposed work, a blooming new technique called location averaging technique is combined with few image processing transforms, i.e., location averaging technique is combined with FFT, DCT, and DWT for human face and ear recognition. Location averaging technique is a feature extraction/reduction process; it transforms the whole size of an image into a single column vector. It helps to accumulate more number of images for recognition system. Location averaged FFT, location averaged DCT, and location averaged DWT are the three methods proposed for face and ear recognition system. The standard face and ear database images are used for analyzing the accuracy, runtime, and mismatching. The maximum accuracy value of about 99% is achieved in shortest run time with less mismatching. © Springer Nature Singapore Pte Ltd. 2018.