Brain tumor and intracerebral hemorrhage are major causes for death among the people. Brain tumor is the growth of abnormal cells multiplied in an uncontrolled manner in brain. Magnetic resonance imaging (MRI) technique plays a major role for analysis, diagnosis, and treatment planning of abnormalities in the brain. Bleed is detected manually by radiologists, but it is laborious, time-consuming, and error prone. The automatic detection method was performed to detect the tumor as well as bleed in brain under a single system. The proposed method includes image acquisition, pre-processing, patch extraction, feature extraction, convolutional neural network (CNN) classification, and fuzzy inference system (FIS) to detect the abnormality with reduced classification loss percentage. This chapter is compared with the existing system of tumor detection using convolution neural network based on certain features such as skewness, kurtosis, homogeneity, smoothness, and correlation.