Due to the increasing in size of web information, it is needed to make a crawler with good scalability. Category based search engines are going to be the next generation search engines. Crawlers with good load balancing are required for Category based search engines. In this paper, we present a distributed web crawler architecture that holds goods for category support Search engine. Our category based search engine crawler splits the crawled data based upon the web page metadata into categories and distributes their storage and computing resources, with minimized communication cost. We also analyze the performance and scalability of the category based web crawler over traditional distributed web crawlers. © 2020 IEEE.