Optimizing energy consumption is the main concern for designing and planning the operation of the Wireless Sensor Networks (WSNs). Clustering technique is one of the methods utilized to extend lifetime of the network and balancing energy consumption among sensor nodes of the network. In this paper, we propose the recently developed, heuristic optimization algorithms like Particle Swarm Optimization (PSO) and Tabu Search Algorithm(TSA) as well as the traditional Fuzzy C-Means (FCM) clustering algorithms. A comparison is made with the well known cluster-based protocol approach developed for WSNs known as harmony search algorithm which is music based Meta heuristic optimization method. Simulation results demonstrate that the proposed protocol using hybrid can reduce energy consumption and improve the network lifetime.