Stability exploration has drawn more attention in contemporary research for huge interconnected power system. It is a complex frame to describe the behaviour of system, hence it can create an overhead for modern computer to analyse the power system stability. The preliminary design and optimization can be achieved by low order liner model. In this paper, the design problems of SMIB-GPSS and SMIB-MBPSS are considered to compare the performance of PSO and GA optimization algorithms. The performance of both optimization techniques are then compared further. Simulation results are presented to demonstrate the effectiveness of the proposed approach to improve the power system stability.