Indian Journal of Science and Technology, Vol 9(18), DOI: 10.17485/ijst/2016/v9i18/89342, May 2016 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 * Author for correspondence 1. Introduction Smart antenna technology is used in mobile communication. Te coverage area, spectral efciency, reduction in interference and channel capacity can be enhanced by using smart antennas in mobile wireless communication 1 . Smart antenna is basically one type of adaptive antennas that are used various signal processing algorithms to identify the location of the user by the estimation of Direction of Arrival of signal. Afer the fnding of Direction of Arrival, antenna beam is located towards the mobile using beam forming network of the antenna array 2 . Smart antennas radiate maximum power in the direction of main beam which is in the direction of the user and produce nulls in the interference direction 3 . Te two main functions in smart antenna are Direction of Arrival (DOA) estimation and the adaptive beam forming. Te improvement of received signal quality depends on the determination of Direction of Arrival (DOA) of that signal, by accepting signal only from the desired direction and neglecting the interferences 4 . Te correct determination of signal direction, also known as received input signal DOA is very important aspect which needs in the formation of beam pattern only towards the desired direction from antenna, thereby minimizing the interference 5 . Te estimation of signal direction is important in various radio communication 6,7 . Te objective of DOA estimation is to utilize the signals received by the antenna array sensors to determine the signals direction from the actual users 6 . Tus, the DOA based algorithms which are used for estimation of angular position of a signal efects on the increment of received signal quality. Te algorithm of DOA or super resolution analyse the antenna array arrangements to better diagnose the received signals and they also can identify multiple location of targets. In other words, the success of smart antenna design depends on the precise Abstract Smart antenna system after determination of Direction of Arrival (DOA) of signal, generates beam toward user and null toward interferer and enhances the security and capacity in mobile network. The objective of the present work is to determine weaker coherent and non-coherent signals with low Signal-to-Ratio (SNR) in heavily faded areas, where performances of other conventional algorithms are not good. For the determination of weaker signal accurately, a combined method using Blind Source Separation (BSS) based Joint Approximation Diagonalisation of Eigen matrices (JADE) and Multiple Signal Classification (MUSIC) algorithm is used. From simulated results, it is found that the resolution of MUSIC algorithm can be enhanced using this combined method. Also the capability of detection of angle of incoming signal can be enhanced using this proposed method. Since, smart antenna system is one of the main technologies in fourth generation mobile communication and beyond, the proposed method may be useful for next generation mobile communication. Keywords: Blind Source Separation, Coherent and Non-Coherent Signals, Direction of Arrival, Multiple Signal Classifi- cation, Smart Antenna Direction of Arrival Estimation for Smart Antenna using a Combined Blind Source Separation and Multiple Signal Classifcation Algorithm Anwesha Dhar * , Anupama Senapati and Jibendu Sekhar Roy School of Electronics Engineering, KIIT University, Bhubaneswar - 751024, Odisha, India; anwesha.dhar100@gmail.com, senapati.anupama@gmail.com, drjsroy@rediffmail.com