Computer Vision is one of reasearch that gets a lot of attention with many applications. One of the application is the hand gesture recognition system. By using EmguCV, will be obtained camera images from webcam camera. The Pictures will be disegmented by using skin detection method for decrease noises in order to obtain the information needed. The final project of this system is to implement the convexity defect method for extracting images and recognize patterns of hand gesture that represent the characters A, B, C, D, and E. The parameters used in pattern recognition of hand gesture is the number and length of the line connecting the hull and defects derived from the pattern of hand gesture.