Vision-based recognition of hand gestures is a challenging project in computer science.This paper puts forward and realized a practical gesture system which can be used in controlling robot and HCI.