Vision Controlled Wheelchair

Undergraduate #349
Discipline: Technology and Engineering
Subcategory: Computer Engineering

Nicholas Strawn - Virginia State University
Co-Author(s): James Finne and Ahnyjah Bradley, Virginia State University, Petersburg, VA

---

Transportation for an individual with disabilities remains an ongoing focal point in society. According to the United States Census Bureau, as of 2010 over 3.6 million individuals in America have a need for the use of a wheelchair. Functionality of a wheel chair has evolved over time to aid the physically disabled who have been limited in mobility, such as individuals who may be quadriplegic. The purpose of this design is to enhance the mobility of the aforementioned people through a wheel chair with vision control. Software of the design will rely on python and openCV to operate the vision controls. The objective of this project is to design and develop a prototype of a vision controller for an electric wheelchair that is controlled solely on eye movement. A data acquisition system will be located in a headset and consist of a camera and Raspberry Pi. Eye movement will be captured using a camera while Raspberry Pi processes the image and wirelessly sends the data to a control system. A wireless receiver and Arduino microcontroller will make up the control system. The system will generate signals that control the movement and direction of the wheelchair. A vision controlled electric wheelchair will display knowledge of programming, wiring, motors, troubleshooting, functionality and efficiency. This design demonstrates one of the many uses of computer vision, specifically, to simplify the lives and transportation of wheelchair users.

Funder Acknowledgement(s): Eisenhower Fellowship; Virginia State University

Faculty Advisor: Ali Ansari, aansari@vsu.edu