Looking for AR/VR developers to support research for people who are deaf and hard of hearing
We’re a research group in UW CSE and are looking for undergrad or masters students who have experience with coding AR/VR applications, particularly on Microsoft HoloLens, or at the very least fluency with programming in Java. Experience with Machine Learning and NLP is a bonus. This is a volunteer or for-credit (e.g. an independent study) research opportunity. The project will involve building real-time captioning applications on HoloLens, including integration of automatic speech transcription, speaker segmentation, and showing topical information. See this preliminary paper for more details. Once built, we will evaluate the app with people who are deaf and hard of hearing. You will be working closely with a grad student, Dhruv Jain and will interact regularly with our NSF sound awareness team. We are aiming for a conference publication (our group has a strong publication record in top tier conferences), and depending on the work accomplished, an open source release of the app.
If interested, fill out this form and send an email to Dhruv Jain (djain@cs.uw.edu) with your resume and a brief explanation of your interest and experience.
Need android or IoS developers for research on sound awareness for people who are deaf or hard of hearing
Calling out to undergrad and masters students with android or IoS programming experience to develop a smartwatch sound awarness app! You could volunteer or opt for course credits (e.g. using an independent study). We’re a group of HCI researchers making tools to support sound awareness for people who are deaf of hard of hearing. The project will involve loading an existing tensorflow based model onto a smartwatch and making an interactive app to sense and display visaulizations for sound information (such as type of sound, location, loudness, pitch) to the wearer. You will be working closely with a grad student, Dhruv Jain and will interact regularly with our NSF sound awareness team. We are aiming for a conference publication (our group has a strong publication record in top tier conferences), and an open source release of the app.
If interested, fill out this form and send an email to Dhruv Jain (djain@cs.uw.edu) with your resume and a brief explanation of your interest and experience.