Home Artificial Intelligence (AI) NVIDIA AI Podcast: How Deep Learning Can Translate American Sign Language

NVIDIA AI Podcast: How Deep Learning Can Translate American Sign Language

NVIDIA AI Podcast: How Deep Learning Can Translate American Sign Language

Deep learning has accelerated machine translation between spoken and written languages. But it’s lagged behind when it comes to sign language.

Now Syed Ahmed, a computer engineering major at the Rochester Institute of Technology, is unleashing its power to translate between sign language and English.

“You want to talk to your deaf or hard of hearing friend, but you don’t know sign language, what would you do in that case?” says Ahmed, a research assistant at the National Technical Institute for the Deaf, in a conversation with Michael Copeland in this week’s episode of the AI Podcast.

Ahmed fed around 1,700 sign language videos into a deep learning algorithm. The model was able to analyze physical movements and translate it into American English.

“You point your phone at your friend and while they sign, automatic captions appear on your phone,” Ahmed said.

Bridging a gap between a visual language and a written language, the model’s possibilities are endless, according to Ahmed. The AI’s ability to map body language can help predict certain health conditions. In an augmented world, phones wouldn’t be a necessary medium with translated words appearing on the side of the speaker’s face.

Testing is still underway. Since the model is as good as the data set, one of the challenges the system has faced is interpreting colloquial terms in ASL. The amount of videos the algorithm has to sort through also causes the output of captions to lag.

“It’s very new right now, in the future we will be making more experiments with decision making tasks,” Ahmed said.

Read the entire article here, AI Podcast: How Deep Learning Can Translate American Sign Language

via the fine folks at NVIDIA.

NVIDIA Since 1993, NVIDIA (NASDAQ: NVDA) has pioneered the art and science of visual computing. The company's technologies are transforming a world of displays into a world of interactive discovery -- for everyone from gamers to scientists, and consumers to enterprise customers.

Featured Resources:

Related Articles:


White Papers

    Application Lifecycle Management with Stratusphere UX – White Paper

    Enterprises today are faced with many challenges, and among those at the top of the list is the struggle surrounding the design, deployment, management and operations that support desktop applications. The demand for applications is increasing at an exponential rate, and organizations are being forced to consider platforms beyond physical, virtual and cloud-based environments. Users […]


      Download Commvault VM Backup and Recovery: end-to-end VM backup, recovery and cloud management

      Commvault’s ability to provide end-to-end VM backup, recovery and cloud management creates a significantly better way to build, protect and optimize VMs throughout their lifecycle. Our best-in-class software for VM backup, recovery and cloud management delivers a number of significant benefits, including: VM recovery with live recovery options; backup to and in the cloud; custom-fit […]

      On-Demand Webinars

        What’s Going on in EUC Printing – A Technical Deep Dive!

        The IGEL Community and ThinPrint invite you to watch the following technical deep dive webinar. The agenda is to technically bring you up to speed on what’s going on in the EUC Printing space today along with a deep dive into new methods, technologies, printing scenarios and a discussion on why printing still matters. You […]

        Latest Videos

          Views All IT News on DABCC.com
          Views All IT Videos on DABCC.com
          Win big $$, visit ITBaller.com for more info!

          Visit Our Sponsors