The American Society for Deaf Children

Un enfoque distinto para enseñar el abecedario en lenguaje de señas

Para abordar la privación del lenguaje y ayudar a salvar la barrera de comunicación entre niñxs sordxs o con dificultades de audición y sus padres, madres y compañerxs, Hello Monday/DEPT® se asoció con la American Society for Deaf Children para crear Fingerspelling.xyz, una experiencia de hand-tracking que usa machine learning para ayudar a lxs usuarixs a aprender el abecedario en lenguaje de señas.

La importancia del abecedario en lenguaje de señas

En Argentina, la hipoacusia afecta a entre 700 y 2.100 niñxs al año. El 90% de estxs niñxs nacen de padres y madres que no presentan dificultades en la audición y, en muchos casos, su hijx es la primera persona sorda que conocen.

Si no se le presenta el lenguaje de señas en una etapa temprana, unx niñx sordx puede perder el aprendizaje del idioma. Esto puede conducir a un retraso o privación del lenguaje, lo que tiene un impacto negativo en el largo plazo en su vida. Por eso es tan importante que los padres, madres y compañerxs de niñxs sordxs tengan la oportunidad de aprender el lenguaje de señas lo antes posible.

Una experiencia de aprendizaje lúdico

Fingerspelling.xyz es una web app que utiliza una cámara web y machine learning para analizar las formas de sus manos y lograr que lxs usuarixs aprendan el alfabeto ASL correctamente. El deletreo manual es una parte esencial de ASL, el idioma principal de la comunidad estadounidense de sordxs. A menudo se usa para nombres propios o para deletrear una palabra cuyo signo no se conoce.

La app muestra a lxs usuarixs una serie de palabras y utiliza un modelo 3D para demostrar cómo se debe colocar la mano para cada letra. Cuando lxs usuarixs replican la palabra, la cámara realiza un seguimiento de los movimientos de sus manos y proporciona información para que puedan hacer las correcciones necesarias. Esto le ayuda a desarrollar rápidamente sus habilidades de deletreo manual y pasar al siguiente nivel del programa.

El juego de fingerspelling es una excelente manera de presentar los conceptos básicos de ASL de una manera divertida y lúdica. En lugar de tener que leer o ver videos sobre deletreo manual, ofrecemos una herramienta de enseñanza online.

Anders Jessen, Founding Partner, Hello Monday

Las decisiones de diseño detrás de la web app

Desde una perspectiva de diseño, el objetivo era comunicar el deletreo manual de la manera más limpia y simple posible. Por lo tanto, la mano 3D se coloca de manera prominente en el centro del sitio y se combina con un tipo de letra divertido. Sus ángulos tienen un movimiento dinámico que refleja sutiles matices visuales en los gestos de las manos, y la apariencia ligeramente descentrada se siente alegre y cautivadora.

En cuanto al color, el objetivo era utilizar una paleta que fuera lo suficientemente audaz como para atraer a la gente y, al mismo tiempo, darles energía para comenzar a aprender a deletrear con los dedos. Captar la atención fue clave.

La mano 3D fue diseñada para sentirse amigable, con suficiente detalle para que los usuarios puedan ver fácilmente cómo se colocan y doblan los dedos. Una mezcla de estilo de dibujos animados y realismo fue la solución perfecta.

Sobre la tecnología utilizada

La característica principal del sitio es el seguimiento manual, para lo cual se utiliza MediaPipe Hands. Es extremadamente eficaz y puede detectar, incluso cuando partes de los dedos están ocultas detrás de otros dedos.

La tarea que consumió más tiempo fue definir cuándo se debe aceptar o no una carta de Fingerspelling. El equipo desarrolló un sistema basado en reglas para cada una de las letras que analiza la rotación de la mano; ya sea que mire hacia arriba, hacia abajo, hacia la izquierda o hacia la derecha. Si la orientación de la mano es correcta, observa cómo se coloca cada dedo y cuánto se dobla el dedo. La configuración de las reglas fue un proceso manual para cada letra que involucró mucho ensayo y error. Para asegurarse de que todos los signos se enseñen de la manera correcta, un profesor de ASL ayudó a probar todas las letras diferentes.

Una herramienta de aprendizaje reconocida en la industria de premios.

El resultado, Fingerspelling.xyz, está diseñado para escritorio, principalmente para ser utilizado por padres y madres de niñxs sordxs, pero puede ayudar a cualquiera a familiarizarse más con el alfabeto ASL al proporcionar una manera fácil y sencilla de comenzar.

Dentro de los 10 días posteriores al lanzamiento del sitio, se realizaron 150.000 señas manuales correctas. 10 meses después, se habían registrado más de 2,5 millones de señas manuales correctas. La American Society for Deaf Children ahora también usa Fingerspelling.xyz como parte de sus propios materiales de capacitación, lo que demuestra cuán útil es la herramienta.

Creamos esta herramienta de fingerspelling con Hello Monday/DEPT® para ayudar a padres y madres a apoyar el dominio del lenguaje de señas de sus hijxs y para que puedan compartir la alegría de comunicarse y conectarse con sus hijxs.

Cheri Dowling, Director of Outreach and Programs, American Society for Deaf Children

Fingerspelling.xyz ha tenido un impacto positivo para la comunidad sorda y su innovación ha sido reconocida con prestigiosos premios internacionales, que incluyen:

¿Preguntas?

Founding Partner, Hello Monday (part of DEPT®)

Anders Jessen

Justdiggit

Using the power of technology for a good cause

iStock 181126562 1 scaled

What do you get when you bring digital and tech together with a good cause? A digital marketplace where donors are linked to African farmers, who shovel life back into the barren soil.

The project

The climate is one of the major concerns of this generation. Realising this, Justdiggit trains people in areas of drought to dig half-moon circles in which rainwater is collected. This process of ‘greening’ ensures that the land will be fertile again within a year, something that is vitally important for the local population and which, on a larger scale, the whole world can benefit from.

Visual Light 105 1 scaled


Climate change is one of the major concerns of this generation

Visual Light 104 1 scaled

Spreading the knowledge

Justdiggit focusses on spreading their knowledge all the while empowering locals to organise and carry out the work themselves under the guidance of fundi’s, the local rangers. In order to have a lasting and positive effect on the climate, Justdiggit needs to fertilise as many hectares of land as possible, something it simply cannot do by itself. They believe that empowering the local population is a sustainable solution.

Justdiggit asked DEPT® how technology could help them achieve their goals. As we’re committed to making a change, the agency is a breeding ground for social and sustainable initiatives. So within DEPT®, a team was put together to give a helping hand.

Marketplace

In a strategy and design sprint, the team designed a platform where farmers who want to dig holes in a qualifying area are linked to people who want to sponsor them. Research showed that many of the farmers in African villages are well connected. They completely skipped landlines and ADSL and take care of a lot of business mobile. For example, over 40% of the population of Tanzania does their banking via M-Pesa, which amounts to 95 million mobile money transactions per month.

People in the West can easily donate money through Ideal and in the background, a system automatically connects the donations to all the farmers who are allowed to dig in a qualifying area. Once a hole has been dug, it is captured with a photograph. The donor receives the photo and the transaction overview. It is a fair system and a perfect example of cutting out the middleman, where Justdiggit is purely the facilitator.

The marketplace/app works as follows:

  • People in the West can easily donate money through Ideal.
  • In the background, a system automatically connects the donations to all the farmers who are allowed to dig in a qualifying area.
  • Once a hole has been dug, it is captured with a photograph. This photo is approved by a fundi, who acts as a kind of overseer, and then the transaction is made.
  • The donor receives the photo and the transaction overview. Digging a hole costs €3,64, of which €2,02 goes to the farmer (55%). The rest of the money goes to the purchase of seeds (27%) , the salary of the fundi (5%), transaction costs (5%) and the protection of project areas against overgrazing by cattle (8%). It is a fair system and a perfect example of cutting out the middleman, where Justdiggit is purely the facilitator.

Visual Light 103 4 scaled

Clear objectives

Real world challenges

Rabobank x Justdiggit

An all inclusive project

iStock 157313406 min scaled

Results

The most important quantitative goals of the platform in 2019 were to raise the average donation height. Our prognosis was that the combination of complete transparency of the chain and higher engagement by use of messenger and/or the platform would make this happen.

This worked out: the particular donations via the platform is now €34,35 per benefactor; that’s almost three times than the regular online donation to Justdiggit before the launch of the tool. This was far above expectations, especially when you keep in mind there’s been no paid media involved.

Questions?

Programme Manager

Koen Schunselaar

Van Gogh Museum

Step into the extraordinary

Trial2 scaled

More and more individuals are shifting towards digital channels to accomplish any and everything. Seeing this shift, the Van Gogh Museum understood that it needed to elevate its digital presence and ensure it was accessible to everyone. So they asked DEPT® to turn their existing website into a work of art.

Designing a new website worthy of Van Gogh’s art

vangogh3 scaled

The Approach

The iconic Van Gogh Museum in Amsterdam, dedicated to displaying the works of Vincent van Gogh, is one of the most important museums in the Netherlands. With over 200 paintings, 400 drawings, and 700 letters by the artist, it’s the largest Van Gogh collection in the world. To meet the demands of the digital world, the museum has partnered with DEPT® for the last two years. Together, we have created a new visual identity for the museum and developed the Unravel Van Gogh mobile app. But it was time to take it up a notch and design a new website worthy of Van Gogh’s art.

When you think of Van Gogh, colourful sceneries come to mind. So this was our starting point. We wanted the website to resonate with the user and leave an impression while, at the same time, being modest and simple in appearance. So, to kick off our design process, we started with an analysis which would enable us to make concrete recommendations for the museum’s future website. We researched the user journey and delved into any challenges they may face while browsing the current website, paying special attention to any difficulties those with a disability may encounter. 

vangogh4 scaled

Behind the brushstrokes


To ensure the content stood out and that the design did not compete with the work of Van Gogh or other work featured on the website but instead complimented it, we kept the design clean and minimalistic, giving it a timeless feel. We embraced the museum’s new identity, which was designed by Studio Dumbar (part of Dept) in 2018, by using similar colours and typography. We assigned each page to a different colour which was adapted to the work of art displayed on it, a feat rarely done amongst the white backgrounds of various museum websites. We also implemented subtle interaction animations and transitions to make the website feel light and engage the user. 

The museum website not only aims to inspire and entice visitors but also educate and delight them. However, the old story format didn’t promote users to read the content in its entirety.  So we updated the website’s story format by simplifying the layout while making it more snappy and interactive as the user scrolls down. This made the articles more appealing to read, especially for users coming from social channels. It also enabled editors to create and post content in a much quicker fashion.

vangogh5 scaled

Revealing the details of Van Gogh’s paintings digitally

The museum’s new website embarks in a voyage of discovery and inspiration, helping guide art lovers to the world of Vincent van Gogh. Ensuring users all around the world are inspired by how Van Gogh influenced art’s history and can connect with the museum in a desirable digital manner.

Experience the website

Questions?

UX Design & Research Lead

Franklin Schamhart

Mantengámonos en contacto!

Personalize your experience

We use functional cookies to make the website work properly, analytical cookies to measure your behavior and marketing cookies for ads- and content personalization. We collect data on how you use our website to make our website easier to use, but also to tailor or personalize communication in advertisements, on our website or apps. Data collected through marketing cookies is also shared with third parties. By clicking accept you agree to this. More information? Read our cookie policy.