Accueil - Portfolio d'Emmanuelle ABOAF
Transcription de la conférence How to make subtitles readable to everyone?
Transcript
Slide 1
Hello everyone !
I'm happy to give you this talk: how to make subtitles readable to everyone?
Like everyone else, I watch a lot of videos. Some are subtitled, others are not. When they are, it's often subtitled anyhow. That's the goal of this talk. I will give you some tips to better subtitle your videos.
Slide 2
Before we begin, I provide you with my written transcript of my talk.
Because I am deaf and French. I have an accent due to my deafness, I'm not sure that automatic subtitles will follow me.
Also, there are some videos without sound. I transcribed them for blind and visually impaired people.
You can scan the barcode or use the link : https://bit.ly/id24-captions-transcription. You will find the link given by one of the organizers of the event under my live.
Slide 3
First, let me introduce myself. My name is Emmanuelle ABOAF and I am French. I am deaf with two cochlear implants. I like to say I'm bionic.
I am a developer. I've been working in tech for 10 years and I speak a lot of accessibility especially web accessibility in France.
This is the first times I give this talk in English. I hope you understand me well despite my accent of deaf and French person. Otherwise you have my transcript to follow.
I work at Shodo. Shodo is an IT consulting agency in France. Our expertise is based on good design and development practices and we intervene on production, coaching and training activities.
I am also a member of the Duchess France association, which is an association representing women in tech in France. It is important to have a good Representation of women in tech especially women with disabilities as me.
I recently joined the CNCF Deaf and Hard of Hearing Working Group. The Deaf and Hard of Hearing Working Group is a volunteer-based group of the Cloud Native Computing Foundation (CNCF), part of the Linux Foundation. Our members are deaf/hoh, family members of deaf/hoh, and allies with a common mission: create pathways for deaf/hoh members to become active community members. How? (1) Educate the community about our needs and preferences and why it's important to include us; (2) provide best practices for you, employers, and conference organizers (help you help us); and (3) empower deaf/hoh to become more active by creating more opportunities for us to participate. Nothing about us without us.
I’m also very concerned about accessibility. It’s my fight every days.
Slide 4
Why subtitle ?
- According to the World Health Organization (WHO) over 5% of the world's population, or 430 million, are Deaf or Hard of Hearing (HoH);
- It helps people with others disabilities and people who are not native speakers of the language in the video;
- 85% of videos are watched without sound;
- Subtitles can also be used for marketing purposes;
- Subtitles are good for SEO.
Slide 5
What is the difference between subtitles and captions ?
Slide 6
You often hear this word but you don't know what it means?
Often we say "subtitles" but deaf and hard of hearing people say "captions". What's the difference?
Subtitles do not have any sound indications. There are the transcribed or translated dialogues.
Captions are subtitles for the Deaf and Hard of Hearing people. Captions contain sound indications.
We also use the term : Open captions and Closed captions.
What do they mean?
Slide 7
We have two kind of captions.
Closed captions are user-enabled captions. According to the plateforms, users can choose :
- font
- font size
- color of captions
- add background with color on captions.
The user can display or not display the captions as he wants.
For open captions, captions are embedded in the video. Everyone sees the captions. The users have no choice as to the display and the format of the captions.
Slide 8
So, let's talk about open captions.
That is the purpose of this talk. I see a lot of videos that are captionned any way and I'm going to show you why that's a problem.
Slide 9
To support my point, I will show you two videos of two deaf people who also work in accessibility and who explain why these captions can be problematic.
These two videos have no sound, that's normal. So focus on captions.
For blind and visually impaired people looking at me, there is a transcript.
Slide 10
I really appreciate the work of Meryl Evans and Alexa Heinrich I invite you to follow them on LinkedIn because they do a lot of popularization on the accessibility of captions in English just like I do in French. Their videos are fun and educational.
Meryl Evans' post
"Without further ado ... I've created a brand new side-by-side video. One uses captioning best practices (except it's open instead of closed) and the other uses different types of Hormozi-style options. Which do you prefer?"
Transcript of Meryl Evans’ video
A side-by-side video. On the left, a good captions and on the right, captions with different styles.
Meryl Evans says :
"Howdy, y’all! This is a talking head video. I want
to show you some examples of Hormozi-style captions. They are all about looks
pizzazz and branding. They may contains all caps, Karaoke-style, motion and
different colors. It’s a LOT of work to create inaccessible captions. The best
captions are bording. They let the video be the star.
On the left, the captions are in a black banner with a white font. We see them perfectly.
On the right, we see captions in Hormozi-style, pizzazz-style, branding-style, captions with caps, karaoke-style, motion and different colors we can’t see them correctly.
You see that the captions on the left are much more comfortable to read than the captions on the right.
Slide 11
Now, here is the video of Alexa Heinrich.
Alexa Heinrich' post
"This is what I mean when I say that kinetic captions are a bad idea and not very accessible!"
Transcript of Alexa Heinrich’ video
Alexa Heinrich says:
"When I say that kinetic captions are a bad idea for your videos, this is what
I mean. Thease captions that appear one word at a time on the screen. They
kind of hop around. They don’t feed like normal captions would. It makes it
very hard to read. What’s even worse about these particular captions on
Instagram is that they’re in all caps and you can’t that with this specific
style. Your captions, when it comes to how they look, should really be as
boring as possible. Make them look like Youtube captions. They’re straight
forward. There's high contrast with the video and you can actually read them.
Keep them in sentence case. Caption what you hear. That’s the point of
captions and if you can’t read them, if you can’t read them easily, they’re
just no good. So, try to avoid using kinetic captions like this."
Did you enjoy Alexa's captions? I don't.
Slide 12
I agree so much with Meryl and Alexa. These captions are totally inaccessible. Personally, I can't stand them and it hurts my eyes a lot. I am forced to concentrate and it gives me migraines. Reading captions shouldn't required effort.
What criteria should be respected when creating captions ?
I will show you examples of bad captions and then tell you what criteria you should respect.
Slide 13
Constrast matters.
I don’t like kinetic captions. Ofter these captions are white without black
background. How we can see them if they are white in white background?
Do you see them? I see them barely.
In first photo, a pancake half filled with avocados, tuna and salmon on a
white plate. White captions appear in kinetic format on the white plate: "I
decided to make this version a little sushi."
You see, we see these
captions barelly.
In second photo, a same pancake totally filled with avocados, tuna and salmon
on a white plate. But this time, the captions that we barely saw before, we no
longer see them even though they are there.
We don’t see them. They are here but we can’t see them.
In third photo, a woman with a striped top with red, blue and yellow colors.
Captions are white : "Could the ugly untalented gays, please report to the
principal's office?"
Captions are "normal" but we don’t see them correctly because of color
stripes.
When you create captions, the least you can do is to check that the contrast between the color of the captions and the background of the videos is respected. Otherwise you might as well not put them on if you can't see them.
Even with "normal" captions, I see contrast problems. The ideal would be to always put a black background to better see the captions.
Also avoid flashy colors (bright red, bright yellow, etc.) because it stings the eyes. This can cause discomfort.
Slide 14
Font matters.
In first photo, a woman in a wheelchair is dressed as a barbie with pink captions surrounded by white. Captions are fancy font. Captions display "I can't get throught there”.
In second photo, a man is in an office. In front of him, the office is empty. The captions are in French and are in a blue band with a font having very thin letters. We hardly differentiate the letters i, l, h and f. The text of the captions is french but I translated in english: "to the issue of disability and making the connection".
In these two photos, we see that the font used is a serif font or a fancy font.
People with dyslexia may have trouble reading them. This is why it is strongly recommended to use a sans serif font.
Slide 15
Size matters.
On first photo, two actresses are promoting their film "Then you run". White captions appear and are small: "We've watched the first episode of the series".
On second photo, a woman with little white captions in French. I can’t read them. I do not know what is captioned.
The size of the captions is important. It doesn't matter what media you use. If they are small for a small smartphone but large enough for the computer or a smartphone with a large screen, this is a problem.
We can't stick our noses to our phone to see the captions better. Many people wear glasses. Everyone sees differently. If the captions are small, you can be sure that they can only be read by a handful of people.
On this second video, I had the impression that it annoyed the person who captionned to put these captions. If you don't want to put them on, don't just put them on.
Slide 16
Please, don’t put caps on captions.
On first photo : a teacher with his student who shows him his grades. It is titled at the top in white with a black banner "When the teacher messes up on the test". The captions appear at the bottom in red and uppercase: "I didn't really get question 11".
On second photo, A sepia-colored photo with a man from behind and his suitcase. French captions are red and capitalized: "It's much worse than we say.”
I don't know about you but in French culture, capitalized captions mean that we shout, that we scream. Clearly, this is not the case.
Capital letters are also uncomfortable to read. In addition to poor contrast, these capitalized captions are difficult to read.
Slide 17
Here is a video in French with totally inaccessible captions. I am unable to
tell you what is written, even translate it to you so fast it goes. Captions
that flash and scroll at this speed hurt the eyes a lot.
This is a promotional video about pilates. That's all I know. Sometimes I
capture a word here, a word there.
Especially since if you want to learn the language via captions, how can you learn it if captions scroll at this speed? You don't have time to read every word. And in addition it hurts very much. You have to concentrate and be able to read at this speed. Not everyone has the ability to read captions quickly.
So, stop making captions unreadable. It's inaccessible to everyone and it can give some people migraines.
Slide 18
I do not have an example to show you, but it is important that I tell you this. When you caption, be faithful to the content. Don't summarize, don't change words with another word that means the same thing just to "earn" space.
It's uncomfortable and it makes you feel stupid. Some deaf and hard of hearing people can hear through hearing aids so if they hear the slightest difference, it makes them confused.
So don't do it.
Slide 19
It's important to limit captions to two lines for the simple reason that our brains are used to capturing captions quickly in two lines. More than two lines, we force ourselves to concentrate to read more.
Slide 20
In this photo, a man is giving a speech on a desk. On his desk, it is displayed Sciences Po (a French graduate school) with another text that I can not read to you because there is a caption above. This white caption in French is displayed: "European nations are much too small".
Here is an example that shows that there are captions on text. It is very difficult to read them and to read what is behind the captions. Texts and captions should not overlap. If you have text, place the captions above or below during this scene.
Slide 21
Pay attention to captions’s placement.
On first photo, during a video of the haka, a woman is seen making faces but a black caption with a white headband "let us proceeed" hides her grimace.
On second photo, on the same video, a black caption with a white headband hides a group of women on the rugby field doing the haka.
Details matters. If the captions hide the details, we can miss an important piece of information or miss the image that can give us emotion.
I would put these captions at the bottom to better see the woman's face or the group doing their haka to better appreciate the experience.
On third photo, two athletes at the Olympics congratulate each other for being champions. White captions with the black banner are displayed behind the icons and texts and cannot be read properly.
On social networks like Instagram or Tiktok, when I put the video in full screen, it overlaps with the icons on the right, left, bottom.
It is important to choose the right placement of captions.
Slide 22
Sounds must be described.
Slide 23
How to describe the sounds?
- [applause]
- [lyrical flute solo]
- [The Beatles singing “Hey Jude”]
- ♪ Hey Jude, don't make it bad. ♪♪
- [Piper] Thank you.
- [Chris] You're welcome.
- [Speaking French] Bonjour.
Sounds indications are important. Each sound must be accurately described so that the viewer has the information. Sounds can be important in the flow of the video. If, during a video, people applaud, it must be specified.
A deaf friend told me when I captionned her video with her transcript: "Good thing you specified the applause on the video, I never knew that people clapped on this or that passage." It was an information that gave her confidence.
Personally, I love music but I never know what kind of music is played in a
video.
One day, I asked the person who made the captions what music it was so
beautiful I thought it was. It was violin! Simply putting "music" on captions
is not enough. Specifying that it was violin completely changed the game and
changed my perception of the stage.
It made me melancholic. We have emotions like everyone else. It's the same for
the lyrics of the songs. Putting the lyrics of the song contribute to enrich
our musical culture whether we have hearing aids or not.
When there are several interlocutors, it is also important to specify who is
speaking. Without directions, one can quickly become confused and no longer
understand the video. "Wait, did that person say that or was it another
person?”
The same happens when the person speaks another language. It is important that
we know that another language is spoken.
In France, we have color codes on the captions on TV. Each color is assigned
to a type of sound. White when you see the character on screen, yellow when
the person is off-camera, magenta when it's music, green when the character
speaks a foreign language, turquoise when the person reveals his thoughts and
red when it's noise.
But right now, there is a debate about color codes because the colors used can
be a problem for colorblind people.
Slide 24
You can use automatic captions provided you correct them afterwards.
This rule is important. When using software that allows automatic captioning, check that these captions, regardless of their language, are good.
We have made a lot of progress in artificial intelligence but not enough to make full use of auto captions. Auto captions may contain errors.
Slide 25
When you use auto captions during the live, correct them in replay as here at Inclusive Design 24 because they aren't 100% accurate. The proof if you have displayed the auto captions while I speak. You've probably figured out that it's a disaster because of my french and deaf accent.
When you create videos, you can use the automatic tools to caption automatically but don't forget to fix them.
Indeed, to improve auto captions, human intervention is still needed. It is therefore necessary to mix artificial intelligence and human intelligence to make the experience even better.
Voice recognition is not perfect and is far from it. Tim Cook said well during his speech at Gallaudet University in May 2022: "AI is good but it's not that good!"
That says it all.
Slide 26
In English, when we say that the captions are bad, we say "craptions". A play on words between crap and captions.
So careful to craptions.
Slide 27
So, what are THE perfect captions?
Slide 28
The perfect captions are :
- Do not make spelling, grammar or conjugation mistakes in any language.
- Respect the color format: white with a black or half-black background.
- Pay attention to font size.
- Choose a sans serif font.
- Pay attention to placement.
- No caps, no animations and no flashing on captions.
- Sounds must be described.
- Always captions on up to two lines.
- Do not use only automatic captioning and always correct it.
In fact, as Meryl and Alexa said, make just boring captions.
Slide 29
In conclusion, when you create captions, think about the readability of your captions.
Don't caption just because it's pretty.
Caption because you want your message to be read by everyone.
Slide 30
Now you know how to create good captions.
Thank you very much. I hope you enjoyed my talk and that you understood me correctly. In the following 2 slides, you will find resources.
Here are the slides.
I am available to answer your questions if we have time.