Handling Periodic Signs In American Sign Language Using Synthetic Generation Of Periods
Notice bibliographique
Résumé
American Sign Language (or ASL) is the dominant sign language of deaf people in United States and parts of Canada. 500,000 to 2 million people use ASL as their primary language in United States. ASL uses hands, face and body, with constantly changing movements and orientations. Since the language is based on gestures, not a printed alphabet, it gets difficult to know the associated meaning given a video. There are multimedia tools and dictionaries available to view a sign video for a given word but there are no dictionaries available which, given a sign video will respond with corresponding word. This egged on development of video based lookup in ASL dictionary. The vision is to have a system in which a user will be able to lookup the meaning of an ASL sign simply by performing gesture in front of a video camera synced to a computer. The computer will compare the unknown sign with a database of signs to identify the most likely matches. In existing ASL lexicon project a user submits a query sign video and the application finds the most similar signs from the system database. The existing system evaluates the similarity between the query video and every sign video in the video database, using Dynamic Time Warping (DTW) distance. DTW is an algorithm for measuring similarity between two sequences which may vary in time or speed. DTW is a method that allows a computer to find an optimal match between two given sequences (e.g. time series) with certain restrictions. The sequences are warped non- linearly in the time dimension to determine a measure of their similarity independent of certain non-linear variations in the time dimension. The existing ASL lexicon project uses the similarity in hand locations and orientations to lookup a gesture in dictionary of ASL signs. The ability of DTW to cater to temporal misalignments helps us recognize signs differing in time or speed. ASL periodic signs are signs which have repetition of an action. The number of times this action is repeated is signer ‘s discretion. DTW in such cases will still attempt to align input video with the dictionary sign video. The alignment will not be meaningful, if the number of times an action is repeated in input video differs from dictionary sign video. Since DTW in such case results in non-meaningful association, it ultimately results in poor similarity responses. The paper attempts to correct this problem of ‘ Incorrect Period Matching ‘. The paper contributes by defining a protocol for annotating periodic signs and introduces a method for improving system accuracy on such signs. It builds an informative database for periodic video signs on an ASL lexicon dataset of 1113 unique signs. It captures the temporal information (start and end of period) for all the periods executed in each periodic sign video. This paper provides a mechanism to generate periods synthetically. We use the periodic temporal information of the last period to create subsequent periods for the training video. We successfully corrected the problem which spurred while using DTW on periodic signs, by synthetically generating periods.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,001 | 0,000 |
| Méta-épidémiologie (sens strict) | 0,000 | 0,000 |
| Méta-épidémiologie (sens large) | 0,001 | 0,000 |
| Bibliométrie | 0,001 | 0,001 |
| Études des sciences et des technologies | 0,000 | 0,001 |
| Communication savante | 0,000 | 0,000 |
| Science ouverte | 0,001 | 0,001 |
| Intégrité de la recherche | 0,000 | 0,000 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,001 | 0,000 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».