Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
MA3HO'11: The First International ACM Workshop on Multimedia access to 3D Human Objects (MA3HO'11) is held on November 2011 at Scottsdale, Arizona, USA in conjunction with ACM Multimedia 2011. Motivations behind this initiative are strong: 3D is becoming increasingly popular in a number of economically relevant fields of application, including movies, graphic entertainments, security applications, data archives storage, search and retrieval. 3D cinema, online gaming and virtual reality, surveillance and security, mechanic parts management, medical imaging, structural and molecular biology, cultural heritage asset reproduction, improved human computer interaction, natural and multimodal interactivity are just a few of the potential applications. While 3D digital data was obtained by manual CAD and 3D modeling software until a few years ago, nowadays laser scanners and computer vision technology make it possible to get high resolution textured 3D models from real world data at very fast pace. Dynamic 3D models can be captured from moving targets as well. Low cost devices like the Kinect 3D scanner permit to obtain low resolution 3D full scans in real time at short distance. Computer vision solutions permit fast extraction of interest points in the images, compute their geometrical relationships and perform approximate 3D reconstruction of observed objects or scenes. Smart tracking algorithms, while observing a target from different viewpoints permit to reconstruct its 3D silhouette and provide a realistic avatar of the moving target. Pan Tilt Zoom cameras make it possible to capture high resolution images of far targets and potentially permit their 3D reconstruction from such a sequence. 3D object databases are rapidly emerging in many application fields, so paving the way to large scale 3D content-based retrieval over the Internet. Web3D is near to come and will enable access to 3D materials of high quality. Sharing, retrieving and reusing 3D content will be soon exchanged between professionals of 3D data. To restrict the scope of interest this Workshop was focused on 3D human objects, intended both as parts of 3D human bodies and 3D parts for humans, i.e.: people silhouettes, head and torso models, arms and hand models, body, faces and faces parts such as lips or objects handled and interacting humans and eventually 3D environment where humans acts. We particularly envision the task of matching 3D models with 3D models or 2D image data. In surveillance and security, for example, matching of 2D face images with 3D face models permits to exploit both appearance and structural information to perform target identification, so superseding the limitations of traditional 2D face matching. While 3D face databases are becoming more and more available, 3D face matching is becoming an important topic of investigation for advanced security applications. New recognition and tracking applications will fully exploit 3D body behaviors. Real time reconstruction of the 3D target body and face from multiple 2D views, makes live 3D body modeling, identification, re-identification a new opportunity in surveillance long term tracking and and forensic applications, easing the task of behavior analysis and recognition. Expression analysis, human machine interaction with natural interfaces are all fields where 3D can improve with respect the the current state of the art. A growing number of benchmark and dataset of 3D human objects was made available from research projects. Examples are the TRICTRAC project where a number of video clips were rendered in 3D, the Carnegie Mellon University Motion Capture Database, for human bodies and interactions (http://mocap.cs.cmu.edu/); the Multi-view 3D Human Pose Estimation benchmark at CVPR2009 (http://www.gavrila.net/Research/3-D_Human_Body_Tracking) and the 3D multiview object modeling for re-identification, by the EU project THIS (http://imagelab.ing.unimore.it/3dpes/). The MA3HO workshop is aimed at taking a leap forward in emerging research of multimedia access of 3D human objects, merging researchers in 3D graphics, 3D object recognition and retrieval, Multimedia, with attention to application fields where humans are highly significant, such as security, surveillance and biometry, animation and entertainment, video retrieval, sport analytics, natural interaction, cultural heritage, augmented and virtual reality and world wide web. Main subjects addressed are among the others: 3D human objects reconstruction from 2D views 3D pose estimation from 2D information 2D to 3D human object matching 3D human object categorization 3D people identification and re-identification 3D object/face similarity matching, indexing, and mining Feature extraction for 3D model segmentation Feature extraction for 3D motion detection and behavior classification 3D shape descriptors Retrieval with large distributed and heterogeneous 3D datasets and benchmarking Semantics-driven 3D object retrieval and classification 3D natural interfaces and search modalities The workshop has attracted 18 good quality submissions fairly distributed among different countries: China, Japan, Canada, USA, France, Italy and Germany. Many of the key arguments of the workshop call were addressed. The MA3HO Technical Program Committee, after careful review and evaluation, only selected 6 papers for oral presentation and 7 papers for poster presentation, in order to have a selective high quality event, in the spirit of the ACM MULTIMEDIA conference. SSPW'11: It is a pleasure and an honor to have organized the Third International Workshop on Social Signal Processing (SSPW'11), held on December 1, 2011, in Scottsdale, Arizona, USA in conjunction with ACM Multimedia 2011. Machine analysis of human social behaviors and machine synthesis of human-like socially-aware interactions is of utmost importance for research on next-generation computing and multimedia including ambient intelligence, smart environments/ multimedia, and perceptual interfaces/multimedia. This field -- widely know as Social Signal Processing -- has witness a surge of interest in the past couple of years and is progressing rapidly with new or pending applications in HCI, psychology, biomedicine, politics, and entertainment technology, among other domains. With these advances come new conceptual and methodological challenges. The SSPW'11 workshop is the third edition of the Social Signal Processing Workshop series and it presents cutting-edge research and new challenges in automatic analysis and synthesis of social interactions and social signals in an interdisciplinary forum of computer and behavioral scientists. The workshop series is the premier forum for presenting research in social signal processing and the related topics. The workshop provides a rich forum for sharing and generating allied technologies: the generation of new ideas, new approaches, new techniques, and new evaluation. The workshop is organized under the auspices of the SSPNet, the FP7 European Network of Excellence on Social Signal Processing (EC FP7 grant agreement no. 231287), and continues the tradition of the previous SSPW workshops by maintaining the high standard set by its predecessors. Main topics discussed during the SSPW workshop series include the following: Social Intelligence, Social Cognition and Social Behavior Modeling Facial behavior analysis and synthesis in social interactions Expressive speech analysis and synthesis in social interactions Human gesture and action recognition and synthesis in social interactions Multimodal human behavior analysis and synthesis in social interactions Perceptual, multimodal, and socially-aware user interfaces Socially-adept Embodied Conversational Agents Data Mining, Machine Learning, Information Retrieval, Artificial Intelligence in Social Contexts Databases for training and testing Socially-aware computing and applications (reality mining, implicit multimedia tagging, etc.) The SSPW'11 workshop program includes a number of Keynote talks and a poster session. For the workshop we have received 13 good quality submissions. Each of these was assessed by no fewer than two reviewers. The final SSPW'11 program consists of four Keynote talks by Hatice Gunes (Queen Mary University London, UK), Shri Narayanan (University of Southern California, USA), Matthias Mehl (University of Arizona, USA), and Louis-Philippe Morency (Institute of Creative Technologies, USC, USA), and a poster session with 4 papers. The Keynote and poster presentations bring together related communities to share the latest findings and ideas and pursue continuing and new collaborations in research on social signal processing.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it