TA2 - Together Anywhere, Together Anytime

Reseach leader:Smrž Pavel
Team leaders:Zemčík Pavel
Agency:EU-7FP-ICT
Code:TA2
Start:2010
End:2012
Keywords:social interaction, multimedia processing
Annotation:
TA2 (Together Anywhere, Together Anytime), pronounced "tattoo", aims at defining end-to-end systems for the development and delivery of new, creative forms of interactive, immersive, high quality media experiences for groups of users such as households and families. The overall vision of TA2 can be summarised as "making communications and engagement easier among groups of people separated in space and time".

One of the key components of TA2 is a set of generic and reliable audio, video, and multimodalities integration and recognition tools. This includes automatic extraction of cues from raw data streams. The running TA2 project stresses low-level "instantaneous" cues; it does not deal with semantic-aware integration of contextual information which could significantly improve the quality of cues.

The proposed TA2 project extension focuses on the medium-level (context-aware) cues taking into account not only low-level analysis outputs but also contextual information, e.g., about the activated scenario. The created semantic cues will be used by the TA2 system to orchestrate (i.e. frame, crop and represent) the audio-visual elements of the interaction between people.

The addition of BUT to the consortium will allow the semantic relevance of the metadata extracted from the analysis to be interpreted within the particular contexts described in the project. This will make the subsequent orchestration of the video more effective and more efficient and hence improve the end-user experience. The extension will enable building better applications that help families to interact easily and openly through games, through improved semi automatic production and publication of user generated content, and through enhanced ambient connectedness between families.

Products

Publications

2012Bednařík, R., Vrzáková, H., Hradiš, M.: What you want to do next: A novel approach for intent prediction in gaze-based interaction, In: ETRA '12 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara, US, ACM, 2012, p. 83-90, ISBN 978-1-4503-1221-9
 Hradiš, M., Eivazi, S., Bednařík, R.: Voice activity detection in video mediated communication from gaze, In: ETRA '12 Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara, US, ACM, 2012, p. 329-332, ISBN 978-1-4503-1221-9
 Hradiš, M., Řezníček, I., Behúň, K.: Semantic Class Detectors in Video Genre Recognition, In: Proceedings of VISAPP 2012, Rome, IT, SciTePress, 2012, p. 640-646, ISBN 978-989-8565-03-7
 Král, J., Hradiš, M.: Restricted Boltzman Machines for Image Tag Suggestion, In: Proceedings of the 19th Conference STUDENT EEICT 2012, Brno, CZ, VUT v Brně, 2012, p. 5
 Motlíček, P., Valente, F., Szőke, I.: Improving Acoustic Based Keyword Spotting Using LVCSR Lattices, In: Proc. International Conference on Acoustics, Speech, and Signal Processing 2012, Kyoto, JP, IEEESP, 2012, p. 4413-4416, ISBN 978-1-4673-0044-5
 Poláček, O., Klíma, M., Sporka, A., J., Žák, P., Hradiš, M., Zemčík, P., Procházka, V.: A comparative study on distant free-hand pointing, In: EuroiTV '12 Proceedings of the 10th European conference on Interactive tv and video, Berlin, Germany, DE, ACM, 2012, p. 139-142, ISBN 978-1-4503-1107-6
2011Hradiš, M., Řezníček, I., Behúň, K.: Brno University of Technology at MediaEval 2011 Genre Tagging Task, In: Working Notes Proceedings of the MediaEval 2011 Workshop, Pisa, Italy, IT, CEUR.WS, 2011, p. 1-2, ISSN 1613-0073
 Řezníček, I., Zemčík, P.: On-line human action detection using space-time interest points, In: Zborník príspevkov prezentovaných na konferencii ITAT, september 2011, Praha, SK, MFF UK, 2011, p. 39-45, ISBN 978-80-89557-01-1
2010Hradiš, M., Beran, V., Řezníček, I., Herout, A., Bařina, D., Vlček, A., Zemčík, P.: Brno University of Technology at TRECVid 2010, In: TRECVID 2010: Participant Notebook Papers and Slides, Gaithersburg, MD, US, NIST, 2010, p. 11
 Chmelař, P., Láník, A., Mlích, J.: An overview of SUNAR, In: Proceedings of ITAT 2010, Bratislava, SK, UNIBA, 2010, p. 9-16, ISBN 978-80-970179-3-4
 Láník, A., Mlích, J., Zemčík, P., Juránek, R., Chmelař, P.: Multimodal data acquisition on mobile devices, In: Proceedings of 7th International Workshop Digital Technologies 2010, Žilina, SK, EDIS ŽU, 2010, p. 57-58, ISBN 978-80-554-0304-5
 Řezníček, I., Bařina, D.: Classifier creation framework for diverse classification tasks, In: Proceedings of the DT workshop, Žilina, SK, VUT v Brně, 2010, p. 3, ISBN 978-80-554-0304-5
 Žák, P., Bartoň, R., Zemčík, P.: Vision based user interface framework, In: Proceedings of the DT workshop, Žilina, SK, 2010, p. 3, ISBN 978-80-554-0304-5

Your IPv4 address: 54.242.188.217
Switch to IPv6 connection

DNSSEC [dnssec]