Show simple item record

dc.contributor.authorSmolic, Aljosa
dc.contributor.authorChalasani, Tejo
dc.date.accessioned2020-02-18T17:19:46Z
dc.date.available2020-02-18T17:19:46Z
dc.date.issued2019
dc.date.submitted2019en
dc.identifier.citationChalasani, T. & Smolic, A., Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition, 2019en
dc.identifier.otherY
dc.identifier.urihttps://arxiv.org/pdf/1909.08606.pdf
dc.identifier.urihttp://hdl.handle.net/2262/91580
dc.descriptionPUBLISHEDen
dc.description.abstractEgo hand gestures can be used as an interface in AR and VR environments. While the context of an image is impor- tant for tasks like scene understanding, object recognition, image caption generation and activity recognition, it plays a minimal role in ego hand gesture recognition. An ego hand gesture used for AR and VR environments conveys the same information regardless of the background. With this idea in mind, we present our work on ego hand gesture recogni- tion that produces embeddings from RBG images with ego hands, which are simultaneously used for ego hand seg- mentation and ego gesture recognition. To this extent, we achieved better recognition accuracy (96.9%) compared to the state of the art (92.2%) on the biggest ego hand gesture dataset available publicly. We present a gesture recognition deep neural network which recognises ego hand gestures from videos (videos containing a single gesture) by gener- ating and recognising embeddings of ego hands from image sequences of varying length. We introduce the concept of simultaneous segmentation and recognition applied to ego hand gestures, present the network architecture, the train- ing procedure and the results compared to the state of the art on the EgoGesture dataset [31].en
dc.language.isoenen
dc.rightsYen
dc.subjectHand gesturesen
dc.subjectVirtual realityen
dc.subjectAugmented realityen
dc.titleSimultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognitionen
dc.typeConference Paperen
dc.contributor.sponsorSFI stipenden
dc.type.supercollectionscholarly_publicationsen
dc.type.supercollectionrefereed_publicationsen
dc.identifier.peoplefinderurlhttp://people.tcd.ie/smolica
dc.identifier.rssinternalid212557
dc.rights.ecaccessrightsopenAccess
dc.contributor.sponsorGrantNumber15/RP/277en
dc.subject.TCDThemeCreative Technologiesen
dc.subject.TCDTagMultimedia & Creativityen
dc.subject.darat_impairmentOtheren
dc.status.accessibleNen


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record