Recognizing the presence of hidden visual markers in digital images
As the promise of Virtual and Augmented Reality (VR and AR) becomes more realistic, an interesting aspect of our enhanced living environment includes the availability — indeed the potential ubiquity — of scannable markers. Such markers could represent an initial step into the AR and VR worlds. In th...
| Main Authors: | , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Published: |
2017
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/48770/ |
| _version_ | 1848797841919574016 |
|---|---|
| author | Xu, Liming French, Andrew P. Towey, Dave Benford, Steve |
| author_facet | Xu, Liming French, Andrew P. Towey, Dave Benford, Steve |
| author_sort | Xu, Liming |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | As the promise of Virtual and Augmented Reality (VR and AR) becomes more realistic, an interesting aspect of our enhanced living environment includes the availability — indeed the potential ubiquity — of scannable markers. Such markers could represent an initial step into the AR and VR worlds. In this paper, we address the important question of how to recognise the presence of visual markers in freeform digital photos. We use a particularly challenging marker format that is only minimally constrained in structure, called Artcodes. Artcodes are a type of topological marker system enabling people, by following very simple drawing rules, to design markers that are both aesthetically beautiful and machine readable. Artcodes can be used to decorate the surface of any objects, and yet can also contain a hidden digital meaning. Like some other more commonly used markers (such as Barcodes, QR codes), it is possible to use codes to link physical objects to digital data, augmenting everyday objects. Obviously, in order to trigger the behaviour of scanning and further decoding of such codes, it is first necessary for devices to be aware of the presence of Artcodes in the image. Although considerable literature exists related to the detection of rigidly formatted structures and geometrical feature descriptors such as Harris, SIFT, and SURF, these approaches are not sufficient for describing freeform topological structures, such as Artcode images. In this paper, we propose a new topological feature descriptor that can be used in the detection of freeform topological markers, including Artcodes. This feature descriptor is called a Shape of Orientation Histogram (SOH). We construct this SOH feature vector by quantifying the level of symmetry and smoothness of the orientation histogram, and then use a Random Forest machine learning approach to classify images that contain Artcodes using the new feature vector. This system represents a potential first step for an eventual mobile device application that would detect where in an image such an unconstrained code appears. We also explain how the system handles imbalanced datasets — important for rare, handcrafted codes such as Artcodes — and how it is evaluated. Our experimental evaluation shows good performance of the proposed classification model in the detection of Artcodes: obtaining an overall accuracy of approx. 0.83, F2 measure 0.83, MCC 0.68, AUC-ROC 0.93, and AUC-PR 0.91. |
| first_indexed | 2025-11-14T20:10:18Z |
| format | Conference or Workshop Item |
| id | nottingham-48770 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| last_indexed | 2025-11-14T20:10:18Z |
| publishDate | 2017 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-487702020-05-04T19:13:45Z https://eprints.nottingham.ac.uk/48770/ Recognizing the presence of hidden visual markers in digital images Xu, Liming French, Andrew P. Towey, Dave Benford, Steve As the promise of Virtual and Augmented Reality (VR and AR) becomes more realistic, an interesting aspect of our enhanced living environment includes the availability — indeed the potential ubiquity — of scannable markers. Such markers could represent an initial step into the AR and VR worlds. In this paper, we address the important question of how to recognise the presence of visual markers in freeform digital photos. We use a particularly challenging marker format that is only minimally constrained in structure, called Artcodes. Artcodes are a type of topological marker system enabling people, by following very simple drawing rules, to design markers that are both aesthetically beautiful and machine readable. Artcodes can be used to decorate the surface of any objects, and yet can also contain a hidden digital meaning. Like some other more commonly used markers (such as Barcodes, QR codes), it is possible to use codes to link physical objects to digital data, augmenting everyday objects. Obviously, in order to trigger the behaviour of scanning and further decoding of such codes, it is first necessary for devices to be aware of the presence of Artcodes in the image. Although considerable literature exists related to the detection of rigidly formatted structures and geometrical feature descriptors such as Harris, SIFT, and SURF, these approaches are not sufficient for describing freeform topological structures, such as Artcode images. In this paper, we propose a new topological feature descriptor that can be used in the detection of freeform topological markers, including Artcodes. This feature descriptor is called a Shape of Orientation Histogram (SOH). We construct this SOH feature vector by quantifying the level of symmetry and smoothness of the orientation histogram, and then use a Random Forest machine learning approach to classify images that contain Artcodes using the new feature vector. This system represents a potential first step for an eventual mobile device application that would detect where in an image such an unconstrained code appears. We also explain how the system handles imbalanced datasets — important for rare, handcrafted codes such as Artcodes — and how it is evaluated. Our experimental evaluation shows good performance of the proposed classification model in the detection of Artcodes: obtaining an overall accuracy of approx. 0.83, F2 measure 0.83, MCC 0.68, AUC-ROC 0.93, and AUC-PR 0.91. 2017-10-23 Conference or Workshop Item PeerReviewed Xu, Liming, French, Andrew P., Towey, Dave and Benford, Steve (2017) Recognizing the presence of hidden visual markers in digital images. In: Thematic Workshops of ACM Multimedia 2017, 23-27 October, 2017, Mountain View, California, USA. Visual markers; Artcodes; Topological feature descriptor; Classifier https://dl.acm.org/citation.cfm?id=3126761 10.1145/3126686.3126761 10.1145/3126686.3126761 10.1145/3126686.3126761 |
| spellingShingle | Visual markers; Artcodes; Topological feature descriptor; Classifier Xu, Liming French, Andrew P. Towey, Dave Benford, Steve Recognizing the presence of hidden visual markers in digital images |
| title | Recognizing the presence of hidden visual markers in digital images |
| title_full | Recognizing the presence of hidden visual markers in digital images |
| title_fullStr | Recognizing the presence of hidden visual markers in digital images |
| title_full_unstemmed | Recognizing the presence of hidden visual markers in digital images |
| title_short | Recognizing the presence of hidden visual markers in digital images |
| title_sort | recognizing the presence of hidden visual markers in digital images |
| topic | Visual markers; Artcodes; Topological feature descriptor; Classifier |
| url | https://eprints.nottingham.ac.uk/48770/ https://eprints.nottingham.ac.uk/48770/ https://eprints.nottingham.ac.uk/48770/ |