Abstract

Online shopping is becoming a popular option for consumers. Currently, the most common product searching method that online shopping websites provide is keyword search. Most shoppers have to carefully select relevant keywords to search for their favorite products. Finding desired products using a query image for online shopping is currently not available. Image has been used for searching similar images in the database but they are usually not well annotated. Research effort has been devoted to developing reliable image-based retrieval systems for applications such as medical image retrieval and trademark search. None of these developments focuses on improving online shopping experiences for consumers. This thesis reports the development of an image retrieval system to provide better online shopping experience for consumers. The system searches products with similar appearance such as shape and textures to the query images the user provides. Turn angle is a contour based shape descriptor. It has many unique properties that make it a perfect shape matching method for image retrieval. The best matching image has the shortest shape distance to the query shape. Turn angle, however, could fail with slightly stretched shapes. Dynamic programming is used to help turn angle match slightly deformed shapes. Another technique called centroid distance is also included as a restriction for shape matching in order to avoid retrieving irrelevant or disparate shapes. With a well-built database, the enhanced turn angle descriptor that includes dynamic programming and centroid distance is able to reach a high accuracy rate.Shape matching alone is usually not sufficient for a powerful retrieval system. Products with similar shape but very different textures will not be distinguished based solely on shape matching. Edge histogram is a robust shape descriptor for texture matching. It can be implemented to construct either global or local histogram for this purpose. Global edge histogram uses only 5 bins, which is simple but ignores detail texture information. Local and semi-global edge histograms are more complex but retains detail texture information. A hierarchical matching system is built to combine the shape and texture descriptors for better retrieval accuracy.Easy access to the shopping system is desired. An Android Application is developed to provide consumers a convenient and friendly tool to use the system. Grab cut is applied to the captured image to segment the object from the background. The segmentation provides the retrieval system the required contour information for shape matching. The Android Application submits the captured image along with the segmented contour to the server. After the retrieval process is completed, the server sends retrieved images of similar products back to the Android App for the user to consider. Using the retrieval system via a handheld device provides a user-friendly online shopping experience.

Degree

College and Department

Ira A. Fulton College of Engineering and Technology; Electrical and Computer Engineering

Rights

http://lib.byu.edu/about/copyright/