Home Query by
Image Example		 Query by
Semantics		 Query by
Text Annotation		 VPheno
Ontology		 Project
Team		 Publications

Query by Image Example

Phenotype image searches are typically performed by matching text from image captions or metadata. However, the accuracy of such systems is limited because describing phenotypes with words is challenging insomuch as perception and vocabulary vary from person to person and domain expert to domain expert. How much simpler would it be if a system existed that allowed users to submit as the query an image of the phenotype they are interested in (and the system would return the most visually similar images from the database)? That is precisely the system that we been developed.

This Query by Image Example search mechanism uses a dataset consisting of leaf images from maize lesion mimic (les) mutants. To perform a search, first select an image from the box by clicking on it. A larger version of the image will be displayed. Then, hit the 'Search' button. The system will find those phenotype images whose visual appearances best match the query image.

You will also notice a set of slider bars on the page as well. These bars control the amount of emphasis placed on each class of characteristics measured from the phenotype images. For more specialized searches, adjust the sliders to weight the characteristics as desired before hitting the 'Search' button. By default, each class of characteristics is weighted evenly.


 
Image Key: 07_SF07_FP_00870_13_10_tip_les3_bet_12.8.07_DSC_0396
Image Key: 07_SF07_FP_00457_08_13_stem_les6_gimmel_10.8.07_DSC_0234
Image Key: 07_SF07_FP_00487_05_14_stem_les7_gimmel_11.8.07_DSC_0090
Image Key: 07_SF07_FP_00526_08_13_middle_les8_bet_12.8.07_DSC_0323
Image Key: 07_SF07_FP_00539_06_11_tip_les8_gimmel_11.8.07_DSC_0142
Image Key: 07_SF07_FP_00597_01_12_tip_les12_bet_12.8.07_DSC_0100
Image Key: 07_SF07_FP_00620_04_11_tip_les13_bet_12.8.07_DSC_0384
Image Key: 07_SF07_FP_00644_01_12_middle_les17_gimmel_11.8.07_DSC_0343
Image Key: 07_SF07_FP_00659_04_13_middle_les18_gimmel_11.8.07_DSC_0401
Image Key: 07_SF07_FP_00677_01_12_stem_les18_bet_12.8.07_DSC_0142
Image Key: 07_SF07_FP_00357_12_13_middle_les1_bet_10.8.07_DSC_0070
Image Key: 07_SF07_FP_00868_07_13_middle_les23_bet_12.8.07_DSC_0411
Image Key: 07_SF07_FP_00724_08_12_stem_les21_bet_12.8.07_DSC_0279
Image Key: 07_SF07_FP_00727_08_13_stem_les21_bet_12.8.07_DSC_0307
Image Key: 07_SF07_FP_00703_01_12_middle_les19_bet_12.8.07_DSC_0217
Image Key: 07_SF07_FP_00864_09_13_stem_les5_bet_12.8.07_DSC_0395
Image Key: 07_SF07_FP_00456_06_14_stem_les6_gimmel_10.8.07_DSC_0231
Image Key: 07_SF07_FP_00469_09_13_stem_les7_gimmel_11.8.07_DSC_0066
Image Key: 07_SF07_FP_00552_01_14_middle_les9_gimmel_11.8.07_DSC_0269
Image Key: 07_SF07_FP_00553_14_11_tip_les9_gimmel_11.8.07_DSC_0278
Image Key: 07_SF07_FP_00569_06_11_tip_les10_gimmel_11.8.07_DSC_0286
Image Key: 07_SF07_FP_00619_08_11_stem_les13_bet_12.8.07_DSC_0357
Image Key: 07_SF07_FP_00633_05_13_middle_les17_gimmel_11.8.07_DSC_0170
Image Key: 07_SF07_FP_00679_05_14_middle_les19_bet_12.8.07_DSC_0147
 
Query Image Image Characteristic Weightings
image
Lesion Size:
Lesion Distribution:
Lesion Shape:
Leaf Color:
Lesion Color:
Texture:
Number of Results:
This material is based upon work supported by the National Science Foundation under Grant No. 0447794.

Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.