Query by Image Example

Phenotype image searches are typically performed by matching text from image captions or metadata. However, the accuracy of such systems is limited because describing phenotypes with words is challenging insomuch as perception and vocabulary vary from person to person and domain expert to domain expert. How much simpler would it be if a system existed that allowed users to submit as the query an image of the phenotype they are interested in (and the system would return the most visually similar images from the database)? That is precisely the system that we been developed.

This Query by Image Example search mechanism uses a dataset consisting of leaf images from maize lesion mimic (les) mutants. To perform a search, first select an image from the box by clicking on it. A larger version of the image will be displayed. Then, hit the 'Search' button. The system will find those phenotype images whose visual appearances best match the query image.

You will also notice a set of slider bars on the page as well. These bars control the amount of emphasis placed on each class of characteristics measured from the phenotype images. For more specialized searches, adjust the sliders to weight the characteristics as desired before hitting the 'Search' button. By default, each class of characteristics is weighted evenly.


 
Image Key: 07_SF07_FP_00870_13_10_tip_les3_bet_12.8.07_DSC_0396
Image Key: 07_SF07_FP_00457_08_13_stem_les6_gimmel_10.8.07_DSC_0234
Image Key: 07_SF07_FP_00487_05_14_stem_les7_gimmel_11.8.07_DSC_0090
Image Key: 07_SF07_FP_00526_08_13_middle_les8_bet_12.8.07_DSC_0323
Image Key: 07_SF07_FP_00539_06_11_tip_les8_gimmel_11.8.07_DSC_0142
Image Key: 07_SF07_FP_00597_01_12_tip_les12_bet_12.8.07_DSC_0100
Image Key: 07_SF07_FP_00620_04_11_tip_les13_bet_12.8.07_DSC_0384
Image Key: 07_SF07_FP_00644_01_12_middle_les17_gimmel_11.8.07_DSC_0343
Image Key: 07_SF07_FP_00659_04_13_middle_les18_gimmel_11.8.07_DSC_0401
Image Key: 07_SF07_FP_00677_01_12_stem_les18_bet_12.8.07_DSC_0142
Image Key: 07_SF07_FP_00357_12_13_middle_les1_bet_10.8.07_DSC_0070
Image Key: 07_SF07_FP_00868_07_13_middle_les23_bet_12.8.07_DSC_0411
Image Key: 07_SF07_FP_00724_08_12_stem_les21_bet_12.8.07_DSC_0279
Image Key: 07_SF07_FP_00727_08_13_stem_les21_bet_12.8.07_DSC_0307
Image Key: 07_SF07_FP_00703_01_12_middle_les19_bet_12.8.07_DSC_0217
Image Key: 07_SF07_FP_00864_09_13_stem_les5_bet_12.8.07_DSC_0395
Image Key: 07_SF07_FP_00456_06_14_stem_les6_gimmel_10.8.07_DSC_0231
Image Key: 07_SF07_FP_00469_09_13_stem_les7_gimmel_11.8.07_DSC_0066
Image Key: 07_SF07_FP_00552_01_14_middle_les9_gimmel_11.8.07_DSC_0269
Image Key: 07_SF07_FP_00553_14_11_tip_les9_gimmel_11.8.07_DSC_0278
Image Key: 07_SF07_FP_00569_06_11_tip_les10_gimmel_11.8.07_DSC_0286
Image Key: 07_SF07_FP_00619_08_11_stem_les13_bet_12.8.07_DSC_0357
Image Key: 07_SF07_FP_00633_05_13_middle_les17_gimmel_11.8.07_DSC_0170
Image Key: 07_SF07_FP_00679_05_14_middle_les19_bet_12.8.07_DSC_0147
 
Query Image Image Characteristic Weightings
image
Lesion Size:
Lesion Distribution:
Lesion Shape:
Leaf Color:
Lesion Color:
Texture:
Number of Results: