Limitations of Content-based Image Retrieval

© Copyright 2008 by T. Pavlidis

Appendix D: Edge Histograms Provide No Semantic Information Either

It is not only color histograms that do not provide semantic information. Edge Histograms (another popular feature) do not provide it either. For each of the six images used in the discussion of Color Histograms and a seventh one ("Tomb") as well as their histogram equalized version I computed an edge strength histogram and then computed the normalized distance (percent of average image area) for all the 91 pairs. The results were sorted according to the computed distance. If such histograms provided semantic information, one would expect that the smallest distances would occur between an image and its equalized version. But this happened in only two cases, the images of "dogs" and "people" (marked by green). For the other five images the distance between the pair (marked in dark red) that are closest semantically is larger than that of unrelated pairs.

A Note on Details: The edge strength of a pixel is computed as the largest of the vertical and horizontal gradients at that pixel. The table has been generated by a program that looks at all possible distinct pairs of images in a folder. Only format editing was done before it was incorporated in this document.


List of the Distance of the Edge Histograms of All Pairs from a Set of Pictures
1: D[fountain.jpg, palm.jpg] = 9
2: D[dogs.jpg, e_dogs.jpg]= 10
3: D[books.jpg, e_fountain.jpg]= 10
4:D[people.jpg, e_people.jpg]= 12
5: D[dogs.jpg, e_books.jpg]= 16
6: D[e_books.jpg, e_dogs.jpg]= 18
7: D[e_books.jpg, e_people.jpg]= 19
8: D[fountain.jpg, e_palm.jpg]= 20
9: D[house.jpg, e_people.jpg]= 21
10: D[people.jpg, e_books.jpg]= 21
11: D[books.jpg, e_palm.jpg]= 22
12: D[e_fountain.jpg, e_palm.jpg]= 23
13: D[books.jpg, people.jpg]= 23
14: D[people.jpg, e_fountain.jpg]= 24
15: D[palm.jpg, e_palm.jpg]= 24
16: D[people.jpg, e_palm.jpg]= 24
17: D[dogs.jpg, tomb.jpg]= 25
18: D[books.jpg, e_books.jpg]= 26
19: D[e_fountain.jpg, e_people.jpg]= 26
20: D[tomb.jpg, e_dogs.jpg]= 26
21: D[books.jpg, e_people.jpg]= 28
22: D[house.jpg, people.jpg]= 29
23: D[e_books.jpg, e_fountain.jpg]= 29
24: D[house.jpg, e_books.jpg]= 29
25: D[e_house.jpg, e_tomb.jpg]= 30
26: D[e_dogs.jpg, e_people.jpg]= 30
27: D[dogs.jpg, e_people.jpg]= 31
28: D[e_palm.jpg, e_people.jpg]= 31
29: D[house.jpg, e_dogs.jpg]= 32
30: D[fountain.jpg, e_fountain.jpg]= 33
31: D[books.jpg, dogs.jpg]= 34
32: D[dogs.jpg, house.jpg]= 35
33: D[fountain.jpg, people.jpg]= 35
34: D[e_dogs.jpg, e_house.jpg]= 36
35: D[books.jpg, fountain.jpg]= 36
36: D[dogs.jpg, people.jpg]= 37
37: D[dogs.jpg, e_fountain.jpg]= 38
38: D[people.jpg, e_dogs.jpg]= 38
39: D[e_books.jpg, e_palm.jpg]= 38
40: D[palm.jpg, e_fountain.jpg]= 39
41: D[palm.jpg, people.jpg]= 40
42: D[books.jpg, palm.jpg]= 40
43: D[tomb.jpg, e_books.jpg]= 40
44: D[books.jpg, e_dogs.jpg]= 41
45: D[tomb.jpg, e_house.jpg]= 41
46: D[house.jpg, e_fountain.jpg]= 45
      
47: D[e_dogs.jpg, e_fountain.jpg]= 45
48: D[books.jpg, house.jpg]= 45
49: D[dogs.jpg, e_house.jpg]= 45
50: D[house.jpg, e_house.jpg]= 45
51: D[house.jpg, e_palm.jpg]= 46
52: D[fountain.jpg, e_people.jpg]= 46
53: D[house.jpg, e_tomb.jpg]= 49
54: D[dogs.jpg, e_palm.jpg]= 50
55: D[e_books.jpg, e_house.jpg]= 50
56: D[palm.jpg, e_people.jpg]= 51
57: D[fountain.jpg, e_books.jpg]= 53
58: D[tomb.jpg, e_people.jpg]= 55
59: D[e_dogs.jpg, e_palm.jpg]= 55
60: D[books.jpg, tomb.jpg]= 56
61: D[house.jpg, tomb.jpg]= 57
62: D[e_house.jpg, e_people.jpg]= 57
63: D[palm.jpg, e_books.jpg]= 58
64: D[e_dogs.jpg, e_tomb.jpg]= 59
65: D[fountain.jpg, house.jpg]= 60
66: D[tomb.jpg, e_fountain.jpg]= 61
67: D[people.jpg, tomb.jpg]= 61
68: D[people.jpg, e_house.jpg]= 65
69: D[house.jpg, palm.jpg]= 65
70: D[dogs.jpg, fountain.jpg]= 66
71: D[e_books.jpg, e_tomb.jpg]= 69
72: D[tomb.jpg, e_tomb.jpg]= 69
73: D[dogs.jpg, e_tomb.jpg]= 69
74: D[tomb.jpg, e_palm.jpg]= 69
75: D[e_people.jpg, e_tomb.jpg]= 69
76: D[dogs.jpg, palm.jpg]= 70
77: D[fountain.jpg, e_dogs.jpg]= 70
78: D[palm.jpg, e_dogs.jpg]= 74
79: D[books.jpg, e_house.jpg]= 74
80: D[people.jpg, e_tomb.jpg]= 77
81: D[e_fountain.jpg, e_house.jpg]= 77
82: D[e_house.jpg, e_palm.jpg]= 81
83: D[fountain.jpg, tomb.jpg]= 87
84: D[palm.jpg, tomb.jpg]= 89
85: D[e_fountain.jpg, e_tomb.jpg]= 93
86: D[books.jpg, e_tomb.jpg]= 93
87: D[fountain.jpg, e_house.jpg]= 94
88: D[e_palm.jpg, e_tomb.jpg]= 95
89: D[palm.jpg, e_house.jpg]= 98
90: D[fountain.jpg, e_tomb.jpg]= 103
91: D[palm.jpg, e_tomb.jpg]= 107

Back to the Table of Contents - Back to Section 2

Latest update June 16, 2008