CS 143 - Project 2: pb-lite: Boundary Detection

Arman Uguray (auguray)

pb-lite is a boundary detection algorithm, based on the 2011 paper by Arbelaez, Maire, Fowlkes and Malik. The problem with most traditional boundary detection algorithms is that they don't distinguish well between edges that form continuous boundaries between logical segments and edges that belong to region that forms a texture.

Algorithm

The algorithm has these basic steps:

  1. Group pixels into different clusters based on the orientation and intensity of edges they lie on using k-means,
  2. Generate brightness and texture gradients based on the chi-square distance of each pixel to the 'mean' value of its cluster,
  3. Multiply the result of a canny edge detection output by the gradients to distinguish the contiuous contours from 'textures'.

The first step, which results in a "texton-map", is achieved by convolving the image with a filter bank, consisting of a collection of oriented derivative of Gaussian filters:

fb-small fb-large

The second step is generated by calculating the chi-square distance of each pixel to the mean value of the cluster. This is done by independently convolving pixels that belong to each cluster by a set of half-disk masks.

masks

The final result is obtained by taking the average value of the set of results obtained by each pair of half-disk images.

Results

Here are the set of results for each of the 10 images in the given testset. The graph shows how it compared based on the two other baseline filters:

pr-curve

Graph generated with default parameters

1. Penguin

pbl
real1 sobel1 canny1
Original Sobel Canny

2. Rhinos

real1
pb1 sobel1 canny1
Original Sobel Canny

3. Fish

real1
pb1 sobel1 canny1
Original Sobel Canny

4. Bird

real1
pb1 sobel1 canny1
Original Sobel Canny

5. Airplane

real1
pb1 sobel1 canny1
Original Sobel Canny

6. Caterpillar

real1
pb1 sobel1 canny1
Original Sobel Canny

7. Butterfly

real1
pb1 sobel1 canny1
Original Sobel Canny

8. Duck

real1
pb1 sobel1 canny1
Original Sobel Canny

9. Gorilla

real1
pb1 sobel1 canny1
Original Sobel Canny

10. Hawk

real1
pb1 sobel1 canny1
Original Sobel Canny