We investigate potential sources of visual localization errors in this paper. We analyze subject behavior according to responses on a 2D Gaussian stimuli patch that is presented in 3 different eccentricities and 24 different angular locations over the course of 720 trials per subject. We develop heatmaps analyzing 4 main image statistics that represent visual scenes: edge distance, edge density, saliency, and luminance, and analyze the differences between perceived and physical locations of the patch. These image statistics are compared to the absolute errors of each trial to understand which image features lead most to localization errors. Results show that among permutation tests, localization errors are attracted to object and lumninance boundaries. In addition, localization is biased towards areas of low luminance and high salience. As a result, analyses show novel sources of localization errors and novel contextual influences in reported locations of natural scenes.