Although unmanned aerial vehicles (UAV) can provide images with high resolution in a portable and easy way, the matching algorithms such as scale-invariant feature transform and speeded-up robust features (SURF) are often time-consuming. To reduce the time of image matching processes, a fast and low-cost method is proposed for constructing the UAV image matching framework using a satellite image. In this context, the satellite image is used as the base map of UAV images. To find the matching points between UAV and satellite images, a simplified version of SURF is designed to detect interest points. The simplified version of the SURF method uses only one octave of scale spaces to build filter response maps, and each octave is subdivided into four levels of scale spaces. Meanwhile, template matching is used to remove incorrectly matched points. The experimental results show that the method of this paper is robust and can deal with images acquired by small-sized UAVs without a position and orientation system. The method can calculate the rough overlap regions, which are then employed to narrow down the searching space. This will improve the speed of matching greatly, especially for an unordered database of images.