A reference picture is processed to generate, first, second and third pictures. The first picture has a lower resolution than the second picture and the second picture has a lower resolution than the third picture. Using independent starting positions, first and second stage field motion estimation (motion vector) searches are preformed using the first and second pictures, respectively. By performing the first stage field motion estimation search, a first field motion vector candidate is obtained. By performing the second stage field motion estimation search, a second field motion vector candidate is obtained. Using at least one of the first and second field motion vector candidates as a starting position and the third picture, a third stage field motion estimation search is performed. Alternatively, a first stage field motion estimation search is performed using the first picture to obtain a first motion vector from a top reference field and a second motion vector from a bottom reference field. A second stage field motion estimation search is performed using the second picture to obtain a third motion vector from the top reference field and a fourth motion vector from a bottom reference field.