Plymouth had a chance to take the lead from the penalty spot on 26 minutes as Damien Delaney brought down David Norris inside the area. Ebanks-Blake took the penalty right-footed, but Boaz Myhill was equal to it as he managed to dive the right way and palm the ball to safety.
Nicky Forster nearly created a goal towards the end of the half as he raced into the box and slipped a ball across, but the Plymouth defence was quick to intercept and clear the danger.
The visitors took the lead on the stroke of half-time as Norris swung in a cross from the right and Halmosi arrived at the back post to nod the ball past Myhill.
Forster had a chance early in the second half as he ran on to a flick-on from Dean Windass, but his right-footed effort from 12 yards was wide of the mark.
Plymouth made it 2-0 on 59 minutes as Halmosi put in a cross from the left and Ebanks-Blake beat his marker to put the ball into the back of the net from six yards.
Hull grabbed one back moment later as Andy Dawson swung in a cross from the right which Windass nodded on to Forster, whose close-range header was well saved by Romain Larrieu but the Plymouth keeper couldn't do anything about the rebound as substitute Elliott fired the ball home from close range.
Halmosi came close to putting his side further in front soon after, but his right-footed effort from close range hit the post and went out for a goal-kick.