The Lille forward came off the bench to crash high into the net with just two minutes left after some mesmeric play by Eden Hazard on the flank.
It came just moments after Kevin Mirallas hit the post, but in truth it was very harsh on Fabio Capello's Russia.
The Red Devils have been tipped to go far in this tournament but again struggled to impress as the Russians carved out the better openings.
Victor Faizulin forced a fine early save out of Thibaut Courtois before the Russians had a big shout for a penalty when Toby Alderweireld tripped Maxim Kanunnikov on the left of the area.
Alexander Kokorin then planted a free header wide from a sumptuous left-wing cross in first-half stoppage time before Andrey Eshchenko drilled just wide in the second half.
Russia looked all set to earn the draw but were undone late on as Belgium stepped it up in the final five minutes to snatch victory.