Jude Loi knows a thing or two about being the The sexiest man in the world. After all, he held the coveted title 20 years ago.

Now, as PEOPLE prepares to crown a new winner (Patrick Dempsey is the reigning ADM), Law, 51, offers some advice to the man who has yet to be named.

“Be yourself, guys. Be yourself,” he says before joking: “Actually, my advice is to ask George Clooney. Hadn’t he been there six times? (For the record, Clooney was champion twice: in 1997 and 2006.)

Law’s time as the Sexiest Man Alive came as he established himself as a bona fide star, headlining films like 2004’s. Sky Captain and the World of Tomorrowof which producer Jon Avnet exclaimed: “The thing about Jude is that he has the talent of a character actor and the looks of a leading man.”

Never miss a story: subscribe to PEOPLE’s free daily newsletter to stay up to date with the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

Law’s former teammates also paid tribute to him in the cover story: “He’s the most beautiful man who ever walked the earth – an absolutely perfect oil painting.” Naomi Wattshis partner in comedy I love Huckabeeshe said at the time.

Added Rachel Weiszwho acted with Law in Enemy at the gates“He has the most beautiful eyes you’ve ever seen.”

The compliments are nice, but the Oscar-nominated actor, at this point in his career, just wants to focus on his best work.

“Honestly, I think my priority is to continue working into my 80s and 90s and continue to surprise myself,” Law, who stars in the new police drama The Ordertells PEOPLE. “I always remember seeing the Peter Greenaway film Prospero’s books with John Gielgud and he was like 80 years old doing this incredible, bizarre performance and this nudity.

“And I always remember being blown away by the evidence that this guy, this knight of the theater, this guy at the end of his career… he’s still challenging himself and having fun. I always thought it was so ambitious.

The next PEOPLE The sexiest man alive will be revealed on Tuesday, November 12