Cole Hauser opens with the biggest difference he’s experienced between raising his daughter and raising his sons.

Thursday, November 7, episode of The Drew Barrymore ShowTHE Yellow stone star, 49, revealed that he and his wife Cynthia Daniel11-year-old daughter Steely “runs the roost,” which also includes their sons Ryland, 20, and Cole, 16.

“At the end of the day, I love him so much that it’s hard for me to say no to anything,” the actor admitted. “But I’m getting better as she gets older and I’m a little more careful giving her everything she asks for.”

Never miss a story: subscribe to PEOPLE’s free daily newsletter to stay up to date with the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

Laugh, host Drew Barrymore “Was it like that with your boys?” he asked.

“No,” he replied promptly. “They have nothing. ‘Go to work, do what I tell you to do, go play sports.’ It’s just totally different.”

He added: “My wife says it all the time, she says, ‘She’s got you wrapped around your finger.’ ”

The PEOPLE Puzzler crosswords are here! How quickly can you solve it? Play now!

During the filming of the fourth season of Yellow stone on site during the COVID-19 pandemic. Hauser told PEOPLE in November 2020 that he saw this period as a lesson in “how important it is to enjoy family”.

“It’s been a little difficult the last few years, just because I’m away for five months at a time,” he said, explaining how his family copes when he’s away from home.

“It’s not easy being a parent from a distance. Steely is a real gun, and they are great boys. When I’m away, they take over, making sure Mom and Steely are watched. That’s how I raised them and I’m proud of them for that.”

Yellow stone returns Sunday, November 10 at 8:00 PM ET/PT on the Paramount Network.