Jana Kramer wonders if her children, whom she shares with her ex Mike Caussincalls her new husband Allan Russell “Dad.”

In this week’s episode of his podcast Moan with Jana Kramerthe country singer and actress, 40, was joined by Russell, 43, and Caussin, 37, as the three discussed how they co-parent Kramer and Caussin’s daughter Jolie, 8, and their son Jace, 5 years old. As they discussed their relationships, Kramer asked what Caussin thought about his older children calling Russell “Daddy.”

“It’s a difficult question. They never called Allan Dad at my house,” Caussin said. “I’m not going to stand here and tell them you can’t call him whatever you want to call him.”

“We also had a conversation about that,” Kramer responds. “The three of us, remember, when we had a conversation last year when I was pregnant with Roman.”

Never miss a story: subscribe to PEOPLE’s free daily newsletter to stay up to date with the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

“And we’re like, ‘We can’t say what they can and can’t do. If they want to call him the Easter Bunny, they can call him the Easter Bunny. They can call him whatever he wants,’” she continues. “I’m not going to say you have to call him dad.”

“Yeah, and you don’t.” No one is obligated to make corrections. But that’s the one that stings the most,” Caussin says. “If I heard it, or if the kids said to me, ‘Oh, Mommy told us to call him Daddy.’ That would send me.

Russell intervened, adding that this would never happen because he would never allow children to call him “Daddy” in Caussin’s presence.

“Yeah, I think the only thing is with Roman, it’s more like I say Allan 90 percent of the time, but sometimes I’m like, ‘Go give that to Dad,'” Kramer says, referring to her and Russell’s son, Roman. “Because it’s Roman.”

“And I’m cool with that and I’m able to separate myself from that to a certain extent,” Caussin says. “But yeah, it’s just the hardest thing. Again, it’s like missing out on moments with the kids. That’s what it is. Comes with the territory.

Russell added that he doesn’t think the kids will ever call him “Daddy,” since they are old enough to discern who their father is and who their stepfather is.

“It’s not like I’ve been around the kids since they were 1 year and 6 months old where it would be any different. Of course, sometimes it could definitely come out of their mouths. I don’t think it “It’ll always be a habit,” Russell says. “I don’t think they’ll ever call me ‘Dad’ all the time. I think they’re at an age where… all this has happened where they’re at an age where they’re quite old.

“Yeah, at this point, they kind of call you what they call you,” Caussin says. “But I stand for that, it’s like a father or daddy is someone who provides, protects, takes care of a child, whether they’re biological or not. So, you know, you still deserve that title , obviously. But yes, the children know that.