Duck Dynasty: Phil Robertson Told Willie Show Was a Bad Idea / Jimmy Fallon Interview with 'Duck Dynasty' Stars [VIDEO]

Nobody could have predicted the massive success A&E series Duck Dynasty has had in four seasons. Nobody except for Duck Commander CEO Willie Robertson.

When Willie and a couple other Duck Dynasty stars appeared on Late Night with Jimmy Fallon earlier in the week, Willie confessed his father, and Robertson patriarch was skeptical about the idea of having a reality television show based on the family.

"We just got an email out of the blue that said, 'Hey, I think you guys may have a big show," Willie told to Jimmy Fallon on the late night talk show.  "I said, 'Dad, we could do a big show on a network.'"

What did the all-knowing Phil Robertson reply to his business-savy son?

"Nah, that won't work."

Willie told Fallon he reminds his dad every day of the momentary misjudgment.

Could you imagine a world without Duck Dynasty? How bleak a place without Uncle Si's blend of senility and genius? A world without Phil's solemn understanding of the universe? A world without Miss Kay's homemade jam?

Catch it all when Duck Dynasty Season 4 airs Wednesday at 10 PM ET on A&E.

Here's the clip of Duck Dynasty stars Willie, Jep and Uncle Si Robertson on Jimmy Fallon.