The Door in the Wall (1956)

A man is haunted throughout his life, by a magical door that opens onto an alternate, Garden-of-Eden like world.