This paper, firstly, discusses the history and differences among logical structure, syntactic structure and information structure. Then, a few examples are given to explain if it is possible to analyze the syntactic structure of each sentence correctly that is helpful to understand its information structure. Finally, through the French and Chinese examples and their inter-translation, this paper will discuss the concept of fidelity in the three elements of fidelity, fluency and elegance of translation. Not only does the fidelity mean the translation of words but also the information structure in the original texts should be considered while doing translation. In other words, it is necessary to consider the information structure in the original texts and to present the meanings of structure as accurate as possible in the TL when doing translation.