The insoluble carbonaceous matter from 12 chondrites (CI, CM, CO, CV, EH, and UOC), was characterized by high resolution transmission electron microscopy (HRTEM). Besides ubiquitous nanoglobules, the insoluble organic matter from petrologic type 1 and 2 chondrites and Semarkona (LL 3.0) is composed of a highly disordered polyaromatic component. No structural differences were observed between these IOMs, in agreement with the limited thermal metamorphism they all experienced. In chondrites of petrologic type >3.0, the evolution of the IOM is controlled by the extent of thermal metamorphism. The polyaromatic layers, shorter than 1 nm in petrologic type =3.0 chondrites, grow up to sizes between 5 and 10 nm in petrologic type >3.6 chondrites, contributing to the increase of the degree of structural order. In addition, we find rare, but ubiquitous onion-like carbons, which may be the product of nanodiamond graphitization. The insoluble carbonaceous matter of the enstatite chondrite Sahara 97096 (EH 3) is different from the other meteorites studied here. It is more heterogeneous and displays a high abundance of graphitized particles. This may be the result of a mixture between (1) the disordered carbon located in the matrix, and (2) catalytic graphitized phases associated with metal, potentially originating from partial melting events. The structural and nanostructural evolution are similar in all IOMs. This suggests that the structure of the accreted precursors and the parent body conditions of their secondary thermal modifications (temperature, duration, and pressure) were similar. The limited degree of organization of the most metamorphosed IOMs compared with terrestrial rocks submitted to similar temperature suggests that the conditions are not favorable to graphitization processes, due to the chemical nature of the precursor or the lack of confinement pressure.