I have some data files that I would like to read and decipher using Python. They are self-describing .dat files, which means that they contain human readable information about the corresponding data for each of the parameters contained in the files (the files contain data for many different parameters that were measured by a simulation). The amount of data entries corresponds to the metadata for each parameter being measured.
I would like to recover this information somehow, then read the data corresponding to this information. When I attempted to use pandas read_csv function, I received a ParserError. I could get around this by skipping the header, but I would then lose the information in it. What solutions are there to my situation?