Timeline for Moving from C++ to NodeJS - Working with XML and JSON
Current License: CC BY-SA 3.0
10 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 13, 2017 at 12:32 | history | edited | Umut Kahramankaptan | CC BY-SA 3.0 |
deleted 26 characters in body
|
| Apr 19, 2015 at 18:15 | comment | added | Umut Kahramankaptan | Depending on the available RAM, you can use a Java DOM with good amount of memory allocated via jvm options. If you are looking for straight forward object selection, a SAX or StAX parser can do the job. It really depends on your data, filtering criteria, performance requirements and resources after all. | |
| Apr 19, 2015 at 16:22 | comment | added | Jimmy | I pull in a fairly large number (10 initially, around 50 in the future) of 100mb xml files from web domains, then I work out the difference between the files, i.e what nodes have been added / removed in the newer file, then I pump out the results in JSON. I can't vary my output format (json) or my input format (xml) but I can do whatever I want in the middle. Since this is run in the cloud time is money. | |
| Apr 19, 2015 at 16:19 | comment | added | Umut Kahramankaptan | Now I am thinking, could you describe the system and your need a little bit more, if it is not sensitive. I can suggest a more solid answer if you can support the requirement and background of the domain. | |
| Apr 19, 2015 at 16:19 | comment | added | Jimmy | Yes it is external. Are you thinking to convert it to json straight away and then process that, or did you have something else in mind? | |
| Apr 19, 2015 at 16:17 | comment | added | Umut Kahramankaptan | Is your xml source external to your system? You might want to try a conversion earlier when your system receives the data, or you might want to use an opportunistic deamon to utilize conversion in parallel. | |
| Apr 19, 2015 at 11:53 | vote | accept | Jimmy | ||
| Apr 19, 2015 at 10:22 | review | First posts | |||
| Apr 19, 2015 at 11:02 | |||||
| Apr 19, 2015 at 10:20 | comment | added | Jimmy | Thank you for the help. I need to run this every few hours each day with a lot of data. I'm having a really hard time working with xml and JSON in C / C++. Python was running a bit slow for my liking (at least 15 times slower) | |
| Apr 19, 2015 at 10:17 | history | answered | Umut Kahramankaptan | CC BY-SA 3.0 |