Skip to main content
coney1's user avatar
coney1's user avatar
coney1's user avatar
coney1
  • Member for 3 years, 3 months
  • Last seen more than 1 year ago
awarded
comment
How do I control many datasets that are related and can change independently?
I've been wondering if I'm overthinking it, so it's nice to hear someone suggest that. For what it's worth, we don't know of any bugs when creating new versions of A; however we're working with data collected from an instrument and as we learn new ways to calibrate the data, the pipeline code that creates A changes as well. In practice, updating the calibration is just like fixing bugs but I suppose it feels different because the reason is due to our lack of understanding instead of QA failures.
comment
How do I control many datasets that are related and can change independently?
@JonasH I'd say they are reasonably optimized. I used 1h in the description of the problem to simplify the problem, but really E-->F (the longest runtime of the pipelines) takes several hours. That script is written in FORTRAN and I believe it's fairly optimized. I certainly know the type of scientists that write highly unoptimized code..
awarded
Loading…
Loading…
awarded
awarded
comment
Should a data class manipulate its input?
I appreciate the feedback! Yes, I used non-descriptive names for the sake of the example but your assertion at the end is particularly useful. I think my code is more readable already.
accepted
awarded
asked
Loading…