Readit News logoReadit News
benzofuran commented on LabPlot: Free, open source and cross-platform Data Visualization and Analysis   labplot.org/... · Posted by u/turrini
goku12 · 3 days ago
It's the use case. Here is one concrete example. I worked as a project engineer during the development of a launch vehicle. The telemetry data frames from every test and every flight were processed into numerous CSV or TSV files that were labeled with the parameter name. Those files could be very large depending up on their sampling rates, especially for tests that lasted hours on end. You would conduct exploratory manual analysis on that data which involves:

* Quickly cycle visually through time series graphs (often several hundred parameters). You'd have seen most of those parameters before and would quickly catch any anomalies. You can clear so much data rapidly like this.

* Quickly analyze a graph at various zoom and pan settings. May be save some as images for inclusion in documents. Like above, the zoom and pan operations often follow each other in a matter of seconds.

* Zoom into fine details, down to single bit levels or single sample intervals. There's surprising amount information you can glean even at these levels. I have run into freak, but useful single events at these levels. And since they're freak events, it's hard to predict in advance where they'd show up. So operation speed becomes a key factor again.

* Plot multiple parameters (sometimes with different units) together to assess their correlation or unusual events. We used to even have team analysis sessions where such visualizations were prepared on demand.

* Do statistical or spectral analysis (like periodograms, log or semi-log graphs, PDFs, etc)

* Add markers or notes within the graph (usually to describe events). Change the axes or plot labels. Change grid value formatting (eg: Do you want time in seconds or HMS?).

All the operations above are possible with Julia, Matlab, R or Python. And we did use almost all of them (depending on personal preference). But none of them suit the workflow described above for one simple reason - speed. You don't have enough time to select each parameter by text or GUI. There must be a way to either quickly launch a visualization or cycle through the parameters as the investigator closes each graph. You also don't have time to set zoom, pan and labels by text. It must be done using mouse (zoom & pan) and directly on the graph (labels and markers) in a WYSIWYG manner. And you don't want to run an FFT or a filter function, save the new series and then plot it - you want it done with a single menu selection. The difference is like using a C++ compiler vs Python in JupyterLab. The application we used was very similar to Labplot.

Now, Excel might seem like a better choice. In fact, LabPlot and our application all has a spreadsheet-like interface with the ability to directly import CSV, TSV, etc. But Excel just doesn't cross the finish line for our requirement. For example, to plot a time series in excel, you have to select the values (column or cells), designate the axes, optionally define the axes and graph labels, start a plot, expand it to required levels and format the print. At that rate, you wouldn't finish the analysis in a month. Those applications would do all that on their own (the labels and other metadata were embedded in the data files by means of formatted comments). But an even bigger problem was the size of the data. Some of those files on import would slow down Excel to speed of molasses. The application had disk and memory level buffering to significantly improve the responsiveness to almost instant interactivity.

I hope this gives you an idea where the tools that you mentioned are not good enough replacements for LabPlot and similar tools.

benzofuran · 3 days ago
Sounds like plotjuggler (https://github.com/facontidavide/PlotJuggler) could be worth checking into as well for you.
benzofuran commented on Drafting Software Recommendation    · Posted by u/morpheos137
benzofuran · a month ago
Bricscad (www.bricsys.com) is a professional (paid) cad package that has most of what you're looking for. They're old-school perpetual license folks and they have a fully featured demo so you can try out the various scripting/programmatic options for a bit. No relation except as a user, but if you're willing to pay it's probably your easiest path forward.
benzofuran commented on Interactive tour of James Clerk Maxwell's house   clerkmaxwellfoundation.or... · Posted by u/joebig
benzofuran · 2 years ago
If you're ever in Edinburgh, this is an excellent place to visit and spend an afternoon. One of the funniest parts was upon walking in the door, the gentleman who greeted me asked "What kind of engineer are you?" Very worthwhile.
benzofuran commented on Geospatial data science with Julia   juliaearth.github.io/geos... · Posted by u/juliohm
jstrickshire · 2 years ago
Yeah, I can do that. Will get to it tomorrow!
benzofuran · 2 years ago
Awesome - getting KMZs of 4x4 routes is way harder than it should be. All the Colorado data is there but extracting it is challenging.
benzofuran commented on Geospatial data science with Julia   juliaearth.github.io/geos... · Posted by u/juliohm
jstrickshire · 2 years ago
I have a passion project 4x4anarchy.com that operates with a Python-MariaDB system for querying map data by latitude and longitude, transforming it into GeoJSON for map display. The website deals with sizable tables, approximately 1 GB in size. I've made extensive optimizations, relying on well-structured indexes, caching mechanisms, and query optimization to enhance performance.

Given these circumstances, how might the incorporation of Julia and some geospatial DB (PostGIS) contribute to further optimizing geospatial data retrieval and presentation, especially when dealing with large datasets and intricate geospatial operations?

benzofuran · 2 years ago
Cool site! Any chance of a adding a simple KMZ export for offline use for a given area of interest?
benzofuran commented on Americans have never been so unwilling to relocate for a new job   bloomberg.com/news/articl... · Posted by u/JumpCrisscross
benzofuran · 2 years ago
It's getting much tougher to pull this off - I recently had an offer for a cherry government job but it was in southern California. The salary, while competitive for most locations, would've required me to be independently wealthy to live within an hour of the office in order to buy even a modest home.
benzofuran commented on Show HN: Engineering Book Club   engineeringbookclub.com/... · Posted by u/miguelbemartin
benzofuran · 2 years ago
Is this for software engineers or actual engineers? You may want to specify.
benzofuran commented on The Black Ships Shock: A Historic Encounter That Changed Japan   nippon.com/en/japan-topic... · Posted by u/rntn
benzofuran · 3 years ago
Dan Carlin's Hardcore History (episode 1: https://www.dancarlin.com/product/hardcore-history-62-supern...) recently did a great series "Supernova in the East" on the modernization of Japan and the internal politics. If you've got some time (drive or such), it's well worth the listen and there's a great diversity of sources.
benzofuran · 3 years ago
Book list: https://www.goodreads.com/list/show/177152.Dan_Carlin_s_Hard...

For some reason it didn't get appended to the podcast descriptions

benzofuran commented on The Black Ships Shock: A Historic Encounter That Changed Japan   nippon.com/en/japan-topic... · Posted by u/rntn
LarryMullins · 3 years ago
What boggles my mind is that less than 100 years after this happened, the Imperial Japanese Navy was able to give the US Navy a serious run for their money. The rapid industrial and technological development of Japan is hard to comprehend. Medieval feudalism to an industrial powerhouse in just a few decades.
benzofuran · 3 years ago
Dan Carlin's Hardcore History (episode 1: https://www.dancarlin.com/product/hardcore-history-62-supern...) recently did a great series "Supernova in the East" on the modernization of Japan and the internal politics. If you've got some time (drive or such), it's well worth the listen and there's a great diversity of sources.
benzofuran commented on Ford Mustang Mach-E has a mile of wires it doesn’t need. That’s a big deal   cnn.com/2023/02/04/busine... · Posted by u/rntn
benzofuran · 3 years ago
They certainly haven't made this mistake in any late-model F-x50 Super Duties. The amount that has to be unplugged and shuffled to do even minor work is amazing, not to mention the entire front end has to be disassembled to replace the headlight bulbs.

Hopefully this will usher in some 'common sense' engineering at Ford and other manufacturers and get them back to sane and serviceable designs.

u/benzofuran

KarmaCake day388March 7, 2012
About
Metallurgical Engineer
View Original