Allow me to open with a wildly speculative question: What if the internet were public interest technology? I mean "internet" the way most people understand it, which is to say our whole digital sphere, and by "public interest" I don't mean tinkering at the margins to reduce harm from some bad actors or painting some glossy ethics principles atop a pile of exploitative rent-seeking — I mean through and through, warts and all, an internet that works in support of a credible, pragmatic definition of the common good.
Readit Newsrecifs commented on The Public Interest Internet berjon.com/public-interes... · Posted by u/recifs
recifs commented on Observable 2.0, a static site generator for data apps observablehq.com/blog/obs... · Posted by u/tmcw
Are you planning to add new UI components like Data Table or other in the future or it’s purely Plotting and Data ingestion and the UI through Tailwind or CSS or would it be possible to add UI libraries like shadcn or DaisyUI to make it a full fledged web site? Thanks
It’s only the first public release, rest assured we have plans to develop it beyond that point :-)
Data tables are high on the list, but it’s going to be a lot of work and I can’t say when we’ll have something to share.
In the meantime almost any library available on npm should work out of the box—not just the ones that we added explicit support for (even though of course some might need more work than others).
recifs commented on Observable 2.0, a static site generator for data apps observablehq.com/blog/obs... · Posted by u/tmcw
Came here with similar questions and Cmd-F "DuckDB". See the comment about "data loaders". Seems like a "data loader" would provide most of what you're asking about.
I'm also thinking that a "data loader" combined with duckdb-wasm and arrow would be a pretty nice combination. I imagine that it might not be too difficult to switch two between two implementations of the "data loader" as needed. Switch between reading from a remote system (in your case DuckDB on a server) and DuckDB running locally in the browser (that can interact with its own remote or local data sources).
See the example at https://huggingface.co/spaces/observablehq/fpdn where DuckDB is used both as a data loader (to download and digest 200GB worth of source data into a small 8MB parquet file) and on the client-side to allow the user to do live search queries on the minimized data. Server-side, we're using duckdb-the-binary, and client-side we're using duckdb-wasm.
recifs commented on Observable 2.0, a static site generator for data apps observablehq.com/blog/obs... · Posted by u/tmcw
I love how much is possible with the Observable framework and support for libraries like d3.js. However many data apps cannot precompute their outputs. For example, a pipeline that extracts text from documents based on what a user queries, cannot precompute the results and any visualizations must be updated every time. The best hack to accomplish this seems to be rebuilding the app on each update. Or is there another solution?
The code in a Framework can do whatever you want it to do—it can load data on demand, call an external API, etc. Precomputing data is only an option, not an obligation.
But even when you want things to be very interactive it is a good idea to minimize the data. Expose only the "rows and columns" that you need, and compress it as much as possible. This can be done in a data loader. For example, see the data app we deployed yesterday on hugging-face: its data loaders ingest a large source database (320 files totaling 200GB), and digests it into a single 8MB parquet file that we can then use on the page to "live query" 3 million newspaper titles and dates. https://huggingface.co/spaces/observablehq/fpdn
recifs commented on Observable 2.0, a static site generator for data apps observablehq.com/blog/obs... · Posted by u/tmcw
I miss source loading D3 into a simple HTML page, and having D3 tutorials that were up to spec with the latest D3 release.
Yeah Observable data pages look cool, but it really feels like excessive JS bloat for the features.
I think I miss throwing a D3 viz together without having to load an entire framework library.
You can still use D3 the good old-fashioned way, as a standalone script. See https://d3js.org/getting-started#d3-in-vanilla-html for examples.
recifs commented on DIY live map of Air quality in the US observablehq.com/@fil/dyi... · Posted by u/recifs
Given the news today I wanted to see how quickly one can find live air quality data and create a DIY map. Using Observable Plot.
recifs commented on Observable Plot: A JavaScript library for exploratory data visualization observablehq.com/plot... · Posted by u/mbostock
Looks great! I would love to see a violin plot example.
Here's an example https://observablehq.com/@jonhelfman/plot-violin-chart-with-...
We don't have a good KDE built-in yet, but you could upvote https://github.com/observablehq/plot/issues/1469