Readit News logoReadit News
strooper commented on ISBN Visualization   annas-archive.li/isbn-vis... · Posted by u/simon04
strooper · 8 days ago
Is ISBN database available for download?
strooper commented on Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun   blog.wilsonl.in/hackerver... · Posted by u/wilsonzlin
zX41ZdbW · 2 years ago
It is very easy to get this dataset directly from HN API. Let me just post it here:

Table definition:

    CREATE TABLE hackernews_history
    (
        update_time DateTime DEFAULT now(),
        id UInt32,
        deleted UInt8,
        type Enum('story' = 1, 'comment' = 2, 'poll' = 3, 'pollopt' = 4, 'job' = 5),
        by LowCardinality(String),
        time DateTime,
        text String,
        dead UInt8,
        parent UInt32,
        poll UInt32,
        kids Array(UInt32),
        url String,
        score Int32,
        title String,
        parts Array(UInt32),
        descendants Int32
    )
    ENGINE = MergeTree(update_time) ORDER BY id;
    
A shell script:

    BATCH_SIZE=1000

    TWEAKS="--optimize_trivial_insert_select 0 --http_skip_not_found_url_for_globs 1 --http_make_head_request 0 --engine_url_skip_empty_files 1 --http_max_tries 10 --max_download_threads 1 --max_threads $BATCH_SIZE"

    rm -f maxitem.json
    wget --no-verbose https://hacker-news.firebaseio.com/v0/maxitem.json

    clickhouse-local --query "
        SELECT arrayStringConcat(groupArray(number), ',') FROM numbers(1, $(cat maxitem.json))
        GROUP BY number DIV ${BATCH_SIZE} ORDER BY any(number) DESC" |
    while read ITEMS
    do
        echo $ITEMS
        clickhouse-client $TWEAKS --query "
            INSERT INTO hackernews_history SELECT * FROM url('https://hacker-news.firebaseio.com/v0/item/{$ITEMS}.json')"
    done
It takes a few hours to download the data and fill the table.

strooper · 2 years ago
While trying the script, I am getting the following error -

<Trace> ReadWriteBufferFromHTTP: Failed to make request to 'https://hacker-news.firebaseio.com/v0/item/40298680.json'. Error: Timeout: connect timed out: 216.239.32.107:443. Failed at try 3/10. Will retry with current backoff wait is 200/10000 ms.

I googled with no luck. I was wondering if you have a solution for it.

strooper commented on Show HN: exaequOS - a new OS running in a web browser   exaequos.com... · Posted by u/baudaux
strooper · 2 years ago
What's the difference between an OS and an emulator in this scenario?
strooper commented on China crisis is a TikToking time bomb   theregister.com/2023/03/2... · Posted by u/unripe_syntax
strooper · 3 years ago
"The difference is the extensive legal framework protecting Western citizens and companies from state security overreach."

Unfortunately, China is winning in the rest of the world for the same reason. While western citizens and companies are well protected, the West has intentionally kept the rest of the world vulnerable for self dirty interest. We have seen the Western hypocrisy in policies and moral codes destroying societies for decades all over the world. If the Western code of conducts for the rest of the world were hypocrisy free, Chinese slithering would have been impossible, and the world would be a lot better than it is now.

strooper commented on Ask HN: Teach a 5-year-old math and science over the summer?    · Posted by u/a_brawling_boo
strooper · 4 years ago
We have been following Singapore math for our kid since he was a little over five years old. We've found the concepts in this book series practical and workbooks enjoyable for the kid.
strooper commented on Back to India   yugal.me/back-to-india/... · Posted by u/sdht0
strooper · 4 years ago
If solving problems create opportunities for new ventures, that is what the smart people should do instead of piggy backing on technologically stagnated big corporations. Developing countries may have significantly less quality of life in general, but there have always been a class of people enjoying life no less than anyone in the "first world", probably more. Simply put developing countries also need amazon, paypal, EV as they develop and adaption of long existing technology is more important than innovation there. So, entrepreneurs from technologically advance (and competitive) countries have even more opportunities to play bigger roles and create significant impact in a society.
strooper commented on Google Buys DoubleClick for $3.1B (2007)   nytimes.com/2007/04/14/te... · Posted by u/cryptoz
sharemywin · 4 years ago
The internet has always sucked. dial-up was the worst.
strooper · 4 years ago
The best thing about dial-up was the sound of the data transfer. Ah! Those days!
strooper commented on Ask HN: I'm So Lonely    · Posted by u/DevToRecruiter
strooper · 4 years ago
From my history of long time loneliness, I have learned to cope with it by observing things that bring me out of my comfort zone in positive way. I found the following activities helping me- 1. Attending (and pushing myself to mingle) conference or workshop on topics of my interest and expertise. 2. Spend some time at the park or places where relaxed people are around you. 3. Learning wu shu or Tai chi from a good master. It not only helps to widen your physical capabilities, but also you get to interact with other people. 4.Challenge yourself with activities that you are able to fulfill, and enjoy. Volunteering for non-profit organization, hiking in the mountain, learning a new sports, even walking slowly, aimlessly in the market/mall helped me feel myself.
strooper commented on The modern web on a slow connection (2017)   danluu.com/web-bloat/... · Posted by u/x14km2d
strooper · 5 years ago
I wonder if the experience improves by using proxy browsers, such as- Opera (lite/mini).

u/strooper

KarmaCake day342April 11, 2015View Original