offbyone (u/offbyone)

offbyone commented on Oban, the job processing framework from Elixir, has come to Python dimamik.com/posts/oban_py... · Posted by u/dimamik

sorentwo · 13 days ago

With a typical Redis or RabbitMQ backed durable queue you’re not guaranteed to get the job back at all after an unexpected shutdown. That quote is also a little incorrect—producer liveness is tracked the same way, it’s purely how “orphaned” jobs are rescued that is different.

offbyone · 13 days ago

"jobs that are long-running might get rescued even if the producer is still alive" indicates otherwise. It suggests that jobs that are in progress may be double-scheduled. That's a feature that I think shouldn't be gated behind a monthly pro subscription; my unpaid OSS projects don't justify it.

offbyone commented on Oban, the job processing framework from Elixir, has come to Python dimamik.com/posts/oban_py... · Posted by u/dimamik

offbyone · 13 days ago

Ooof. I don't mind the OSS/pro feature gate for the most part, but I really don't love that "Pro version uses smarter heartbeats to track producer liveness."

There's a difference between QoL features and reliability functions; to me, at least, that means that I can't justify trying to adopt it in my OSS projects. It's too bad, too, because this looks otherwise fantastic.

offbyone commented on X-Clacks-Overhead xclacksoverhead.org/home/... · Posted by u/weinzierl

offbyone · 7 months ago

If you happen to nominate or vote on the Hugo Awards, you may have seen this turn up.

offbyone commented on BreezeWiki makes wiki pages on Fandom readable breezewiki.com/... · Posted by u/LorenDB

offbyone · 10 months ago

Self-hosting breezewiki -- even on the same machine that you browse from -- gets neatly around the way fandom wikis block the breezewiki public nodes. I've got it self-hosted and now I never see that damn fandom interface.

offbyone commented on Adding Mastodon Comments to Your Blog beej.us/blog/data/mastodo... · Posted by u/ingve

offbyone · a year ago

I've been doing this on my site for a couple of years: https://github.com/offbyone/ideas/blob/3f50f69494aca01f21aeb...

It's pretty easy to do. I recommend it, if you already use Fedi for anything.

offbyone commented on Kindle is removing download and transfer option on Feb 26th old.reddit.com/r/kindle/c... · Posted by u/andyjohnson0

fractallyte · a year ago

I spent yesterday morning downloading ALL my (~2400) Kindle books using the command line utility from https://github.com/yihong0618/Kindle_download_helper

In case anyone else needs to do something similar: Log in to your Amazon account > Manage Your Content and Devices

Copy the cookie and save it to a file ('cookie.txt'): https://github.com/yihong0618/Kindle_download_helper?tab=rea...

Execute the Python utility (this example accesses amazon.co.uk):

  python kindle.py --cookie-file cookie.txt --uk -o DOWNLOADS --device_sn [Your Kindle serial no.] --mode all

You can also download a JSON list containing details of all your Kindle books:

  python kindle.py --cookie-file cookie.txt --uk --list --device_sn [Your Kindle serial no.]

There are other methods outlined in the README, but this worked best for me.

I also extracted a list of cover URLs from the JSON file using a basic Python script (with output redirected to a file 'covers.txt'):

  import json
  with open('book-list.json') as f:
    json_data = json.load(f)

  for i in range(len(json_data)):
    print(json_data[i]['productImage'])

And then I used wget to download them all too:

  wget --wait=3 --random-wait --input-file=covers.txt

Of course, the books are still DRM'd, but it's trivial to DeDRM them later. The crucial thing was to get the files before it's too late!

offbyone · a year ago

Well, this is delightful; the links that this tool finds now 403, and looking at the network inspector, it seems that the URLs are now signed in some way.

offbyone commented on Google lays off its Python team social.coop/@Yhg1s/112332... · Posted by u/compiler-guy

zem · 2 years ago

in addition to contributing to upstream python, we

* maintained a stable version of python within google, and made sure that everything in the monorepo worked with it. in my time on the team we moved from 2.7 to 3.6, then incrementally to 3.11, each update taking months to over a year because the rule at google is if you check any code in, you are responsible for every single breakage it causes

* maintained tools to keep thousands of third party packages constantly updated from their open source versions, with patch queues for the ones that needed google-specific changes

* had highly customised versions of tools like pylint and black, targeted to google's style guide and overall codebase

* contributed to pybind11, and maintained tools for c++ integration

* developed and maintained build system rules for python, including a large effort to move python rules to pure starlark code rather than having them entangled in the blaze/bazel core engine

* developed and maintained a typechecker (pytype) that would do inference on code without type annotations, and work over very large projects with a one-file-at-a-time architecture (this was my primary job at google, ama)

* performed automated refactorings across hundreds of millions of lines of code

and that was just the dev portion of our jobs. we also acted as a help desk of sorts for python users at google, helping troubleshoot tricky issues, and point newcomers in the right direction. plus we worked with a lot of other teams, including the machine learning and AI teams, the colaboratory and IDE teams, teams like protobuf that integrated with and generated python bindings, teams like google cloud who wanted to offer python runtimes to their customers, teams like youtube who had an unusually large system built in python and needed to do extraordinary things to keep it performant and maintainable.

and we did all this for years with fewer than 10 people, most of whom loved the work and the team so much that we just stayed on it for years. also, despite the understaffing, we had managers who were extremely good about maintaining work/life balance and the "marathon, not sprint" approach to work. as i said in another comment, it's the best job i've ever had, and i'll miss it deeply.

offbyone · 2 years ago

I was your opposite number at AWS for many years. Like you say, it was one of the best jobs I've ever had, but over there it was a career dead end. I wasn't laid off, but I had to leave it to have any hope of growing myself.

I feel for ya, zem; if you ever turn up at a PyCon in person, lemme buy you a drink.

offbyone commented on Amazon CEO reportedly told remote employees: It’s probably not going to work out theverge.com/2023/8/28/23... · Posted by u/cdme

offbyone · 2 years ago

If you want my cynical take, here's the real reason that Amazon and other big companies are all-in on RTO: the commercial real estate collapse that may (will?) happen if downtown office districts don't repopulate: https://wapo.st/3QXHpFT

I think the reason that Amazon leadership isn't bringing data to support RTO is that not only are they aware of the "Urban Doom Loop” that this article is referring to, but I'd bet you a lot of money that the C-suite (S-team) has a significant investment in commercial real estate.

offbyone commented on Everything that uses configuration files should report where they're located utcc.utoronto.ca/~cks/spa... · Posted by u/ingve

jonhohle · 3 years ago

Amazon had a hierarchical configuration system for loading config that could override other config (or add to it, depending on the implementation). The Java framework would provide an endpoint to show you the final resolved config along with which file and line that value came from. Very helpful when trying to figure out why config was different than expected.

At least the inspector in Safari (and maybe other WebKit browsers) does something similar for CSS.

I’m all for it. It’s a pain when writing config systems (no longer just key/value, but key+value+meta), but very helpful. It can be a pain for things like JSON where libraries don’t give you that type of diagnostic information easily, however.

offbyone · 3 years ago

I had the distinct pleasure (?) of owning the C++, Python, and Java implementations of that config for a while and ... yeah, it had some positives, but the fact that it had two orthogonal hierarchies of configuration in addition to implementation-specific feature gaps and nuances made it something of a nightmare in practice.

offbyone commented on Simple Raspberry Pi Powered SMS Gateway blog.haschek.at/2021/rasp... · Posted by u/DeathArrow

offbyone · 4 years ago

The article is interesting in general, but this line really needs more than "works like a charm": `usb_modeswitch -W -v 12d1 -p 14fe -K -P 14ac -M "55534243000000000000000000000011060000000000000000000000000000"`

I mean, I believe you, but ... what on earth IS all of that?