Readit News logoReadit News
haxel commented on Ask HN: What do you do with Local LLMs?    · Posted by u/rkwz
Tepix · a year ago
If you send yourself messages via a Discord bot, you lose the privacy advantage of running a LLM locally.

Discord does not have end-to-end encryption for messages.

haxel · a year ago
Indeed. Currently, my primary concerns are a) surprise b) accessibility c) efficiency and d) self-containment.

Surprise, because that draws my attention better. Not interested in guardrails here.

Accessibility, because I can involve my sons without friction.

Efficiency, because using Discord lets me skip building or finding a component (for now).

And I still get a degree of self-containment because Discord is the only piece I'll need to swap out. Bonus that it doesn't have a recurring cost until then.

Yet privacy still matters to me. Despite being Discord-compromised, the detailed personal context within the prompts remains private. The data that determines the timing and topic of each message remains private as well.

haxel commented on Ask HN: What do you do with Local LLMs?    · Posted by u/rkwz
haxel · a year ago
I use Mistral (7B v0.2 instruct, 6-bit quantized) to generate the title-text for messages that I send to myself via a Discord bot.

Right now, I'm prompting Mistral to generate these titles in "clickbait" style. I fold the topic of the message and other context into the prompt.

My intention is to shift my attention to the message, which shifts my attention to something else I need to do, because I tend to over-focus on whatever I'm doing at the moment.

It doesn't matter whether what I'm doing at the moment is "good" or "bad". Based on probability, I should almost always switch my attention when I receive such a message because I should have switched an hour ago.

To guarantee consistent JSON output, I use a llama.cpp grammar (converted from JSON schema)

Generation is via CPU (Ryzen 5800) because it's an async background operation and also because my 1070 GPU is being used by Stable Diffusion XL Turbo to generate the image that goes along with the message.

haxel commented on Ask HN: Freelancer? Seeking freelancer? (February 2024)    · Posted by u/whoishiring
haxel · 2 years ago
SEEKING WORK - Mostly remote

Location: West coast Canada. Remote: Yes (occasional Vancouver onsites OK).

Frontend: SolidJS, React, Material UI, and more.

Backend: FastAPI, Flask, and more (mostly Python)

Services: PostgreSQL, OpenZFS, GlusterFS, Redis, Docker Swarm, Kubernetes, and more.

Additional: Article writing, report writing, diagramming, research, conceptual communication, and more.

I have decades of experience at all levels of the tech stack, from provisioning hardware up through services, backends, frontends, and including architecture, app design, and UIs from scratch.

When necessary, I will synthesize and implement a novel solution (while making the most of existing components).

I've been brought in multiple times as an emergency fixer and executed the rescues successfully.

I've also taken on high-level roles requiring decision-making, planning, and communication skills to go along with demonstrated high integrity.

Willing to take a crack at anything substantial.

Email: clyde6@gmail.com

haxel commented on Show HN: I wrote an entire book to build a mouseless dev environment   themouseless.dev/... · Posted by u/thanato0s
j1elo · 5 years ago
I've been meaning to finally upgrade from my ancient but perfectly functional Linux Mint 18.3 (based on Ubuntu 16.04) to Regolith Linux, with the intention of getting into an i3 environment.

Any thoughts or comments about Regolith?

EDIT to mention that for people interested in getting into tiling window managers (such as i3), the Pop_OS distro also comes with its own, optional tiling wm that can be switched on/off, which might be a nicer and more approachable middleground for newcomers

haxel · 5 years ago
Not OP, but I swapped over to Regolith a couple of months ago on my laptop and now it's on my main workstation too. Coming from Ubunutu MATE on both. Very happy with it.

It's my first time using i3 or any tiling WM for that matter. Took about a day to get used to the basics (sane defaults), and that's mostly all I've needed so far.

My one attempt to use the dedicated installer didn't work properly so instead I installed Ubuntu and then Regolith from PPA.

haxel commented on Show HN: Measure and compare your viral risk the easy way   howfunctional.com/viral-r... · Posted by u/haxel
haxel · 5 years ago
Developer statement

IMPORTANT: Android + Chrome only! (for now)

They say you can't manage what you don't measure.

This is a system to help people who feel fine but are worried about becoming infected by COVID-19 or any other dangerous virus. If this is you, now you can actively measure your risk and see a live dashboard in your Android phone's notification bar.

Your regularly refreshed dashboard shows your own risk pattern and compares it with your recent past as well as the risk patterns of other people. This makes it easier for you to manage both your behavior patterns and your mental health.

It's an early release by a single developer, extended from an existing platform. Please don't expect perfection.

Geographical awareness is an obvious next step. Infection/symptom awareness is another.

Feedback welcome!

haxel commented on Ask HN: What projects are you working on now?    · Posted by u/sakopov
haxel · 5 years ago
I'm building a way to roughly (and simply) track your own viral risk in real-time and compare it with others.

https://howfunctional.com/viral-risk

Android-only right now. Precision is not the intention. Getting the ball rolling is.

The tracker is currently in prototype form so it may look or act a bit odd, not least because I quickly extended an existing platform.

u/haxel

KarmaCake day160August 18, 2012
About
Infinitely creative full-stack developer who's done it for decades now.

https://haxel.ca

steve@

View Original