I have studiously avoided making models, though I've been adjacent to their output for years now... I think the root of my confusion is I kinda assumed there was already PyTorch based scripts for inference / training. (I assumed _at least_ inference scripts were released with models, and kinda figured fine-tuning / training ones were too)
So then I'm not sure if I'm just looking at a clean room / dirty room rewrite of those. Or maybe everyone is using "PyTorch" but it's usually calling into CUDA/C/some proprietary thingy that is much harder to grok than a pure PyTorch impl?
Anyways, these arent great guesses, so I'll stop myself here. :)
This package is basically running the model (inference) and maybe fine tuning it using existing AI weights. A great way to learn but still could run into same licensing issue.
Remote: Remote, Hybrid, On-site
Willing to relocate: Not outside of Canada (until next year).
Technologies: Typescript, React, Node.js, Rabbitmq, cockroachdb, kafka, some llms (in-house) etc.
Email: ntemail@protonmail.com
I am a full-stack engineer (first eight years in front-end and the last two years in full-stack). I've lived in Bay area for half of my life and have worked at startups as well as big tech.