Readit NewsYes you can. The community creates quantized variants of these that can run on consumer GPUs. A 4-bit quantization of LLAMA 70b works pretty well on Macbook pros, the neural engine with unified CPU memory is quite solid for these. GPUs is a bit tougher because consumer GPU RAM is still kinda small.
You can also fine-tune them. There are lot of frameworks like unsloth that make this easier. https://github.com/unslothai/unsloth . Fine-tuning can be pretty tricky to get right, you need to be aware of things like learning rates, but there are good resources on the internet where a lot of hobbyists have gotten things working. You do not need a PhD in ML to accomplish this. You will, however, need data that you can represent textually.
Source: Director of Engineering for model serving at Databricks.
Our mileage certainly varies - I would not consider buying an iPad (I already have an iPad mini and don't want more of that), but this device I really like. It's hard to put a finger on it. I read other reviewers claiming that reading e.g. X in greyscale is less addictive, and I didn't really believe it until I tried it myself. Something is certainly different about my workflows on this device.
Reading it late at night is much more enjoyable than reading an iPad, even with the Night Shift on.
I found it:
- oddly heavy, the Daylight is made of all plastic (body & screen) - yet it’s heavier than an iPad Air made from metal & glass.
- handwriting lag, the input lags when I use the pen is so much that it distracts me while writing a sentence. I have to concentrate to ensure it’s keeping up with each letter I write. No such lag exists with my iPad Air.
- no setup instructions or tutorial on its unique gestures. You boot it up and have to figure out how it works and getting it on WiFi
- display resolution is much worse than I was expecting.
- when using chrome, webpages render incredibly small. I’m having to constantly zoom in. There’s a setting in chrome about “desktop mode” but it made no difference.
And I also wasn’t expecting to have to sign up for a Google account to even get software updates, even from Daylight. (Maybe I don’t but that’s what the Google App Store made it seem like).
Wish I had read this review before I had bought it.
https://www.theverge.com/2024/7/20/24201356/daylight-compute...
* Note: I truly love the idea of Daylight, and hope they succeed. But in my mind, a considerable device improvement needs to be made to realize that vision. Until then, I’ll revert back to using my iPad Air (and now with nano-texture coming more broadly across Apple lines, Daylight is going to have that much more to overcome - because Apple is also cheaper product).
- oddly heavy: it's indeed heavier than remarkable, but not an issue for me.
- handwriting lag: hm, which app did you use? I didn't notice that in both Reader and Notes, the experience was all right for me.
- no setup: valid feedback, I had to figure out things myself. Granted, it's an Android tablet, so I think I discovered most of the shortcuts etc. Not that much different from iPad.
- display resolution: maybe because I used iPad mini (and Remarkable) before, I didn't have very high expectations. The resolution is OK with me.
- chrome rendering too small: I didn't notice that before you mentioned it, but you can also change the default zoom level in Settings -> Accessibility, which I just discovered.
- Google ecosystem: yep, I kinda expected that given that I knew it's an Android tablet, so that was not an issue for me.
Update: Here is what o3 thinks about this topic: https://chatgpt.com/share/688030a9-8700-800b-8104-cca4cb1d0f...