Alternate source: https://techcrunch.com/2023/12/14/cruise-slashes-24-of-self-...
Readit Newspcshah1996 commented on GM's Cruise Unit Is Laying Off 24% of Workforce wsj.com/business/autos/gm... · Posted by u/pcshah1996
So, better than GPT4 according to the benchmarks? Looks very interesting.
Technical paper: https://goo.gle/GeminiPaper
Some details:
- 32k context length
- efficient attention mechanisms (for e.g. multi-query attention (Shazeer, 2019))
- audio input via Universal Speech Model (USM) (Zhang et al., 2023) features
- no audio output? (Figure 2)
- visual encoding of Gemini models is inspired by our own foundational work on Flamingo (Alayrac et al., 2022), CoCa (Yu et al., 2022a), and PaLI (Chen et al., 2022)
- output images using discrete image tokens (Ramesh et al., 2021; Yu et al., 2022b)
- supervised fine tuning (SFT) and reinforcement learning through human feedback (RLHF)
I think these are already more details than what we got from OpenAI about GPT4, but on the other side, still only very little details.
Some discussion on twitter about misleading evaluation: https://twitter.com/a_a_cabrera/status/1732454328307511807
(nitter: https://nitter.net/a_a_cabrera/status/1732454328307511807#m)
pcshah1996 commented on Time to preserve those floppy disks patreon.com/posts/7807424... · Posted by u/wsces
One of my first (toy) websites was a silly floppy disk size calculator. You could enter an amount of songs/movies/files/etc and it would tell you how many disks it would take: https://howmanyfloppydisks.com/
It was very grounding to understand how disk capacity has grown over time.
> So, the current version of the Wikipedia page on vector clocks is wrong, or at least misleading, about the origin of the idea, and it’s kind of my fault.
No. 0% fault of the author and 100% the fault of the Wikipedia editor. Generally speaking, people who are unwilling to ensure the accuracy of their work don't deserve the privilege to do that work.
As usual, a (semi-)relevant xkcd: https://xkcd.com/978/ (Citogenesis)
Interesting stuff! Prompt engineering can really help improve the LLM output(s).
For example, replacing "that's two part name, I want one part name" with "those are compound names, I want a single-part name." Note that the only change is changing "two part" to "compound."
Results look much more reasonable with that: I apologize for misunderstanding your request earlier. Here are some single-part name options for a Diablo 2 Necromancer:
Vex Kain Zoltar Mordecai Stryfe Xander Grimoire Lazarus Zephyr Azrael