A llm backend fantasy game. It uses structured output and supports Openai, Anthropic and LM Studio. Gemini support is ending, at the moment it is not working reliable.
https://github.com/HabermannR/Fantasy-Tribe-Game
Readit NewsRHab commented on Ask HN: What are you working on? (October 2024) · Posted by u/david927
RHab commented on Structured Output for LM Studio 0.3.5, OpenAI, Anthropic and Gemini github.com/HabermannR/Fan... · Posted by u/RHab
I am trying to understand structured output from LLMs, and as training I am building a text game.
OpenAI is using pydantic to create objects directly in its beta branch, it's quite nice. Anthropic is a bit more involved, as you need to involve tool calling.
LM Studio 0.3.5 introduced a bug for structured output when using pydantic and enums or literals, I created a workaround.
Also Gemini is not using Pydantic at all, instead TypedDict to create the json scheme.
And Gemini does not have a system message.
I am quite proud to have everything working, if you want to check out my code please take a look: https://github.com/HabermannR/Fantasy-Tribe-Game
Here is the backend: https://github.com/HabermannR/Fantasy-Tribe-Game/blob/main/L...
For example, this is how I call Gemini:
completion = model.generate_content(
messages[0]['content'] + ": " + messages[1]['content'],
generation_config=genai.GenerationConfig(
response_mime_type="application/json", response_schema=response_types.typed_dict
),
)
result = response_types.pydantic_model.model_validate_json(completion.text)
Happy for any feedback!
Hi, I am programming as a hobby since I am seven, and I always wanted to program a game, but never finished anything. I am super fascinated by LLMs, and made a small interactive text-based strategy game, where the player can choice a tribe and then gets presented 3 choices, which will shape the development of the tribe from humble beginnings to god like ascension. Everything is done procedurally by an LLM using structured output. I support OpenAI, Anthropic, and local LLM, tested with LM Studio.
Please take a look and give me some feedback, thanks!
https://github.com/HabermannR/Fantasy-Tribe-Game
The weirdest one of the bunch is the AMD EPYC 9175F: 16 cores with 512MB of L3 cache! Presumably this is for customers trying to minimize software costs that are based on "per-core" licensing. It really doesn't make much sense to have so few cores at such an expense, otherwise. Does Oracle still use this style of licensing? If so, they need to knock it off.
The only other thing I can think of is some purpose like HFT may need to fit a whole algorithm in L3 for absolute minimum latency, and maybe they want only the best core in each chiplet? It's probably about software licenses, though.
Abaqus for example is by core, I am severly limited, for me this makes totally sense.
Lancom Systems | Senior Data Platform Engineer | Karlsruhe,Würselen,Remote(EU - Germany, Spain, Austria, Belgium, Netherlands) | Full-time | https://www.lancom-systems.com
Lancom Systems provides cloud-managed networking solutions.
My team is responsible for processing metrics and logs sent by the devices. Our stack consists of ClickHouse, Kafka, K8s, Helm, Argo, Kotlin and Vert.x (and some Spring).
We are looking for a data platform engineer that is comfortable evolving SQL schemas, optimizing our deployments and extending our data pipeline. Previous experience in all technologies is not required, but you should have a high interest in working with data-intensive applications and a willingness to learn.
Interested? Email me at jonas.vonandrian … lancom.de
Würselen! The world is small :D
No plastic material, only basic contact, no advanced connectors...
This is my problem with all these fancy FEA codes, nice in theory, not fit for industrial models.