sitefail1 (u/sitefail1)

KronisLV · 4 months ago

I like the AI integrations (they me use Claude Sonnet 3.7, Gemini 2.5 and GPT 4.1 with my all products pack) and quite enjoy their Junie tool, much better than my attempts at getting Aider working.

UI seems pretty okay, at least on the 2025 versions of the tools (in compact mode, Inter 12 as the custom UI font on a 1080p monitor) but still quite the resource hog.

Oh well, I’m actually going to try their Fleet as well after reinstalling my OS because it was worse than VSC the last time I tried it, might be better now.

sitefail1 · 4 months ago

It's not. The functionality gap between VSC and Fleet has further widened, and its future looks even more unsure now they backed out the Kotlin native stuff back to the main IDEs.

tzury · 4 months ago

Vertex by example:

    creds = service_account.Credentials.from_service_account_file(
        SA_FILE,
        scopes=[
            "https://www.googleapis.com/auth/cloud-platform",
            "https://www.googleapis.com/auth/generative-language",
        ]
    )


    google.genai.Client(
        vertexai=True,
        project=PROJECT_ID,
        location=LOCATION,
        http_options={"api_version": "v1beta1"},
        credentials=sa_creds,
    )

That `vertexai=True` does the trick - you can use same code without this option, and you will not be using "Vertex".

Also, note, with Vertex, I am providing service account rather than API key, which should improve security and performance.

For me, the main aspect of "using Vertex", as in this example is the fact Start AI Cloud Credit ($350K) are only useable under Vertex. That is, one must use this platform to benefit from this generous credit.

Feels like the "Anthos" days for me, when Google now pushing their Enterprise Grade ML Ops platform, but all in all I am grateful for their generosity and the great Gemini model.

sitefail1 · 4 months ago

I don't think a service account vs an API key would improve performance in any meaningful way. I doubt the AI endpoint is authenticating the API key against a central database every request, it will most certainly be cached against a service key in the same AZ or whatever GCP call it.