Hacker News — vinext + Cloudflare Workers

10 points by advanced-stack 2 days ago | 3 comments

ZeroGravitas 1 days ago [-]

I was trying this the other day with opencode and ollama and it all seemed kind of broken/useless.

I don't understand the two llm approach plus telegram here?

It seems like the bot is both creating the telegram interface and using it to be a coding assistant?

advanced-stack 1 days ago [-]

It's mostly a test of the coding capabilities of the 9B model. The 0.8B is used to make the telegram bot smarter than a if/then/else.

I find LM Studio more usable for local setups (desktop/laptop) and I would use directly llama.cpp stack for a (local) server deployment

ZeroGravitas 2 hours ago [-]

I revisited this and using the models directly via ollama run was actually surprisingly fast.

A bug or misconfiguration with the connection to opencode seemed to be the culprit.

2 days ago [-]

Rendered at 15:03:13 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.