Readit NewsI stopped a site lately i ran for 10 years, because Google changed the ranking so often over the years, finally traffic drowned nearly completely like 1k visitors per month, it was so frustrating so I just stopped the webserver after so many years.
Another one but turned out it was never really a big deal: some chatbots from frontier AI labs started to support those niche features (people still coming to my app for the flexibility of using multiple AI models).
I think the biggest problem was #2, life kept pulling me the other way.
It's been a good journey. Thank you so much to whoever keeps running this thread!
Great project btw!
I've been thinking about similar experiments with some obscure esolang for a long time, so more detail on total time/cost would be nice. Also.. if it's correct that this size model is about the right minimal choice for starting such efforts.. what are the next steps if you wanted to shrink it to only specialize in the target? Should you go for distillation or ablation?
Speaking about total time/cost, this experiment cost me just $1.01 for 2h30 on a rental GPU. But the actual successful run was less than 10 minutes for both phases. The rest of the time I was spending fixing the code, tuning the params, train, and retrain. It took me about 6 hours to build and clean the two datasets, though.
For the next step, I'm thinking of improving the model accuracy, maybe with RL, but I would not go about shrinking the model size any lower. Prior to this, I've tried a lot of different model sizes on different kinds of tasks, from 135M to 4B. I'm not sure I like the performance of these small models for code generation :D
I can't find the pricing of the product on the site, I only find that I get '10 free credits', but I don't know how much a credit is and what can I do with it.
Home page says it's one credit per diagram, but then the docs say it's a certain amount of credits per modification (that could be correct or not, I guess...)
I usually skip if I can't find the price, but it could also happen that people create the trial account, spends quickly the credits, then they find the price and it doesn't fit them. Of course, there's always people coming just for the free credits.
I don't know if this is helpful to you or not, but I hope so :)