(open AI is not a free service)
I when to get open AI Key to test the AI generator I found that the service you have to pay for, so AI generator should include the free services or should remove the AI generator altogether.
This is correct, OpenAI is not a free service, you need to pay for each API call. I don’t think there are free services that provide API access. Many people are not bothered by paying a dollar or two per month for the extra capabilities AI gives them, so we’ll keep this functionality in the app.
There has been a suggestion for integrating Ollama, which runs on your own computer. This will give you a free option once we integrate it. It won’t actually be “free” of course - you will need to buy a pretty powerful computer to run local models at comfortable speeds, and you’ll have to invest time in setting everything up.
4 Likes
How deep is the OpenAI integration into the app? if we are running and OpenAI compatible AI with a local API wouldn’t just work out of the box? there are very powerful coding models out there now that can run on reasonable machines, local AI is not that unreachable anymore.
Just wanted to bump this topic. I use Ollama to the point that two months ago I have Windows autostart a small script to auto initialize Ollama in a keepAlive = -1 state.(never unloading).
I could thus launch other apps that support local LLMs without that initial prompt delay penalty. Here’s hoping Bootstrap Studio is one of them. BTW, not all countries have access to OpenAI.
Fact of the matter is, I’m in one of them.
1 Like
Computers are getting more powerful all the time, and all the new Macs can run ollama, depending on the memory usage of the model. It should be quite easy to add the capability. If you really want to go crazy, then add support for the ollama mcp tool integration. thanks in advance