I’m still baffled at how good Ollama is on working on paltry hardware like ARM and small VMs. Give it GPUs and it’s amazing.

The next step should be to encrypt information at Transit and rest to as to purchase GPU power from the cloud but maintaining client-side encryption throughout. That’ll bring even more power to the masses: imagine giving Ollama a Cloud endpoint to remote GPUs which it can compute on without the consumer purchasing any hardware.

Hi, thanks for your comment! I just visited your blog and noticed that it loads fairly quickly: I assume you must have some sort of CDN set up. Could you point me to how you went about setting up the CDN for your domain/website? Thanks!